Apple tightens App Store rules against AI nudification apps and bait-and-switch scams

Guideline update follows a year of investigations into harmful apps reaching users, including minors

By LineZotpaper
Published
Read Time2 min
Sources2 outlets
Apple has updated its App Review Guidelines in a move aimed at stopping AI-powered “nudify” apps and bait-and-switch apps that have repeatedly slipped past its review process, after a year of investigations, enforcement orders and controversies over harmful content on the App Store.

Apple published changes to its App Review Guidelines today, in an update intended to strengthen protections against harmful content and deceptive app review practices, according to 9to5Mac.

The update follows a turbulent year for App Store oversight. In January, the Tech Transparency Project (TTP) identified dozens of AI-powered “nudify” apps on the store. The same month, reports that Elon Musk’s AI chatbot Grok had been used to generate nonconsensual sexualized images of women and minors led lawmakers and advocacy groups to call on Apple to remove X and Grok. Apple later confirmed it had privately warned xAI that Grok could be removed unless the issue was addressed.

In April, a follow-up TTP investigation found Apple’s App Store search suggestions and advertisements had steered users toward nudify apps. In July, San Francisco officials ordered Apple to remove eight apps capable of generating nonconsensual intimate imagery.

Also in July, a 9to5Mac investigation uncovered dozens of apps in Brazil that disguised gambling platforms as simple games and utilities, many of them available to children. The apps behaved as advertised when accessed from outside Brazil, but revealed hidden betting platforms when opened from Brazilian IP addresses.

The guideline changes arrive as Apple faces continued scrutiny over whether its review process can keep pace with AI-generated abuse. Whether the new rules translate into enforcement against the apps that prompted them remains to be seen.

§

Analysis

Why This Matters

  • The App Store is the only sanctioned channel for software on iPhones and iPads, so Apple’s review rules define what millions of users, including minors, can be exposed to.
  • The update is a direct response to documented failures: AI apps that generate nonconsensual intimate images, disguised gambling apps, and sexualized deepfakes produced through Grok.
  • It signals whether Apple can police AI-era harms that its review process was not built for.

Background

Apple has long presented App Review as a safeguard that keeps malware, scams and inappropriate content off iOS. That claim came under sustained pressure over the past year. Investigators found apps that used AI to undress people in photos, apps that hid gambling platforms by changing their behaviour depending on the user’s location, and a prominent AI chatbot generating sexualized images without consent. The guideline update is Apple’s attempt to close those gaps, though the question of enforcement remains open.

Key Perspectives

Apple: The changes are framed as a strengthening of protections against harmful content and deceptive review practices, an acknowledgment that previous rules let problem apps through. Watchdog groups: The Tech Transparency Project and similar researchers documented how easily nudify apps reached users, including through Apple’s own search suggestions and ads; they are likely to measure the update by actual removals, not promises. Developers: Stricter guidelines add another layer of scrutiny to an already demanding review process, raising concerns that legitimate apps could be caught up in enforcement or that rules will be applied unevenly.

What to Watch

  • Whether known problem apps, including the eight San Francisco ordered removed, actually disappear under the new rules.
  • Whether enforcement is applied to high-profile apps such as Grok, which Apple previously warned privately.
  • How Apple detects bait-and-switch behaviour, given that region-specific content has repeatedly fooled reviewers.

Sources

Zotpaper

Written by software from the reporting listed above, scored by an automated standards desk, and published without a person reading it first. If something here is wrong, tell the editor and it will be put right.

How we workSubscribe