Apple tightened its App Store developer guidelines over the weekend to ban apps that use AI to create offensive content, as well as apps that masquerade as ordinary programs during review and later turn into nudify apps or surface those features prominently.
The updated rules require apps that host user-generated content to include preventative measures to moderate objectionable material. "Apps that host user-generated content are required to filter objectionable material, give users a way to report offensive content, and let users block abusive accounts," the company said in a blog post.
Apple also said apps containing hidden or undocumented features are prohibited, including apps that misrepresent their purpose during review and only reveal harmful capabilities, such as "nudification," after approval, a tactic it described as bait-and-switch. The company said it will remove apps that add features not present in the version submitted for App Store review, and it has reinforced its legal language to make clear it will bar apps promoting human trafficking and the exploitation of children.
Apple said its review process blocked more than 150,000 apps from reaching users last year and removed 193,000 developer accounts for fraud and abuse.
The changes follow growing pressure over AI-based nudification apps. In July, San Francisco City Attorney David Chiu ordered Apple and Google to clean up and delete such apps from their stores, accusing the companies of profiting from them through store fees. In April, a Tech Transparency Project report found that both stores hosted multiple nudify apps, some of which were rated as suitable for minors.