Apple Tightens App Store Rules: AI-Generated Nonconsensual Intimate Imagery Must Be Proactively Blocked

What happened

On October 16 (1:05 p.m. Pacific), Apple published revised App Store Review Guidelines on its developer site. The revised Guideline 1.2 names "AI content creation apps" for the first time, alongside social media and user-generated-content platforms, requiring them to treat nonconsensual intimate imagery — including imagery generated using AI tools — as content they must proactively prevent and remove.

The requirements include a method for filtering objectionable material, a reporting mechanism with timely responses, the ability to block abusive users, and published contact information; developers must also prevent users from uploading such imagery and remove anything that slips through. Developers who fail to implement appropriate safeguards or to remediate violations after notice may be treated as violating the Developer Code of Conduct, risking app removal and, in serious cases, termination of the developer account.

The same update added Guideline 2.5.19, explicitly prohibiting hidden features in the submitted build — including hiding undocumented features through code obfuscation. Apple says some apps used a bait-and-switch tactic: behaving normally during review, then switching on nudify features after approval. Offenders face app removal and developer-account termination.

Separately, Section 5 was expanded: apps found to facilitate human trafficking or child sexual exploitation will be removed and blocked from alternative distribution.

Key facts

1. Scope: Apps that let users "create, generate, upload, share" content; AI content creation apps named for the first time
2. Four baselines: Content filtering, reporting with response, blocking abusive users, published contact info — all required
3. Escalated penalties: Not just app removal — violations can count as Developer Code of Conduct breaches, up to account termination
4. Anti-bait-and-switch: New Guideline 2.5.19 names code obfuscation and similar hiding methods; adding features post-review is a violation