You edit photos by telling an AI what to change. Safety filters check the text instruction carefully, but barely look at the picture itself. This means a dangerous image with a harmless editing request can easily slip through.
The team created EditSafetyBench, a standard test with nearly six thousand image-instruction pairs. They tested four major systems from Google, OpenAI, and Alibaba across eleven risk categories to measure when edits are allowed or refused.
The main finding reveals a blind spot: systems refused over four-fifths of risky text prompts but blocked only about a quarter of unsafe images with neutral requests. This matters because current guardrails are effectively blind to visual risk, allowing dangerous content to be edited as long as the text instruction is benign. Providers must build filters that jointly consider what the image shows and what the text asks.
