Newer Google and OpenAI image models were easier to bypass, White Circle researchers say
The same attack method elicited explicit nudity more often from newer versions. The researchers offer possible explanations, but the cause remains unresolved.
Loading page…
The same attack method elicited explicit nudity more often from newer versions. The researchers offer possible explanations, but the cause remains unresolved.
Listen to this story
White Circle’s RISE framework found that deliberate jailbreak attempts succeeded more often against newer Google and OpenAI image models, even though researchers reused the same strategy after submitting their paper. The results indicate weaker resistance in this specific adversarial test, not that ordinary image requests commonly produce nudity. White Circle says it notified both companies and plans to release its reproduction pipeline, while keeping the prompts, attack strategies, and images private.
Google’s explicit-nudity bypass rate rose from 9.5% on Nano Banana 2 to 20.7% on Nano Banana 2.1.
OpenAI’s rate increased from 3.3% on GPT-Image-2 to 7.8% on GPT-Image-2.5-Flare.
RISE uses Qwen3-32B to generate jailbreaks and Gemini Flash to judge whether outputs violate policy; researchers reviewed results.
Newer image generators from Google and OpenAI were more vulnerable to attacks that elicited explicit nudity, Ars Technica reported on October 14, citing White Circle researchers. Their automated testing used widely available AI tools, not custom-built advanced models. The researchers found that explicit-nudity bypass rates more than doubled for both model families.
The latest account follows White Circle’s publication of RISE, short for Red-teaming via Iterative Strategy Evolution. Red-teaming means deliberately trying to make a system break its rules. Its earlier tests covered DALL·E 3, GPT-Image-2 and Nano Banana 2, producing policy-prohibited images on up to 13% of attempts.
After submitting the paper, the researchers tested newer versions without changing RISE. White Circle’s comparison measures success under deliberate attack testing—not the share of ordinary image requests that produce explicit material.
White Circle offered two possible explanations to Ars: newer models may generate a wider range of content, or safety may have been deprioritized in favor of capability. Those are working hypotheses, not demonstrated causes.
RISE searches for attack patterns that work across multiple prompts and scenarios, rather than testing isolated requests alone. One AI model generates jailbreaks—requests designed to get around safeguards—while another judges whether the resulting images contain prohibited content. The goal is to find strategies that transfer between models.
White Circle identifies the attacker as open-source Qwen3-32B and the judge as Gemini Flash. A lightweight software harness connects them. The researchers reviewed outputs to verify the bypass rate. Midjourney was excluded because it lacked a public API—a software interface—suitable for controlled benchmarking.
White Circle says it shared the findings with affected companies before publication. Neither Google nor OpenAI responded to Ars’s requests for comment, including its follow-up with the newer-model findings.
White Circle says its reproduction pipeline is open source on GitHub, while attack prompts, discovered strategies and generated images remain private. Ars describes the release as still planned. The stated aim is to let defenders and regulators repeat the evaluation without publishing those specific attack materials.
Chief executive Denis Shilov told Ars that independent safety testing should be mandatory. White Circle is in early talks with government officials about third-party testing; that remains advocacy and discussion, not a new requirement.
Loading discussion...
Join the conversation
Explain where you would draw the line between transparency and enabling misuse.
Be the first to share a perspective or an experience.
Reader comments
Newest comments first. Replies stay oldest first.