UltraText Bench evaluates prompt-only image generation using 432 human-reviewed prompts across 24 real-world scene categories. Prompts are split equally between English and Chinese, cover three difficulty levels, and specify exact strings for four to twelve text regions with structured references for content, placement, and visual attributes.
A scores generated images on text fidelity, clarity, spatial quality, and scene quality. Results across 24 model configurations show that these dimensions can diverge sharply: Z-Image-Turbo improves clarity by 3.81 points over Z-Image-Base but loses 14.76 fidelity points, while Qwen-Image-2512's English composite drops from 86.50 at L1 to 42.86 at L3. This makes the useful for detecting failures hidden by a single aggregate quality score.