SMART is a self-evolving multi-agent system for long-form subtitle translation. During test-time training, it builds series-level memory and translates a subset of sentences using a dynamic router, a Mixture-of-Agents layer, and tools for terminology verification, subtitle constraint validation, and contextual retrieval. A judge-refiner loop scores candidates and uses textual critiques to update agent prompts and routing policies without retraining the underlying LLMs. During inference, the evolved configuration translates the rest of the series.
SMART achieves the best overall MQM score in all 15 translation directions of the new Subtitle Arena benchmark, reducing the average penalty by 6.9% over the strongest competing agent system. It also obtains the best model result on the public MuSC benchmark across all 4 language pairs and a human evaluation score of 4.50/5. The system addresses key challenges in long-form subtitle translation—long-range consistency, adaptive coordination, and contextual awareness—without modifying LLM parameters.