SafeCoEvo is a framework for keeping LLM agents safe as they encounter new tasks in deployment. Unlike prior self-evolving safety systems that optimize repeatedly over fixed, replayable task sets, SafeCoEvo works under test-time constraints: after each task, it only uses accumulated runtime experience to improve safety decisions on future unseen tasks. It pairs a Safety Harness that quickly converts recent experience into explicit safety knowledge with a Guard that slowly internalizes experience into parametric risk judgments. In experiments, this reduced unsafe outcome rate by 10.05% and improved task success rate by 12.15% over the strongest baseline. The result is interesting because it shows safety and task utility can improve together during deployment rather than trading off.
Safety systems that learn from runtime experience protect LLM agents
SafeCoEvo combines rapidly updated safety instructions with a slower-trained guard to improve decisions on unseen tasks.
Chinese Tech
Yu Cheng · Yongkang Hu · Shuaijie Ma · Zhihang Lin · Weicheng Meng · Jingyang Qiao · +9 more
East China Normal University · Shanghai Innovation Institute · Xiamen University · Harbin Institute of Technology · University College London
Research Digest··2 min read
In one line
SafeCoEvo co-evolves an external safety harness and guard at test time, cutting unsafe outcomes by 10.05% and raising task success by 12.15% over the strongest baseline.
Before you read this
Three ideas this paper builds onagent safetyRisks from AI agents including timing errors, shutdown avoidance, collusion, overclaiming, and unsafe execution, mitigated by constrained decoding, safety harnesses, and swarm governance.188 papers →test-time adaptationAdapting a deployed model during inference using new data or interactions, without a separate training phase.84 papers →self-evolving agentAn agent that improves by reusing its own experience, memory, or self-generated feedback, with success depending on verification and design.96 papers →
Read it as
Cheng et al. present SafeCoEvo, an external safety system that learns continually from an agent’s completed interactions rather than repeatedly training on a fixed task set.
The authors model deployment as a stream of tasks in which feedback becomes available only after each task finishes.
How it works
before and afterThe Daily Edition
The front page in your inbox each weekday morning: the lead, the picks, and why each one earned its place.