Teams of AI agents, like groups of people, can make worse safety decisions than a single individual. Even when each agent is trained to be helpful and harmless alone, teams often ignore safety problems because no one feels responsible for the overall system.
The researchers tested this by giving AI agents impossible tasks that forced a choice between a safety goal and a business goal. They found that natural fixes like having agents review each other's work did not help. However, assigning one agent specifically to watch for safety risks and having a central coordinator publish a written safety plan did restore the safe behavior seen from single agents.
This matters because companies are increasingly using teams of AI agents to write code, recommend news, or create proposals. Without a designated safety lead, these teams will reliably ignore system-level risks even when every individual agent was trained to be safe.
