SALMONN-duo is a voice agent that separates real-time conversation from complex reasoning by pairing two systems: a fast, always-on speech LLM (system 1) and a slower, more powerful asynchronous LLM agent (system 2). System 1 handles normal dialogue and learns when to delegate difficult questions to system 2, then integrates the returned information without interrupting the flow. Evaluations show this adaptive delegation improves accuracy on knowledge-intensive and multi-step reasoning questions while avoiding unnecessary use of system 2, and cost-aware further optimizes the trade-off between performance and backend usage.
Dual-system voice agents balance live conversation with slower tool use
SALMONN-duo delegates difficult requests to an asynchronous reasoning agent while keeping a fast speech model responsive to the user.
Chinese Tech
Wenyi Yu · Siyin Wang · Terumi Chiba · Xianzhao Chen · Xiaohai Tian · Jun Zhang · +2 more
Tsinghua University · ByteDance
Research Digest··2 min read
In one line
Adaptive delegation between fast and slow reasoning enables full-duplex voice agents to balance real-time interaction with complex task accuracy.
Before you read this
Three ideas this paper builds onmulti-agent architectureA system where multiple AI agents collaborate, each handling specialized roles, communicating and coordinating to complete complex tasks.117 papers →model routingDirecting each query or subtask to the most suitable model to optimize cost, accuracy, or quality.89 papers →reinforcement learningA machine learning method where an agent learns to make sequences of decisions by receiving rewards or penalties for its actions.296 papers →
Read it as
The authors pair an always-active, full-duplex speech model with a slower backend agent that can reason and use tools.
The authors built SALMONN-duo around two coordinated components.
How it works
before and afterThe Daily Edition
The front page in your inbox each weekday morning: the lead, the picks, and why each one earned its place.