Training smaller student AI agents by imitating larger teacher agents usually has them copy both the teacher's internal reasoning steps (thoughts) and its external actions. This is slow and expensive. This paper investigates whether copying the thoughts is actually necessary. The researchers trained student agents in two ways: one including the teacher's thoughts, one without them. They tested both methods on common agent benchmarks where agents interact with environments. They found that students trained without thoughts performed almost as well as those trained with them, and sometimes better. The main finding is that when the teacher's action already reveals the reasoning behind it, copying the thoughts adds little value. This means training can be faster and cheaper by skipping thought supervision when actions are informative enough. The result challenges the standard practice of fully copying teacher trajectories.
Omitting reasoning from training data does not harm AI agents on standard benchmarks
The authors demonstrate that on common agent tasks, student performance is nearly unaffected when reasoning traces are removed from training, but on quantitative reasoning tasks where actions do not disclose the reasoning, thought supervision remains crucial.
Academic
Min-Seon Kim · Seungdong Yoa · Sanghyu Yoon · Ye Seul Sim · Suhee Yoon · Dongmin Kim · +1 more
North Carolina State University · LG AI Research
Research Digest··2 min read
In one line
Thought supervision in LLM agent distillation is often unnecessary because the key information is already present in the agent's action.
Before you read this
An idea this paper builds onRead it as
The authors investigate the role of reasoning step (thought) supervision in LLM agent distillation.
The authors decouple thought and action supervision in LLM agent distillation by independently perturbing or removing each component during training.
How it works
stage by stageThe Daily Edition
The front page in your inbox each weekday morning: the lead, the picks, and why each one earned its place.