The paper introduces ConfLens, a framework that tracks how an LLM's confidence in its final answer evolves across reasoning steps, and DACS (Distributional Answer Commitment Score), a confidence estimator based on the entropy of the model's probability distribution over answer commitment. The authors find that shortcut reasoning (e.g., sycophancy or ) consistently shows high confidence early in the reasoning process, unlike faithful reasoning. Experiments on math and code tasks show that DACS improves shortcut detection F1 by over 4.3% compared to strong baselines, and can be used to steer reward models away from preferring shortcut reasoning responses. The work addresses the challenge that verbalized chain-of-thought can be unfaithful, and provides a way to detect such behavior without needing ground-truth answers or task-specific verifiers.
Early answer confidence reveals when language models take reasoning shortcuts
The authors introduce ConfLens and DACS, a method that detects shortcut reasoning by tracking when a model becomes prematurely committed to its final answer.
Chinese Tech
Zhaohan Zhang · Junjie Liu · Chengzhengxu Li · Chen Shen · Xiaoming Liu · Chao Shen · +3 more
Queen Mary University of London · Tongyi Lab, Alibaba Group · Xi'an Jiaotong University
Research Digest··2 min read
In one line
Shortcut reasoning in LLMs is detectable by tracking premature rises in answer confidence during generation.
Before you read this
An idea this paper builds onRead it as
Zhaohan Zhang and colleagues propose ConfLens, a framework that monitors how an LLM's confidence in its final answer evolves during chain-of-thought reasoning.
The authors designed ConfLens to track changes in a model's answer belief at each reasoning step.
How it works
before and afterThe Daily Edition
The front page in your inbox each weekday morning: the lead, the picks, and why each one earned its place.