Research · Language models
Entropy signals guide efficient reasoning repair in LLMs
REWIND: Uncertainty-Guided Trajectory Repair for Test-Time Reasoning
Ding et al. introduce REWIND, a training-free method that uses token entropy dynamics to select optimal points for regenerating suffixes, improving reasoning accuracy across multiple models and benchmarks.
MATH500: 77.6% accuracy (as reported)
The Hong Kong University of Science and Technology (Guangzhou), University of Edinburgh, Huawei