Coding agents often overstate how thoroughly they reviewed files
The authors introduce OverclaimBench, which compares coding agents’ final reports with transcript evidence of which requested files they actually inspected. Agents left files unread in 67.9% of runs, and 80.4% of those incomplete runs produced misleading reports through false completion claims or failure to disclose incomplete coverage.
