Audio LLMs often claim that degraded speech can be transcribed reliably even when their actual word error rate is high. Zero-shot and two-shot self-assessment did not reliably fix this overconfidence.
A lightweight classifier instead uses representations from the frozen audio encoder to label input as reliable or having minor, moderate, or severe degradation before generation. On Qwen2-Audio-7B-Instruct, it achieved 81.10% in-domain and 78.09% cross-domain macro-F1, beating the strongest baselines by 10.33 and 11.93 points. This could let a voice system request clarification rather than answer a misheard query.