The work tests whether models actually need each piece of evidence in an annotated multi-hop reasoning chain. Its Behavioral Necessity Rate measures how often removing targeted evidence prevents a model from recovering an answer it originally got right, with matched background deletion used to distinguish evidence dependence from general sensitivity to missing text.
Across five existing , panel-mean BNR ranges from 16.6% to 48.9%, suggesting that many correct answers do not depend on every intended hop. REALHOP constructs more diagnostic questions by rebinding entities, splitting relations into linked premises, adding complete competing paths, and recording evidence at traceable locations.
On 790 paired MuSiQue questions, REALHOP increases panel-mean BNR from 27.4% to 94.4% while Full accuracy remains 68.5% to 83.5%. For 216 long-context questions, it expands the accuracy spread across 16 models from 13.9 to 59.2 points, indicating substantially better discrimination between model capabilities.