The paper introduces INSPIRE, a for evaluating agents that search prior literature when given only a research problem (solution redacted). Each instance hides the target paper and its cited antecedents, requiring the agent to surface relevant prior work from an open corpus within a fixed search budget. INSPIRE goes beyond end-to-end retrieval quality by logging search trajectories to diagnose three stages: resource exposure (whether useful papers are surfaced), selection (whether retained), and ranking (order).
Across 476 computer-science targets, the best agent achieved 0.284 nDCG@10, indicating substantial room for improvement. The stagewise analysis identified resource exposure as the largest bottleneck, with additional losses in selection and ranking. The benchmark also provides replay-valid hindsight demonstrations that improve held-out search without changing test-time information, establishing INSPIRE as an actionable learning signal for developing better literature search agents.