Search

Any time Past 24 hours Past week Past monthSort:Relevance Newest

Benchmark

MATH-500

Reported in 46 papers on Zotpaper. The latest, each as the paper states it:

Reasoning models can be trained to stop when they know the answer91.8% Accuracy
Language models learn harder problems but can forget easier ones93.24% Pass@128
Parallel training method speeds language model inference by 3.5x4.57 acceptance length

MATH500 (20)All benchmarks →

1 result for “MATH500”

Research · Evaluation & benchmarks
LLMs fail multi-step math despite solving each step correctly
Solving Every Step Is Not Enough: Milestone Oracles Reveal a Composition Gap in LLM Math Reasoning
OracleLadder diagnostic reveals a composition gap that accounts for 33–48% of failures across six models.
MATH500: 3 families solved directly (as reported)
3 Oct 2026Rutgers University, Harvard University, The Hong Kong University of Science and TechnologyCode