Search

Benchmark

MMLU-PRO

Reported in 25 papers on Zotpaper. The latest, each as the paper states it:

All benchmarks →

2 results for “MMLU-Pro”

  1. Research · Reinforcement learning

    Turning failed reasoning attempts into training signal improves GRPO on hard problems

    Failure Is the Mother of Success: Recovering Supervision with Grounding Hindsight

    RSHD generates corrective notes from failures, verifies them via replays, and distills successful behaviors into the policy without extra inference cost.

    MMLU-Pro: 60.7% accuracy (as reported)

    University of California, San Diego, Adobe Research, University of Virginia

  2. Research · Reinforcement learning

    Posterior rewards become indistinguishable for long reasoning traces in LLM training

    Rethinking Probability-Based Reinforcement Learning From Posterior Concentration

    The authors identify a length-dependent failure mode they call Posterior Concentration Phenomenon, and propose a framework to mitigate it.

    MMLU-Pro: 61.3% Avg@2 (as reported)

    National University of Singapore, The Hong Kong University of Science and Technology, University of Science and Technology of China