Search

3 results for “MMLU”

1. Research · Reinforcement learning

   Turning failed reasoning attempts into training signal improves GRPO on hard problems

   Failure Is the Mother of Success: Recovering Supervision with Grounding Hindsight

   RSHD generates corrective notes from failures, verifies them via replays, and distills successful behaviors into the policy without extra inference cost.

   MMLU-Pro: 60.7% accuracy (as reported)

   16 Oct 2026University of California, San Diego, Adobe Research, University of Virginia

2. Research · Reinforcement learning

   Posterior rewards become indistinguishable for long reasoning traces in LLM training

   Rethinking Probability-Based Reinforcement Learning From Posterior Concentration

   The authors identify a length-dependent failure mode they call Posterior Concentration Phenomenon, and propose a framework to mitigate it.

   MMLU-Pro: 61.3% Avg@2 (as reported)

   7 Oct 2026National University of Singapore, The Hong Kong University of Science and Technology, University of Science and Technology of China

3. Research · Safety & security

   TRACE reduces multi-turn attack success while largely preserving model utility

   TRACE: Trajectory Return Attribution and Contrastive Erasure for Multi-Turn Safety

   A token-level safety objective outperformed alternatives across 35 model and attack combinations, with benchmark utility falling by no more than 1.23 points.

   MMLU and HellaSwag: 1.23 pts accuracy drop (as reported)

   2 Oct 2026PRADA Lab, King Abdullah University of Science and Technology, State Key Laboratory of Internet of Things for Smart City