Search

4 results for “MMLU”

1. Research · Agents

   Draft-KV ensures the receiver actually uses the sender's latent message

   Draft-KV: Learning Useful Latent Communication Between Language Models

   By sending key-value states from the sharer's draft, a lightweight interface boosts a 0.5B receiver to 78% on MMLU-Redux, and message-replacement tests confirm the gain comes from genuine information use.

   MMLU-Redux: 78.04% accuracy (as reported)

   29 Sept 2026City University of Hong Kong, University of Science and Technology of China, University of Electronic Science and Technology of China

2. Research · Agents

   Progressive pruning lets language-model debates beat equal-cost baselines

   Beyond Solo and Consistency: Vindicating Multi-Agent Debate via Conditional Progressive Pruning

   Conditional Progressive Pruning uses intermediate debate results and learned agent behavior to allocate computation across rounds more effectively.

   MMLU-Pro: 68% accuracy (as reported)

   5 Oct 2026Rutgers University, New Brunswick, University of Cambridge, Tsinghua University

3. Research · Agents

   Revision-aware agent graphs reuse valid work while avoiding stale answers

   Revision-Aware Independent Agent Graphs for Dynamic Reasoning

   RIAG combines deterministic version selection, version-keyed caching and bounded independent reasoning to handle tasks revised over time.

   Full collection (6 benchmarks): 32.22% joint accuracy (as reported)

   2 Oct 2026Harvard AI and Robotics Lab, Harvard University

4. Research · Agents

   Joint harness search balances model accuracy, safety, and token use

   MoMHa: Multi-Objective Optimization of LLM Harnesses over Accuracy, Safety, and Tokens

   Across 17 domains and 12 models, jointly optimizing the code around language models outperformed sequential and accuracy-only approaches.

   3D hypervolume: 0.36 hypervolume indicator (as reported)

   28 Sept 2026Adobe Research