Search

Benchmark

GSM8K

Reported in 102 papers on Zotpaper. The latest, each as the paper states it:

GSM8K/HumanEval (2)All benchmarks →

7 results for “GSM8K”

  1. Research · Safety & security

    Private-query AI assistants leak secrets through rejected drafts, new protocol plugs the hole

    Answer-Only Disclosure: Private-Context LLM Assistance over Web APIs with a Leakage Ledger

    A protocol called ADLER ensures the cloud sees only what the user sees, and a leakage ledger caps how much the answer reveals about private documents

    GSM8K: 5.4 s modelled communication time per answer (as reported)

    Australian Catholic University, Ant Group, University of Macau

  2. Research · Agents

    Localized Context Distillation resolves the learning dilemma in interaction experience

    Learning from Interaction Experience via Localized Context Distillation

    The authors propose a method that identifies and revises only critical spans in a student's trajectory, outperforming both off-policy and on-policy context distillation across math, code, and agent tasks.

    AIME24: 61.3% accuracy (avg@12) (as reported)

    Tencent, The Chinese University of Hong Kong, Zhejiang University

  3. Research · Agents

    Contrasting multiple trajectories sharpens skill learning for LLMs

    SkillCome: Group Contrast Skill Optimization with Dual Memory

    SkillCome generates several attempts per question and compares them to identify what separates success from failure, then stores patterns across rounds in a dual memory.

    ALFWorld: 95.9% accuracy (as reported)

    Fudan University, Ant Group, Shanghai Jiao Tong University

  4. Research · Agents

    Three-stage training instills world model planning into LLM agents

    Internalizing the Future: A Unified Agentic Training Paradigm for World Model Planning

    The authors show that injecting latent predictive capability through mid-training, then structuring it via supervised fine-tuning and calibrating with reinforcement learning, enables agents to verbalize future rollouts and success estimates, outperforming reactive baselines.

    Fudan University, Shanghai Innovation Institute, Tencent Youtu Lab

  5. Research · Agents

    Letting language models decide when to compact their context windows

    Self-Compacting Language Model Agents

    SelfCompact scaffold pairs a compaction tool with a lightweight rubric, enabling adaptive context summarization without fine-tuning.

    competition math (IMO-Answerbench, HMMT Nov 25/Feb 26): 18.1% accuracy improvement over no-summarization baseline (as reported)

    Johns Hopkins University, AppleCode