News without the noise
Benchmark
Reported in 102 papers on Zotpaper. The latest, each as the paper states it:
5 results for “GSM8K”
Research · Language models
Hinted Scaling Laws
The authors report that using assisted answers from smaller models reduced median error in forecasts of larger models’ unaided accuracy from 21 to 4.3 percentage points.
GSM8K: 3 pts forecasting error (as reported)
Stanford University
Research · Theory
Does Random Search Discover Task Experts? Revisiting Neural Thickets
The apparent advantage of best-of-N selected perturbations mostly reflects selection noise, and top experts perform no better than the base model on held-out questions.
Countdown, GSM8K, MBPP: 0.16 pts mean held-out rank-1 accuracy gain (as reported)
University of Southern California, University of Oxford
Research · Language models
Beyond Low-Rank Parameterization: Narrowing the Gap Between LoRA and Full Fine-Tuning via Gradient Decomposition
GDLoRA recovers gradients orthogonal to LoRA's accessible space and applies them to base weights, improving accuracy across multiple benchmarks by 2–4%.
GLUE: 85.26% average score (as reported)
Huazhong University of Science and Technology, Hebei University of Technology
Research · Language models
Compatibility Matters: A Framework for Token-Level Teacher Selection in On-Policy Distillation
A theoretical framework and new routing scheme yield up to 10 percentage point gains in pass@k across math, code, and reasoning tasks.
AIME 2025 × KernelBench L2: 4.37% joint fast0 pass@1 (as reported)
Princeton University, Amazon Annapurna Labs
Research · Language models
Composable Decoding on the Probability Simplex: Theory and Implementation
The authors formalise decoding as a regularised optimisation problem, recovering standard methods as special cases and enabling new decoders through compositional regularisers.
GPQA Diamond: 26.3% pass@1 (as reported)
Huawei Noah's Ark Lab, UCL Centre for AI