Search

Any time Past 24 hours Past week Past monthSort:Relevance Newest

Benchmark

MMLU

Reported in 43 papers on Zotpaper. The latest, each as the paper states it:

Training language models on false facts they disbelieve causes broader misalignment68.9% accuracy
Language models can learn facts while misjudging what they know0.71 accuracy
Random tweaks suppress leaked personal data as well as targeted fixes61.5% accuracy

MMLU-PRO (25)MMLU-Redux (3)All benchmarks →

2 results for “MMLU”

Research · Efficiency & systems
One random probe can guide data-free mixed-precision model quantization
Quantization Error Is Spectrally Flat: A Single Random Probe Is a Calibrated, Data-Free Sensitivity Estimator, with Application to Budget-Targeted Mixed-Precision Quantization
The authors show that spectrally flat rounding errors make Gaussian probes reliable enough to allocate per-tensor bit widths under an exact memory budget.
MMLU: 73.1% accuracy (as reported)
5 Oct 2026Blacksheep ai.
Research · Language models
Decoding as optimisation on the probability simplex unifies and composes sampling strategies
Composable Decoding on the Probability Simplex: Theory and Implementation
The authors formalise decoding as a regularised optimisation problem, recovering standard methods as special cases and enabling new decoders through compositional regularisers.
GPQA Diamond: 26.3% pass@1 (as reported)
5 Oct 2026Huawei Noah's Ark Lab, UCL Centre for AI