Research · Efficiency & systems
One random probe can guide data-free mixed-precision model quantization
Quantization Error Is Spectrally Flat: A Single Random Probe Is a Calibrated, Data-Free Sensitivity Estimator, with Application to Budget-Targeted Mixed-Precision Quantization
The authors show that spectrally flat rounding errors make Gaussian probes reliable enough to allocate per-tensor bit widths under an exact memory budget.
WikiText-2: 6.59 median perplexity (as reported)
Blacksheep ai.