RAM estimates quantization sensitivity by passing random Gaussian probes through a model. A probe gives an unbiased estimate of squared quantization error, and measured spectral flatness keeps its variance low: one probe measures per-tensor sensitivity within 4 to 7%, while twenty reach 1.3 to 1.4%.
The propagated probes score six candidate bit-widths per tensor, then a knapsack solver selects an allocation under an exact byte budget. No calibration data or gradients are required, and one probe pass supports multiple budgets.
Across seven architectures, RAM reduced median WikiText-2 perplexity by 3.5 to 13.6% versus size-comparable uniform 4-bit builds on the tested MoE models. Analysis took up to nine minutes for a 400B-parameter model on one workstation.