entropy coding
- Papers
- 3
- Released code
- 1
- First seen
- Oct 2026
- Latest
- Nov 2026
3 papers in the last two months, against 0 in the two before.
Start here
Two papers to read first, in the order they came out- 1EntroPack compresses neural weights at finely adjustable storage rates
EntroPack entropy-codes row-normalized E8 lattice quantized weights to hit arbitrary bitrates with lower error than fixed-width formats and fast GPU reconstruction.
Oct 2026 - 2Language models can generate text 2.52 times faster using compression
MINE uses lossless entropy coding to accelerate single-stream LLM inference by 2.52× on an RTX 4060 Ti.
Nov 2026
How fast it is moving
Often studied with
kv cache compressionReducing the size of the key-value cache in transformers via selective retention, low-rank updates, or adaptive compression.2 togetherlattice quantizationQuantization that maps groups of weights or values to the nearest point in a regular lattice, like E8, enabling compact codes without a codebook.1 togetherpost-training quantizationQuantizing pre-trained neural network weights and activations to1 togetherThe papers
Most central to this idea first, not most recent.
- Top Universitycs.LG
Language models can generate text 2.52 times faster using compression
MINE uses lossless entropy coding to accelerate single-stream LLM inference by 2.52× on an RTX 4060 Ti.
ETH Zurich · Nov 2026
- Independentcs.LGcode
EntroPack compresses neural weights at finely adjustable storage rates
EntroPack entropy-codes row-normalized E8 lattice quantized weights to hit arbitrary bitrates with lower error than fixed-width formats and fast GPU reconstruction.
Oct 2026
- Chinese Techcs.PF
Local alignment enables predictive coding for error-bounded KV cache compression
AlignPred compresses persistent KV caches by aligning related blocks and coding residuals under a configurable error budget.
Hunan University, Tencent · Oct 2026
Concepts are extracted from each paper and reused across the corpus, so this page grows on its own as the desk reads.