EntroPack is a weight compressor that uses entropy coding to store neural network weights at arbitrary bitrates without activation calibration or fine-tuning. It combines row-normalized E8 with a conditional probability model of lattice coordinates, and uses sampled storage estimates to pick quantization resolution quickly. The compressed representation is split into independently decodable rANS tiles, so decoding and weight reconstruction can run as fused GPU kernels.
At comparable storage rates it reconstructs weights with lower error than fixed-width formats such as INT8, FP8, and NF4; for Z-Image-Turbo at a 4 bit per parameter target it reports about 24% lower relative L2 weight error than NF4 with less storage. Conversion takes 3.5 seconds and decoding adds about 7.7% to denoising-step time relative to the uncompressed model. The main cost is online decoding latency that grows with weight count, making the method most useful for compute-heavy workloads like diffusion denoising and Transformer prefill.