Tetra represents each 24-weight block with a 48-bit Leech-lattice code and decodes it during matrix-vector multiplication using a Golay-code trellis and a shared 16 KiB table. This reduces GPU memory reads from 4.804 to 2.148 bits per weight.
Complete Qwen3-4B, 8B, and 14B files occupy 2.73, 2.70, and 2.73 bits per parameter. Their MMLU scores trail 4-bit AWQ by 4.76, 4.21, and 2.46 points while using about half its memory, showing a substantial capacity-for-quality tradeoff for memory-constrained inference.
On one NVIDIA L40S, the models generate 113.8, 95.0, and 57.2 tokens per second. Quality losses are larger on GSM8K than MMLU, indicating that the compression tradeoff depends strongly on the task.