#LLM inference

Google's TurboQuant Compresses KV Cache 6x with No Accuracy Loss

Google Research's TurboQuant achieves 6x key-value cache compression at 3 bits with zero model accuracy degradation and up to 8x attention speedup on H100s. The paper hits ICLR 2026. The question is whether lossless is actually lossless in your workload.