KV Cache Quantization for Diffusion Language Models

Paper recorded by Signals 4 on 2026-10-29 in cs.CL. Abstract reproduced from arXiv; link to the original below.

Published 2026-10-29 on arXiv · recorded by Signals 4 on 2026-10-30

Category: cs.CL · 自然语言处理 · first seen 2026-10-30

Abstract

KV cache quantization is well studied for autoregressive language models, where cached prefix states are exact under causal attention and quantization is mainly a cache reconstruction problem. Diffusion language models (dLLMs) break this assumption. Fast dLLM inference reuses KV states across denoising steps, but bidirectional token representations can change as masked tokens are revealed, so the

Read on arXiv →