Learning When to Commit: Schedule Distillation for Fast Diffusion Language Models

Paper recorded by Signals 4 on 2026-10-26 in cs.AI. Abstract reproduced from arXiv; link to the original below.

Published 2026-10-26 on arXiv · recorded by Signals 4 on 2026-10-27

Category: cs.AI · 人工智能 · first seen 2026-10-27

Abstract

Diffusion large language models (dLLMs) can generate multiple tokens in parallel, but often require many decoding rounds to complete a response. Efficient generation depends not only on which tokens are easy to predict, but also on how committing to them helps predict the remaining positions. A highly predictable token may provide little useful context, while revealing a less predictable token can

Read on arXiv →