Paper recorded by Signals 4 on 2026-10-29 in cs.LG. Abstract reproduced from arXiv; link to the original below.
Published 2026-10-29 on arXiv · recorded by Signals 4 on 2026-10-30
Category: cs.LG · 机器学习 · first seen 2026-10-30
Unlike autoregressive large language models (AR-LLMs), diffusion LLMs (dLLMs) generate text by iteratively denoising many tokens in parallel, offering a promising path to efficient inference. Existing serving frameworks, however, schedule dLLM requests with policies designed for AR models, namely first-come-first-served (FCFS) admission and prefill priority. We find that both policies are ill-suit