ECHO: Early-layer Collaborative Hierarchical Orchestration with Bonus Logits in Speculative Decoding

Paper recorded by Signals 4 on 2026-09-15 in cs.CL. Abstract reproduced from arXiv; link to the original below.

Published 2026-09-15 on arXiv · recorded by Signals 4 on 2026-09-16

Category: cs.CL · 自然语言处理 · first seen 2026-09-16

Abstract

While draft-model-free speculative decoding offers a promising path to efficient LLM inference, it is frequently constrained by stale draft candidates and the high computational cost of the verification. To address these challenges, we propose ECHO, a hierarchical dual-loop framework that exploits the functional asymmetry between LLM layers. Leveraging the high discriminative efficiency of early l

Read on arXiv →