Paper recorded by Signals 4 on 2026-10-22 in cs.LG. Abstract reproduced from arXiv; link to the original below.
Published 2026-10-22 on arXiv · recorded by Signals 4 on 2026-10-23
Category: cs.LG · 机器学习 · first seen 2026-10-23
Looped architectures scale quality while keeping parameter count fixed by repeatedly passing activations through the same block of layers. During inference, each recurrence generates independent KV-caches, causing memory to grow linearly. To address this challenge, prior work has proposed KV-sharing (i.e., sharing KV-caches across depth), finding that, in some cases, the KV-cache of the final recu