Paper recorded by Signals 4 on 2026-09-10 in cs.CL. Abstract reproduced from arXiv; link to the original below.
Published 2026-09-10 on arXiv · recorded by Signals 4 on 2026-09-11
Category: cs.CL · 自然语言处理 · first seen 2026-09-11
Out-of-distribution length generalization, namely to extrapolate a task from short to longer context, has been studied intensively for transformers. Here we focus on distance generalization, which probes performance when inter-token distances are changed between training and inference, while keeping a fixed context length. We construct two synthetic delay copy tasks, both involving finite distance