Paper recorded by Signals 4 on 2026-10-30 in cs.AI. Abstract reproduced from arXiv; link to the original below.
Published 2026-10-30 on arXiv · recorded by Signals 4 on 2026-11-02
Category: cs.AI · 人工智能 · first seen 2026-11-02
Agentic workflows are increasingly shifting towards long-horizon tasks, such as open-ended scientific work, where models benefit from long context windows. However, at ultra-long context (above 1M tokens), full attention is prohibitively expensive. A promising approach is sparse attention, in which a dedicated indexer selects a subset of keys for the attention. Yet current methods of indexing eith