Paper recorded by Signals 4 on 2026-10-14 in cs.AI. Abstract reproduced from arXiv; link to the original below.
Published 2026-10-14 on arXiv · recorded by Signals 4 on 2026-10-15
Category: cs.AI · 人工智能 · first seen 2026-10-15
We introduce Continuum Attention (CA), a causal Transformer attention operator that replaces discrete key and value lookup with integration over a continuous, piecewise linear memory curve. Each query induces an exponential relevance density along the curve. Integrating the density and interpolated values yields exact normalized attention from closed form exponential moments, including half token