Trace as State: Reasoning Traces as Conditional States for Long-Context Transformers

Paper recorded by Signals 4 on 2026-09-02 in cs.CL. Abstract reproduced from arXiv; link to the original below.

Published 2026-09-02 on arXiv · recorded by Signals 4 on 2026-09-03

Category: cs.CL · 自然语言处理 · first seen 2026-09-03

Abstract

Transformers process information causally, but long-context reasoning may depend on task state discovered only later. We formalize this mismatch through conditional state update tasks. For causal state update processors, providing the condition first can require exponentially less memory in the worst case than providing it last. Motivated by this principle, we introduce Trace as State. We use co

Read on arXiv →