Paper recorded by Signals 4 on 2026-10-20 in cs.CL. Abstract reproduced from arXiv; link to the original below.
Published 2026-10-20 on arXiv · recorded by Signals 4 on 2026-10-21
Category: cs.CL · 自然语言处理 · first seen 2026-10-21
Large Language Model (LLM) agents can handle increasingly complex tasks, navigating long trajectories of observations and actions. As these trajectories grow, key-value (KV) cache I/O and storage become the dominant cost. Trajectories can also exceed the LLM's maximum context length, requiring control over active cache growth. Prior work uses context engineering to reduce cache size by trimming or