Tasks over Application Manuals: Revealing Gaps in Long-Horizon Procedural Reasoning for Language Models

Paper recorded by Signals 4 on 2026-09-11 in cs.CL. Abstract reproduced from arXiv; link to the original below.

Published 2026-09-11 on arXiv · recorded by Signals 4 on 2026-09-14

Category: cs.CL · 自然语言处理 · first seen 2026-09-14

Abstract

Large language models (LLMs) have achieved strong performance on a wide range of natural language tasks, and recent benchmarks suggest that they are increasingly adept at multi-hop reasoning. However, these benchmarks are typically short-horizon, requiring only a small number of retrieval or inference steps, and provide limited evidence of reliability on real-world tasks that involve following man

Read on arXiv →