Paper recorded by Signals 4 on 2026-09-23 in cs.AI. Abstract reproduced from arXiv; link to the original below.
Published 2026-09-23 on arXiv · recorded by Signals 4 on 2026-09-24
Category: cs.AI · 人工智能 · first seen 2026-09-24
Large language models (LLMs) are increasingly used in coding tasks, but their ability to reason about code execution remains unclear. Existing repository-level QA benchmarks mainly evaluate static code understanding and often rely on LLM-based evaluation, while execution-reasoning benchmarks are mostly limited to snippets or functions. We introduce SWE-Flux, a repository-level benchmark for dynami