Paper recorded by Signals 4 on 2026-10-21 in cs.AI. Abstract reproduced from arXiv; link to the original below.
Published 2026-10-21 on arXiv · recorded by Signals 4 on 2026-10-22
Category: cs.AI · 人工智能 · first seen 2026-10-22
Coding agents are typically evaluated using one-shot, well-formulated prompts. Benchmarks such as SWE-bench use existing GitHub issues as input for a coding agent and evaluate whether the agent successfully solves the task. However, in real-world use cases, prompts are often not as well-formulated or structured as existing GitHub issues. Additionally, a coding agent session is not limited to a sin