Paper recorded by Signals 4 on 2026-10-08 in cs.AI. Abstract reproduced from arXiv; link to the original below.
Published 2026-10-08 on arXiv · recorded by Signals 4 on 2026-10-09
Category: cs.AI · 人工智能 · first seen 2026-10-09
METR's 50\% time horizon measures the human completion time of software tasks that an AI solves with 50\% probability, allowing AI capabilities to be expressed in interpretable units. On 228 tasks and 26 AIs, we recompute the time horizons using splines and item-response theory to relax the assumption that the AI difficulty of a task depends linearly on the log of human time. Our fitted spline can