Paper recorded by Signals 4 on 2026-10-26 in cs.LG. Abstract reproduced from arXiv; link to the original below.
Published 2026-10-26 on arXiv · recorded by Signals 4 on 2026-10-27
Category: cs.LG · 机器学习 · first seen 2026-10-27
Sparse outcome rewards make it difficult for long-horizon language-model agents to assign credit to earlier actions. Learned critics provide value estimates for intermediate states, but these estimates can be inaccurate, while estimating intermediate values with repetitive continuation samples from points within a trajectory incurs substantial costs. To mitigate these issues, we introduce FOCUS, a