Paper recorded by Signals 4 on 2026-10-06 in cs.LG. Abstract reproduced from arXiv; link to the original below.
Published 2026-10-06 on arXiv · recorded by Signals 4 on 2026-10-07
Category: cs.LG · 机器学习 · first seen 2026-10-07
Flow policies have become a standard policy class for learning robot behaviors from demonstrations, but reinforcement learning is still critical for improving pre-trained flow policies or learning them from scratch through interaction. We introduce QF3 (Fast Flow RL with Filtered Q-Gradients), an online off-policy RL algorithm that trains a flow policy with flow matching plus the critic's action g