Paper recorded by Signals 4 on 2026-10-02 in cs.LG. Abstract reproduced from arXiv; link to the original below.
Published 2026-10-02 on arXiv · recorded by Signals 4 on 2026-10-05
Category: cs.LG · 机器学习 · first seen 2026-10-05
The choice of post-training data for large language models substantially affects downstream performance. Gradient-based data selection is a popular approach that ranks training data by how well their gradients align with those of a small validation set. However, ranking with full-parameter gradients requires an expensive backward pass on every sample, making computation intractable for large candi