Paper recorded by Signals 4 on 2026-10-30 in cs.LG. Abstract reproduced from arXiv; link to the original below.
Published 2026-10-30 on arXiv · recorded by Signals 4 on 2026-11-02
Category: cs.LG · 机器学习 · first seen 2026-11-02
Understanding how gradient descent learns features remains a central challenge in neural network theory. We study this question in a minimal multi-index setting that already exhibits rich multi-phase gradient dynamics: a well-specified two-neuron ReLU teacher-student model under isotropic Gaussian inputs, trained by population gradient flow from small initialization. We show that the dynamics are