Paper recorded by Signals 4 on 2026-10-13 in cs.LG. Abstract reproduced from arXiv; link to the original below.
Published 2026-10-13 on arXiv · recorded by Signals 4 on 2026-10-14
Category: cs.LG · 机器学习 · first seen 2026-10-14
In this work, we study grokking in a simple, analytically tractable setting whose rich phenomenology allows us to disentangle the effects of initialization, signal strength, weight decay, sample size, and input dimension. These factors can produce superficially similar learning curves through distinct mechanisms, complicating their interpretation. Our analysis distinguishes early fitting through n