Paper recorded by Signals 4 on 2026-10-06 in cs.LG. Abstract reproduced from arXiv; link to the original below.
Published 2026-10-06 on arXiv · recorded by Signals 4 on 2026-10-07
Category: cs.LG · 机器学习 · first seen 2026-10-07
Knowledge that a language model appears to forget during finetuning often remains stored and can be recovered, a phenomenon called spurious forgetting. Finetuning on new facts can even produce forgetting that undoes itself: recall of the old facts collapses, recovers as training continues on new facts alone, and only then erodes for good. We seek to understand when such forgetting is not catastrop