Improving Signals, Declining Encoder: A Known-Answer Test of Label-Free Monitoring in Self-Supervised Learning

Paper recorded by Signals 4 on 2026-10-26 in cs.LG. Abstract reproduced from arXiv; link to the original below.

Published 2026-10-26 on arXiv · recorded by Signals 4 on 2026-10-27

Category: cs.LG · 机器学习 · first seen 2026-10-27

Abstract

Self-supervised training is monitored without labels, through the loss and statistics of the learned features. We report a case where we know the encoders lost part of what they had learned, so we can check whether these signals noticed. We trained LeJEPA encoders on synthetic images with known generating factors. In nine of ten seeds, the readability of those factors fell abruptly and stayed down

Read on arXiv →