Paper recorded by Signals 4 on 2026-10-14 in cs.LG. Abstract reproduced from arXiv; link to the original below.
Published 2026-10-14 on arXiv · recorded by Signals 4 on 2026-10-15
Category: cs.LG · 机器学习 · first seen 2026-10-15
We introduce an approach for self-supervised representation learning designed to be used as a tokenizer for generative modeling. Our objective supervises a representation loss by factorizing the pointwise mutual information of the data, which we estimate by taking information differences between conditional predictions from a learned generative model. We justify our algorithm theoretically and emp