Paper recorded by Signals 4 on 2026-10-29 in cs.CL. Abstract reproduced from arXiv; link to the original below.
Published 2026-10-29 on arXiv · recorded by Signals 4 on 2026-10-30
Category: cs.CL · 自然语言处理 · first seen 2026-10-30
Tokenizers are usually treated as fixed preprocessing tools, but they are trained on text and can retain traces of that text in their vocabularies. We ask whether a BPE tokenizer can reveal if a candidate dataset was part of its training corpus. The key observation is simple. Rare strings become tokens only when enough corpus frequency pushes them over the merge threshold. This suggests that membe