Paper recorded by Signals 4 on 2026-10-05 in cs.CL. Abstract reproduced from arXiv; link to the original below.
Published 2026-10-05 on arXiv · recorded by Signals 4 on 2026-10-06
Category: cs.CL · 自然语言处理 · first seen 2026-10-06
We investigate whether continued pretraining on Russian legislative documents improves a Russian ModernBERT encoder on legal text. The adapted model, RuModernBERT-ruLaw, was trained on a corpus reported to contain 304,382 legislative documents and 194,425,905 corpus tokens. Corpus token counts are distinguished from positions produced by the model tokenizer. We compare the original and adapted enc