Signals 4 · free daily AI digest

What Carries Forward? Pretraining Disclosure Across Language Model Releases

Paper recorded by Signals 4 on 2026-10-27 in cs.CL. Abstract reproduced from arXiv; link to the original below.

Published 2026-10-27 on arXiv · recorded by Signals 4 on 2026-10-28

Category: cs.CL · 自然语言处理 · first seen 2026-10-28

Abstract

Understanding how language models were pretrained requires information about their data, processing procedures, and computational resources. However, it remains unclear whether successive releases preserve or expand earlier disclosure. We conduct a document-based audit of 41 model entries from 17 families using 24 pretraining-related indicators from the 2025 Foundation Model Transparency Index (FM

Read on arXiv →

#124 most recent of 660 cs.CL papers we have recorded · ↑ newer: Follow the Gradient: Tracing Safety Degradation Back to Training Data · ↓ older: Test-Time Communication in Trading Agent Swarms
Cite this page: What Carries Forward? Pretraining Disclosure Across Language Model Releases: the #124 most recent of 660 cs.CL papers we have recorded (as of 2026-10-27). Source: Signals 4 (Signals API) — https://data.jiangzhang.ca/signals4/t/papers/what-carries-forward-pretraining-disclosure-across-language-model-releases.html
Free to quote with attribution to “Signals 4 (Signals API)”. Machine-readable: papers.json
Related: More cs.CL papers · arXiv signals · All papers · Today in AI
Get 4 AI signals a day by email — free.
Subscribe free → See all plans →
Get 4 AI signals a day by email — free
All models · All repos · By company · Daily editions