Signals 4 · free daily AI digest

Fidelity Is Not Enough: Dispatch-Level Instrumentation for Agentic Datasheet Extraction

Paper recorded by Signals 4 on 2026-08-28 in cs.CL. Abstract reproduced from arXiv; link to the original below.

Published 2026-08-28 on arXiv · recorded by Signals 4 on 2026-08-31

Category: cs.CL · 自然语言处理 · first seen 2026-08-31

Abstract

One model passed our fidelity check without ever opening the datasheet. We found it while qualifying models for an internal extraction service: a structured-output constraint had silently disabled tool use, and the model answered anyway, with fabricated source text. Only the per-tool trace exposed it. Fidelity -- whether an extracted value matches the source -- is the standard measure for agentic

Read on arXiv →

#177 most recent of 186 cs.CL papers we have recorded · ↑ newer: Stranger, Fan, or Peer? A Systematic Study on the Role of Interlocutor · ↓ older: Are These Modules Worth Their Cost? A Paradigm-Level Accuracy-Cost Ana
Cite this page: Fidelity Is Not Enough: Dispatch-Level Instrumentation for Agentic Datasheet Extraction: the #177 most recent of 186 cs.CL papers we have recorded (as of 2026-08-28). Source: Signals 4 (Signals API) — https://data.jiangzhang.ca/signals4/t/papers/fidelity-is-not-enough-dispatch-level-instrumentation-for-agentic-datasheet-extr.html
Free to quote with attribution to “Signals 4 (Signals API)”. Machine-readable: papers.json
Related: More cs.CL papers · arXiv signals · All papers · Today in AI
Get 4 AI signals a day by email — free.
Subscribe free → See all plans →
Get 4 AI signals a day by email — free
All models · All repos · By company · Daily editions