Signals 4 · free daily AI digest

Beyond Scores: Understanding LLM-as-a-Judge Mechanisms in Summarization Evaluation

Paper recorded by Signals 4 on 2026-09-01 in cs.LG. Abstract reproduced from arXiv; link to the original below.

Published 2026-09-01 on arXiv · recorded by Signals 4 on 2026-09-02

Category: cs.LG · 机器学习 · first seen 2026-09-02

Abstract

LLM-based evaluators of natural language generation (NLG) quality are widely deployed as scoring tools and as automated training signals, yet the internal procedure by which they assign a rating remains poorly understood. We investigate this procedure mechanistically through an eight-attack perturbation taxonomy across the Readability and Adequacy dimensions of NLG quality, a generation pipeline t

Read on arXiv →

#154 most recent of 215 cs.LG papers we have recorded · ↑ newer: SPADE: SPaT Attack Detection from the Connected Vehicle's Perspective · ↓ older: Facet-0: A Robotic Foundation Model for Contact-Rich Precise Manipulat
Cite this page: Beyond Scores: Understanding LLM-as-a-Judge Mechanisms in Summarization Evaluation: the #154 most recent of 215 cs.LG papers we have recorded (as of 2026-09-01). Source: Signals 4 (Signals API) — https://data.jiangzhang.ca/signals4/t/papers/beyond-scores-understanding-llm-as-a-judge-mechanisms-in-summarization-evaluatio.html
Free to quote with attribution to “Signals 4 (Signals API)”. Machine-readable: papers.json
Related: More cs.LG papers · arXiv signals · All papers · Today in AI
Get 4 AI signals a day by email — free.
Subscribe free → See all plans →
Get 4 AI signals a day by email — free
All models · All repos · By company · Daily editions