Looking Complete Is Not Being Grounded: Evaluating LLM Sitreps Against Human-Authored Situation Reports

Paper recorded by Signals 4 on 2026-10-13 in cs.CL. Abstract reproduced from arXiv; link to the original below.

Published 2026-10-13 on arXiv · recorded by Signals 4 on 2026-10-14

Category: cs.CL · 自然语言处理 · first seen 2026-10-14

Abstract

Evaluation for automatic crisis reporting should measure what practitioners need, not what is convenient to compare. Through LLM-assisted, author-approved content analysis, we derive a 15-slot information schema from professional humanitarian situation reports using qualitative content analysis, then evaluate 121 human and 261 LLM-generated reports across five disasters and three hazard types. Und

Read on arXiv →