Paper recorded by Signals 4 on 2026-10-09 in cs.AI. Abstract reproduced from arXiv; link to the original below.
Published 2026-10-09 on arXiv · recorded by Signals 4 on 2026-10-12
Category: cs.AI · 人工智能 · first seen 2026-10-12
Semantic query engines ask a large language model (LLM) to judge individual rows, and benchmarks compare these engines on the quality of a few executions at temperature 0. We measure how much another execution changes. We re-execute the text and tabular workloads of SemBench, LRO-Bench, and UDA-Bench through their own harnesses, log every one of 1.2 million model calls, and reanalyze SemBench's pu