When Guardrails Look Effective: Construct Validity Failures in LLM Agent Commerce Evaluation

Paper recorded by Signals 4 on 2026-09-01 in cs.AI. Abstract reproduced from arXiv; link to the original below.

Published 2026-09-01 on arXiv · recorded by Signals 4 on 2026-09-02

Category: cs.AI · 人工智能 · first seen 2026-09-02

Abstract

Interactive simulations increasingly evaluate policies in markets populated by language-model agents. Their outputs can look economic---prices, profits, consumer surplus, and welfare---without instantiating the behavior named in the claim. We audit this risk in a multi-turn buyer--seller testbed for configurable hotel transactions. An initial implementation reported welfare gains from two marketpl

Read on arXiv →