MindEval2: Clinically Grounded Patients and Rubrics for Evaluating Language Models in Mental Health Support

Paper recorded by Signals 4 on 2026-10-15 in cs.CL. Abstract reproduced from arXiv; link to the original below.

Published 2026-10-15 on arXiv · recorded by Signals 4 on 2026-10-16

Category: cs.CL · 自然语言处理 · first seen 2026-10-16

Abstract

With people increasingly turning to AI chatbots for mental health support, the need to evaluate these tools is becoming more pressing. Recent benchmarks attempt to mimic a realistic setting by simulating multi-turn interactions with synthetic patients and evaluating them with an LLM-as-a-judge. However, the usefulness of these methods is limited because simulated patients can be overly forthcoming

Read on arXiv →