Evaluating and Improving LLM Self-Modeling

Paper recorded by Signals 4 on 2026-08-31 in cs.AI. Abstract reproduced from arXiv; link to the original below.

Published 2026-08-31 on arXiv · recorded by Signals 4 on 2026-09-01

Category: cs.AI · 人工智能 · first seen 2026-09-01

Abstract

We study self-modeling: an LLM's ability to answer questions about its own behavior. We focus on verifiable behavioral questions, such as whether a prompt edit would change the model's final answer. To measure this capability, we introduce a benchmark that tests diverse types of self-modeling questions. Current models show non-trivial but limited self-modeling skill, and make systematic mistakes o

Read on arXiv →