Who is the Pronoun Pro? Comparing LLMs and Humans at Number-Disambiguation of 'they'

Paper recorded by Signals 4 on 2026-11-03 in cs.CL. Abstract reproduced from arXiv; link to the original below.

Published 2026-11-03 on arXiv · recorded by Signals 4 on 2026-11-04

Category: cs.CL · 自然语言处理 · first seen 2026-11-04

Abstract

This study evaluates whether large language models (LLMs) can reliably replace or complement human research assistants in linguistically complex annotation. In a controlled annotation task, 73 human annotators (local students and crowdworkers with and without a background in linguistics) and more than 40 LLM configurations number-disambiguated 174 authentic uses of 'they' from Reddit, including in

Read on arXiv →