Paper recorded by Signals 4 on 2026-10-27 in cs.CL. Abstract reproduced from arXiv; link to the original below.
Published 2026-10-27 on arXiv · recorded by Signals 4 on 2026-10-28
Category: cs.CL · 自然语言处理 · first seen 2026-10-28
Reliable evaluation of inter-annotator agreement (IAA) is important for assessing the consistency of annotation processes. While established IAA metrics such as Cohen's kappa, Fleiss' kappa, and Krippendorff's alpha are commonly applied in single-label settings, multi-label tasks require additional decisions about how full label sets, joint selections, and joint omissions should be compared. In