ProteinGeoBench: Frontier Structural-Biology Agents Are Fluent at Lookup but Lost in Geometry

Paper recorded by Signals 4 on 2026-10-19 in cs.AI. Abstract reproduced from arXiv; link to the original below.

Published 2026-10-19 on arXiv · recorded by Signals 4 on 2026-10-20

Category: cs.AI · 人工智能 · first seen 2026-10-20

Abstract

Frontier agents retrieve structural metadata well and compute geometry from coordinates less reliably. We ask how much of a benchmark score reflects that gap and how much reflects the evaluation configuration around the model. We study ProteinGeoBench, a suite of 131 protein-structure tasks, using 4,249 rollouts from four frontier models and 4,486 further trials across 26 models. Three of the four

Read on arXiv →