Signals 4 · free daily AI digest

PatchBench: Measuring Collateral Damage in Activation Patching

Paper recorded by Signals 4 on 2026-10-07 in cs.CL. Abstract reproduced from arXiv; link to the original below.

Published 2026-10-07 on arXiv · recorded by Signals 4 on 2026-10-08

Category: cs.CL · 自然语言处理 · first seen 2026-10-08

Abstract

An LLM safety patch can pass a benchmark while still being a poor repair. This risk is especially acute for jailbreak repairs, where the goal is to correct a specific unsafe behaviour without changing unrelated behaviours. A patch may block exact evaluation prompts yet fail on close harmful variants, or suppress harmful behaviour by over-refusing benign prompts that share its wording or structure.

Read on arXiv →

#303 most recent of 660 cs.CL papers we have recorded · ↑ newer: SemanticFold: Latent Sequence Compression SeparatesLanguage Modeling, · ↓ older: LLM Persuasion Is in the Eye of the Evaluation
Cite this page: PatchBench: Measuring Collateral Damage in Activation Patching: the #303 most recent of 660 cs.CL papers we have recorded (as of 2026-10-07). Source: Signals 4 (Signals API) — https://data.jiangzhang.ca/signals4/t/papers/patchbench-measuring-collateral-damage-in-activation-patching.html
Free to quote with attribution to “Signals 4 (Signals API)”. Machine-readable: papers.json
Related: More cs.CL papers · arXiv signals · All papers · Today in AI
Get 4 AI signals a day by email — free.
Subscribe free → See all plans →
Get 4 AI signals a day by email — free
All models · All repos · By company · Daily editions