Prune Gradually, Adapt Sparsely: Efficient Pruning of Large Language Models at Extreme Sparsity

Paper recorded by Signals 4 on 2026-10-30 in cs.AI. Abstract reproduced from arXiv; link to the original below.

Published 2026-10-30 on arXiv · recorded by Signals 4 on 2026-11-02

Category: cs.AI · 人工智能 · first seen 2026-11-02

Abstract

Weight pruning can reduce the storage and inference cost of large language models (LLMs), but preserving quality at high sparsity levels remains challenging. Existing methods face a quality-cost trade-off in this regime. One-shot pruning is cheap but degrades sharply as sparsity increases, even when followed by post-pruning recovery. A growing line of work instead optimizes the mask directly from

Read on arXiv →