Paper recorded by Signals 4 on 2026-10-02 in cs.AI. Abstract reproduced from arXiv; link to the original below.
Published 2026-10-02 on arXiv · recorded by Signals 4 on 2026-10-05
Category: cs.AI · 人工智能 · first seen 2026-10-05
Dense-retrieval services must switch among embedding-prefix dimensions and index bit rates as latency, quality, and memory budgets change. Tuning a quantizer separately for each rate gives the best quality, but the retrieval tier then holds several code streams and quantizer states at once. We introduce Matryoshka Residual Vector Quantization (MRVQ), a post-hoc residual quantizer for frozen embedd