Paper recorded by Signals 4 on 2026-09-25 in cs.LG. Abstract reproduced from arXiv; link to the original below.
Published 2026-09-25 on arXiv · recorded by Signals 4 on 2026-09-28
Category: cs.LG · 机器学习 · first seen 2026-09-28
We show that neural network weights can be explicilty fintuned to admit a smaller grammar. Weight Pair Encoding (WeightPE) does so by placing a lossy Re-Pair compressor inside a straight-through estimator. The int8 weights of the network are flattened into one string, and near-matching Re-Pair patterns are made exactly equal within a global L2 budget. The network computes with the rewritten weight