Aligning Language Models with General Preferences: An Empirical Study of Direct Nash Optimization
Paper recorded by Signals 4 on 2026-11-03 in cs.AI. Abstract reproduced from arXiv; link to the original below.
Published 2026-11-03 on arXiv · recorded by Signals 4 on 2026-11-04
Category: cs.AI · 人工智能 · first seen 2026-11-04
Abstract
Direct Nash Optimization (DNO) aligns a language model to a general preference function by approximating the Nash equilibrium of a two-player preference game. Its practical variant, DNO-Prct, iterates on-policy sampling, LLM-based rating of the samples together with a teacher's gold response, large-margin preference-pair selection and a DPO-style contrastive update. We re-implement DNO-Prct indepe
Read on arXiv →
Cite this page: Aligning Language Models with General Preferences: An Empirical Study of Direct Nash Optimization: the #3 most recent of 920 cs.AI papers we have recorded (as of 2026-11-03). Source: Signals 4 (Signals API) — https://data.jiangzhang.ca/signals4/t/papers/aligning-language-models-with-general-preferences-an-empirical-study-of-direct-n.html
Free to quote with attribution to “Signals 4 (Signals API)”. Machine-readable:
papers.json
Get 4 AI signals a day by email — free.
Get 4 AI signals a day by email — free