Differential Information: An Information-Theoretic Perspective on Preference Optimization

29 May 2025

Papers citing "Differential Information: An Information-Theoretic Perspective on Preference Optimization"

3 / 3 papers shown

Title
$f$ -PO: Generalizing Preference Optimization with $f$ -divergence Minimization Jiaqi Han Mingjian Jiang Yuxuan Song J. Leskovec Stefano Ermon 121 6 0 29 Oct 2024
Unintentional Unalignment: Likelihood Displacement in Direct Preference Optimization Noam Razin Sadhika Malladi Adithya Bhaskar Danqi Chen Sanjeev Arora Boris Hanin 210 35 0 11 Oct 2024
Length-Controlled AlpacaEval: A Simple Way to Debias Automatic Evaluators Yann Dubois Balázs Galambosi Percy Liang Tatsunori Hashimoto ALM 164 403 0 06 Apr 2024