PLaD: Preference-based Large Language Model Distillation with
Pseudo-Preference Pairs

PLaD: Preference-based Large Language Model Distillation with Pseudo-Preference Pairs

5 June 2024

Jialu Liu

Simon Baumgartner

Michael Bendersky

Chao Zhang

Papers citing "PLaD: Preference-based Large Language Model Distillation with Pseudo-Preference Pairs"

3 / 3 papers shown

Title
Advantage-Guided Distillation for Preference Alignment in Small Language Models Shiping Gao Fanqi Wan Jiajian Guo Xiaojun Quan Qifan Wang ALM 58 0 0 25 Feb 2025
TAID: Temporally Adaptive Interpolated Distillation for Efficient Knowledge Transfer in Language Models Makoto Shing Kou Misaki Han Bao Sho Yokoi Takuya Akiba VLM 57 1 0 28 Jan 2025
Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizes Lokesh Nagalapatti Chun-Liang Li Chih-Kuan Yeh Hootan Nakhost Yasuhisa Fujii Alexander Ratner Ranjay Krishna Chen-Yu Lee Tomas Pfister ALM 220 502 0 03 May 2023