Quantifying the Gain in Weak-to-Strong Generalization

Quantifying the Gain in Weak-to-Strong Generalization

24 May 2024

Chirag Pabbaraju

Kirankumar Shiragur

Papers citing "Quantifying the Gain in Weak-to-Strong Generalization"

16 / 16 papers shown

Title
Denoising Mutual Knowledge Distillation in Bi-Directional Multiple Instance Learning Chen Shu Boyu Fu Yiman Li Ting Yin Wenchuan Zhang Jie Chen Yuhao Yi Hong Bu 0 0 0 17 May 2025
Synergistic Weak-Strong Collaboration by Aligning Preferences Yizhu Jiao Xuchao Zhang Zhaoyang Wang Yubo Ma Zhun Deng Rujia Wang Chetan Bansal Saravan Rajmohan Jiawei Han Huaxiu Yao 133 0 0 21 Apr 2025
Weak-for-Strong: Training Weak Meta-Agent to Harness Strong Executors Fan Nie Lan Feng Haotian Ye Weixin Liang Pan Lu Huaxiu Yao Alexandre Alahi James Zou 80 0 0 07 Apr 2025
How to Mitigate Overfitting in Weak-to-strong Generalization? Junhao Shi Qinyuan Cheng Zhaoye Fei Y. Zheng Qipeng Guo Xipeng Qiu 70 0 0 06 Mar 2025
Weak-to-Strong Generalization Even in Random Feature Networks, Provably Marko Medvedev Kaifeng Lyu Dingli Yu Sanjeev Arora Zhiyuan Li Nathan Srebro 107 0 0 04 Mar 2025
CrowdSelect: Synthetic Instruction Data Selection with Multi-LLM Wisdom Yisen Li Lingfeng Yang Wenxuan Shen Pan Zhou Yao Wan Weiwei Lin Danny Chen 72 0 0 03 Mar 2025
Understanding the Capabilities and Limitations of Weak-to-Strong Generalization Wei Yao Wenkai Yang Zhilin Wang Yankai Lin Yong Liu ELM 107 1 0 03 Feb 2025
Weak-to-Strong Generalization Through the Data-Centric Lens Changho Shin John Cooper Frederic Sala 88 5 0 05 Dec 2024
High-dimensional Analysis of Knowledge Distillation: Weak-to-Strong Generalization and Scaling Laws M. E. Ildiz Halil Alperen Gozeten Ege Onur Taga Marco Mondelli Samet Oymak 56 2 0 24 Oct 2024
Provable Weak-to-Strong Generalization via Benign Overfitting David X. Wu A. Sahai 73 6 0 06 Oct 2024
EnsemW2S: Can an Ensemble of LLMs be Leveraged to Obtain a Stronger LLM? Aakriti Agrawal Mucong Ding Zora Che Chenghao Deng Anirudh Satheesh John Langford Furong Huang 45 4 0 06 Oct 2024
Selective Preference Optimization via Token-Level Reward Function Estimation Kailai Yang Zhiwei Liu Qianqian Xie Jimin Huang Erxue Min Sophia Ananiadou 33 10 0 24 Aug 2024
Weak-to-Strong Reasoning Yuqing Yang Yan Ma Pengfei Liu LRM 37 13 0 18 Jul 2024
Improving Weak-to-Strong Generalization with Reliability-Aware Alignment Yue Guo Yi Yang 29 8 0 27 Jun 2024
Super(ficial)-alignment: Strong Models May Deceive Weak Models in Weak-to-Strong Generalization Wenkai Yang Shiqi Shen Guangyao Shen Zhi Gong Yankai Lin Zhi Gong Yankai Lin Ji-Rong Wen 58 13 0 17 Jun 2024
MoleculeNet: A Benchmark for Molecular Machine Learning Zhenqin Wu Bharath Ramsundar Evan N. Feinberg Joseph Gomes C. Geniesse Aneesh S. Pappu K. Leswing Vijay S. Pande OOD 202 1,778 0 02 Mar 2017