Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons

5 February 2025

ArXiv (abs)PDF HTML

Papers citing "Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons"

11 / 11 papers shown

Title
Large Language Models Could Be Rote Learners Yuyang Xu Renjun Hu Haochao Ying Jian Wu Xing Shi Wei Lin ELM 411 0 0 11 Apr 2025
Advanced Tool Learning and Selection System (ATLASS): A Closed-Loop Framework Using LLM Mohd Ariful Haque Justin Williams Sunzida Siddique Md. Hujaifa Islam Hasmot Ali Kishor Datta Gupta Roy George 97 0 0 13 Mar 2025
Raising the Bar: Investigating the Values of Large Language Models via Generative Evolving Testing Han Jiang Xiaoyuan Yi Zhihua Wei Ziang Xiao Shu Wang Xing Xie ELM ALM 132 8 0 20 Jun 2024
From Crowdsourced Data to High-Quality Benchmarks: Arena-Hard and BenchBuilder Pipeline Tianle Li Wei-Lin Chiang Evan Frick Lisa Dunlap Tianhao Wu Banghua Zhu Joseph E. Gonzalez Ion Stoica ALM 84 181 0 17 Jun 2024
Data Mixing Laws: Optimizing Data Mixtures by Predicting Language Modeling Performance Jiasheng Ye Peiju Liu Tianxiang Sun Yunhua Zhou Jun Zhan Xipeng Qiu 110 76 0 25 Mar 2024
SmallToLarge (S2L): Scalable Data Selection for Fine-tuning Large Language Models by Summarizing Training Trajectories of Small Models Yu Yang Siddhartha Mishra Jeffrey N Chiang Baharan Mirzasoleiman 80 23 0 12 Mar 2024
Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preference Wei-Lin Chiang Lianmin Zheng Ying Sheng Anastasios Nikolas Angelopoulos Tianle Li ... Hao Zhang Banghua Zhu Michael I. Jordan Joseph E. Gonzalez Ion Stoica OSLM 154 596 0 07 Mar 2024
Assessing and Understanding Creativity in Large Language Models Yunpu Zhao Rui Zhang Wenyi Li Di Huang Jiaming Guo ... Xingui Hu Zidong Du Qi Guo Ling Li Yunji Chen LRM 87 24 0 23 Jan 2024
A Study of Generative Large Language Model for Medical Research and Healthcare C.A.I. Peng Xi Yang Aokun Chen Kaleb E. Smith Nima M. Pournejatian ... W. Hogan E. Shenkman Yi Guo Jiang Bian Yonghui Wu LM&MA ELM AI4MH 190 268 0 22 May 2023
Evaluating Large Language Models Trained on Code Mark Chen Jerry Tworek Heewoo Jun Qiming Yuan Henrique Pondé ... Bob McGrew Dario Amodei Sam McCandlish Ilya Sutskever Wojciech Zaremba ELM ALM 236 5,647 0 07 Jul 2021
ZeRO: Memory Optimizations Toward Training Trillion Parameter Models Samyam Rajbhandari Jeff Rasley Olatunji Ruwase Yuxiong He ALM AI4CE 82 916 0 04 Oct 2019