LEAD: Iterative Data Selection for Efficient LLM Instruction Tuning

LEAD: Iterative Data Selection for Efficient LLM Instruction Tuning

12 May 2025

Themis Palpanas

Chengliang Chai

Papers citing "LEAD: Iterative Data Selection for Efficient LLM Instruction Tuning"

10 / 10 papers shown

Title
Concise Reasoning, Big Gains: Pruning Long Reasoning Trace with Difficulty-Aware Prompting Yifan Wu Jingze Shi Bingheng Wu Jiayi Zhang Xiaotian Lin Nan Tang Yuyu Luo LRM 79 0 0 26 May 2025
IterSelectTune: An Iterative Training Framework for Efficient Instruction-Tuning Data Selection Jielin Song Siyu Liu Bin Zhu Yanghui Rao 38 3 0 17 Oct 2024
ItD: Large Language Models Can Teach Themselves Induction through Deduction Wangtao Sun Haotian Xu Xuanqing Yu Pei Chen Shizhu He Jun Zhao Kang Liu LRM 59 10 0 09 Mar 2024
DataInf: Efficiently Estimating Data Influence in LoRA-tuned LLMs and Diffusion Models Yongchan Kwon Eric Wu K. Wu James Zou DiffM TDI 75 67 0 02 Oct 2023
#InsTag: Instruction Tagging for Analyzing Supervised Fine-tuning of Large Language Models Keming Lu Hongyi Yuan Zheng Yuan Runji Lin Junyang Lin Chuanqi Tan Chang Zhou Jingren Zhou ALM LRM 50 71 0 14 Aug 2023
Unnatural Instructions: Tuning Language Models with (Almost) No Human Labor Or Honovich Thomas Scialom Omer Levy Timo Schick ALM 108 372 0 19 Dec 2022
Training Verifiers to Solve Math Word Problems K. Cobbe V. Kosaraju Mohammad Bavarian Mark Chen Heewoo Jun ... Jerry Tworek Jacob Hilton Reiichiro Nakano Christopher Hesse John Schulman ReLM OffRL LRM 280 4,397 0 27 Oct 2021
Evaluating Large Language Models Trained on Code Mark Chen Jerry Tworek Heewoo Jun Qiming Yuan Henrique Pondé ... Bob McGrew Dario Amodei Sam McCandlish Ilya Sutskever Wojciech Zaremba ELM ALM 224 5,518 0 07 Jul 2021
TyDi QA: A Benchmark for Information-Seeking Question Answering in Typologically Diverse Languages J. Clark Eunsol Choi Michael Collins Dan Garrette Tom Kwiatkowski Vitaly Nikolaev J. Palomaki 143 609 0 10 Mar 2020
Snorkel: Rapid Training Data Creation with Weak Supervision Alexander Ratner Stephen H. Bach Henry R. Ehrenberg Jason Alan Fries Sen Wu Christopher Ré 73 1,027 0 28 Nov 2017