Bayesian Optimization for Enhanced Language Models: Optimizing Acquisition Functions

22 May 2025

Papers citing "Bayesian Optimization for Enhanced Language Models: Optimizing Acquisition Functions"

13 / 13 papers shown

Title
Model Fusion through Bayesian Optimization in Language Model Fine-Tuning Chaeyun Jang Hyungi Lee Jungtaek Kim Juho Lee MoMe 136 4 0 11 Nov 2024
SEAL: Safety-enhanced Aligned LLM Fine-tuning via Bilevel Data Selection Han Shen Pin-Yu Chen Payel Das Tianyi Chen ALM 116 23 0 09 Oct 2024
Large Language Models to Enhance Bayesian Optimization Tennison Liu Nicolás Astorga Nabeel Seedat M. Schaar 156 59 0 06 Feb 2024
An Introduction to Bi-level Optimization: Foundations and Applications in Signal Processing and Machine Learning Yihua Zhang Prashant Khanduri Ioannis C. Tsaknakis Yuguang Yao Min-Fong Hong Sijia Liu AI4CE 115 31 0 01 Aug 2023
LLM-Blender: Ensembling Large Language Models with Pairwise Ranking and Generative Fusion Dongfu Jiang Xiang Ren Bill Yuchen Lin ELM 105 334 0 05 Jun 2023
Multi-Objective Bayesian Optimization over High-Dimensional Search Spaces Sam Daulton David Eriksson Maximilian Balandat E. Bakshy 113 113 0 22 Sep 2021
RoBERTa: A Robustly Optimized BERT Pretraining Approach Yinhan Liu Myle Ott Naman Goyal Jingfei Du Mandar Joshi Danqi Chen Omer Levy M. Lewis Luke Zettlemoyer Veselin Stoyanov AIMat 814 24,615 0 26 Jul 2019
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.9K 95,554 0 11 Oct 2018
BOHB: Robust and Efficient Hyperparameter Optimization at Scale Stefan Falkner Aaron Klein Frank Hutter BDL 245 1,102 0 04 Jul 2018
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 1.2K 7,211 0 20 Apr 2018
Averaging Weights Leads to Wider Optima and Better Generalization Pavel Izmailov Dmitrii Podoprikhin T. Garipov Dmitry Vetrov A. Wilson FedML MoMe 197 1,672 0 14 Mar 2018
Predictive Entropy Search for Multi-objective Bayesian Optimization Daniel Hernández-Lobato José Miguel Hernández-Lobato Amar Shah Ryan P. Adams 161 190 0 17 Nov 2015
Practical Bayesian Optimization of Machine Learning Algorithms Jasper Snoek Hugo Larochelle Ryan P. Adams 395 8,002 0 13 Jun 2012