Gaussian Stochastic Weight Averaging for Bayesian Low-Rank Adaptation of Large Language Models

6 May 2024

Papers citing "Gaussian Stochastic Weight Averaging for Bayesian Low-Rank Adaptation of Large Language Models"

8 / 8 papers shown

Title
BLoB: Bayesian Low-Rank Adaptation by Backpropagation for Large Language Models Yibin Wang H. Shi Ligong Han Dimitris N. Metaxas Hao Wang BDL UQLM 104 6 0 28 Jan 2025
Uncertainty Quantification with Pre-trained Language Models: A Large-Scale Empirical Analysis Yuxin Xiao Paul Pu Liang Umang Bhatt W. Neiswanger Ruslan Salakhutdinov Louis-Philippe Morency 173 86 0 10 Oct 2022
Probing as Quantifying Inductive Bias Alexander Immer Lucas Torroba Hennigen Vincent Fortuin Ryan Cotterell 37 14 0 15 Oct 2021
Bayesian Transformer Language Models for Speech Recognition Boyang Xue Jianwei Yu Junhao Xu Shansong Liu Shoukang Hu Zi Ye Mengzhe Geng Xunying Liu H. Meng BDL 68 26 0 09 Feb 2021
Fast and Scalable Bayesian Deep Learning by Weight-Perturbation in Adam Mohammad Emtiyaz Khan Didrik Nielsen Voot Tangkaratt Wu Lin Y. Gal Akash Srivastava ODL 74 266 0 13 Jun 2018
Simple and Scalable Predictive Uncertainty Estimation using Deep Ensembles Balaji Lakshminarayanan Alexander Pritzel Charles Blundell UQCV BDL 268 5,660 0 05 Dec 2016
Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning Y. Gal Zoubin Ghahramani UQCV BDL 249 9,134 0 06 Jun 2015
MCMC using Hamiltonian dynamics Radford M. Neal 164 3,260 0 09 Jun 2012