Pathologies in priors and inference for Bayesian transformers

8 October 2021

Papers citing "Pathologies in priors and inference for Bayesian transformers"

20 / 20 papers shown

Title
BLoB: Bayesian Low-Rank Adaptation by Backpropagation for Large Language Models Yibin Wang Haizhou Shi Ligong Han Dimitris N. Metaxas Hao Wang BDL UQLM 141 8 0 28 Jan 2025
Uncertainty quantification in fine-tuned LLMs using LoRA ensembles Oleksandr Balabanov Hampus Linander UQCV 80 16 0 19 Feb 2024
BNNpriors: A library for Bayesian neural network inference with different prior distributions Vincent Fortuin Adrià Garriga-Alonso Mark van der Wilk Laurence Aitchison BDL UQCV 33 24 0 14 May 2021
Priors in Bayesian Deep Learning: A Review Vincent Fortuin UQCV BDL 86 127 0 14 May 2021
What Are Bayesian Neural Network Posteriors Really Like? Pavel Izmailov Sharad Vikram Matthew D. Hoffman A. Wilson UQCV BDL 61 383 0 29 Apr 2021
VideoGPT: Video Generation using VQ-VAE and Transformers Wilson Yan Yunzhi Zhang Pieter Abbeel A. Srinivas ViT VGen 285 495 0 20 Apr 2021
Scalable Marginal Likelihood Estimation for Model Selection in Deep Learning Alexander Immer Matthias Bauer Vincent Fortuin Gunnar Rätsch Mohammad Emtiyaz Khan BDL UQCV 98 107 0 11 Apr 2021
Bayesian Neural Network Priors Revisited Vincent Fortuin Adrià Garriga-Alonso Sebastian W. Ober F. Wenzel Gunnar Rätsch Richard Turner Mark van der Wilk Laurence Aitchison BDL UQCV 84 140 0 12 Feb 2021
Bayesian Transformer Language Models for Speech Recognition Boyang Xue Jianwei Yu Junhao Xu Shansong Liu Shoukang Hu Zi Ye Mengzhe Geng Xunying Liu Helen Meng BDL 81 27 0 09 Feb 2021
Bayesian Attention Modules Xinjie Fan Shujian Zhang Bo Chen Mingyuan Zhou 126 59 0 20 Oct 2020
The Monte Carlo Transformer: a stochastic self-attention model for sequence prediction Alice Martin Charles Ollion Florian Strub Sylvain Le Corff Olivier Pietquin 33 6 0 15 Jul 2020
Visual Transformers: Token-based Image Representation and Processing for Computer Vision Bichen Wu Chenfeng Xu Xiaoliang Dai Alvin Wan Peizhao Zhang Zhicheng Yan Masayoshi Tomizuka Joseph E. Gonzalez Kurt Keutzer Peter Vajda ViT 87 556 0 05 Jun 2020
Efficient and Scalable Bayesian Neural Nets with Rank-1 Factors Michael W. Dusenberry Ghassen Jerfel Yeming Wen Yi-An Ma Jasper Snoek Katherine A. Heller Balaji Lakshminarayanan Dustin Tran UQCV BDL 49 209 0 14 May 2020
Being Bayesian, Even Just a Bit, Fixes Overconfidence in ReLU Networks Agustinus Kristiadi Matthias Hein Philipp Hennig BDL UQCV 73 285 0 24 Feb 2020
The k-tied Normal Distribution: A Compact Parameterization of Gaussian Mean Field Posteriors in Bayesian Neural Networks J. Swiatkowski Kevin Roth Bastiaan S. Veeling Linh-Tam Tran Joshua V. Dillon Jasper Snoek Stephan Mandt Tim Salimans Rodolphe Jenatton Sebastian Nowozin BDL 41 45 0 07 Feb 2020
Cyclical Stochastic Gradient MCMC for Bayesian Deep Learning Ruqi Zhang Chunyuan Li Jianyi Zhang Changyou Chen A. Wilson BDL 67 275 0 11 Feb 2019
SLANG: Fast Structured Covariance Approximations for Bayesian Deep Learning with Natural Gradient Aaron Mishkin Frederik Kunstner Didrik Nielsen Mark Schmidt Mohammad Emtiyaz Khan BDL UQCV 52 59 0 11 Nov 2018
Variational Attention for Sequence-to-Sequence Models Hareesh Bahuleyan Lili Mou Olga Vechtomova Pascal Poupart DRL 65 117 0 21 Dec 2017
Variational Dropout and the Local Reparameterization Trick Diederik P. Kingma Tim Salimans Max Welling BDL 164 1,500 0 08 Jun 2015
Stochastic Gradient Hamiltonian Monte Carlo Tianqi Chen E. Fox Carlos Guestrin BDL 88 906 0 17 Feb 2014