Deep Ensembles: A Loss Landscape Perspective

5 December 2019

Stanislav Fort

Huiyi Hu

Balaji Lakshminarayanan

OOD

UQCV

ArXiv PDF HTML

Papers citing "Deep Ensembles: A Loss Landscape Perspective"

50 / 158 papers shown

Title
Bayesian posterior approximation with stochastic ensembles Oleksandr Balabanov Bernhard Mehlig Hampus Linander BDL UQCV 29 5 0 15 Dec 2022
Scalable Bayesian Uncertainty Quantification for Neural Network Potentials: Promise and Pitfalls Stephan Thaler Gregor Doehner Julija Zavadlav 40 21 0 15 Dec 2022
Editing Models with Task Arithmetic Gabriel Ilharco Marco Tulio Ribeiro Mitchell Wortsman Suchin Gururangan Ludwig Schmidt Hannaneh Hajishirzi Ali Farhadi KELM MoMe MU 74 443 0 08 Dec 2022
An Ensemble-Based Deep Framework for Estimating Thermo-Chemical State Variables from Flamelet Generated Manifolds A. Salunkhe G. Georgalis A. Patra V. Chandola 19 1 0 25 Nov 2022
Unveiling the Tapestry: the Interplay of Generalization and Forgetting in Continual Learning Zenglin Shi Jing Jie Ying Sun J. Lim Mengmi Zhang CLL 44 1 0 21 Nov 2022
Introduction and Exemplars of Uncertainty Decomposition Shuo Chen UD UQCV PER 32 0 0 17 Nov 2022
REPAIR: REnormalizing Permuted Activations for Interpolation Repair Keller Jordan Hanie Sedghi O. Saukh R. Entezari Behnam Neyshabur MoMe 46 94 0 15 Nov 2022
Packed-Ensembles for Efficient Uncertainty Estimation Olivier Laurent Adrien Lafage Enzo Tartaglione Geoffrey Daniel Jean-Marc Martinez Andrei Bursuc Gianni Franchi OODD 46 32 0 17 Oct 2022
Multi-CLS BERT: An Efficient Alternative to Traditional Ensembling Haw-Shiuan Chang Ruei-Yao Sun Kathryn Ricci Andrew McCallum 43 15 0 10 Oct 2022
Sequential Ensembling for Semantic Segmentation Rawal Khirodkar Brandon A. Smith Siddhartha Chandra Amit Agrawal A. Criminisi 35 2 0 08 Oct 2022
Automatic Neural Network Hyperparameter Optimization for Extrapolation: Lessons Learned from Visible and Near-Infrared Spectroscopy of Mango Fruit Matthew C. Dirks David Poole 26 16 0 03 Oct 2022
MLPInit: Embarrassingly Simple GNN Training Acceleration with MLP Initialization Xiaotian Han Tong Zhao Yozen Liu Xia Hu Neil Shah GNN 60 36 0 30 Sep 2022
On the Factory Floor: ML Engineering for Industrial-Scale Ads Recommendation Models Rohan Anil S. Gadanho Danya Huang Nijith Jacob Zhuoshu Li ... Cristina Pop Kevin Regan G. Shamir Rakesh Shivanna Qiqi Yan 3DV 29 41 0 12 Sep 2022
Quality Not Quantity: On the Interaction between Dataset Design and Robustness of CLIP Thao Nguyen Gabriel Ilharco Mitchell Wortsman Sewoong Oh Ludwig Schmidt CLIP VLM 53 99 0 10 Aug 2022
The Neural Race Reduction: Dynamics of Abstraction in Gated Networks Andrew M. Saxe Shagun Sodhani Sam Lewallen AI4CE 32 34 0 21 Jul 2022
Latent Discriminant deterministic Uncertainty Gianni Franchi Xuanlong Yu Andrei Bursuc Emanuel Aldea Séverine Dubuisson David Filliat UQCV 26 18 0 20 Jul 2022
Single Model Uncertainty Estimation via Stochastic Data Centering Jayaraman J. Thiagarajan Rushil Anirudh V. Narayanaswamy P. Bremer UQCV OOD 35 26 0 14 Jul 2022
Transfer learning for ensembles: reducing computation time and keeping the diversity Ilya Shashkov Nikita Balabin Evgeny Burnaev Alexey Zaytsev 22 1 0 27 Jun 2022
Influence of uncertainty estimation techniques on false-positive reduction in liver lesion detection Ishaan Bhat J. Pluim M. Viergever Hugo J. Kuijf MedIm 21 4 0 22 Jun 2022
Balanced Product of Calibrated Experts for Long-Tailed Recognition Emanuel Sanchez Aimar Arvi Jonnarth M. Felsberg Marco Kuhlmann 23 22 0 10 Jun 2022
Ensembles for Uncertainty Estimation: Benefits of Prior Functions and Bootstrapping Vikranth Dwaracherla Zheng Wen Ian Osband Xiuyuan Lu S. Asghari Benjamin Van Roy UQCV 32 17 0 08 Jun 2022
Revisiting the Importance of Amplifying Bias for Debiasing Jungsoo Lee Jeonghoon Park Daeyoung Kim Juyoung Lee Edward Choi Jaegul Choo 57 22 0 29 May 2022
Sample-Efficient Optimisation with Probabilistic Transformer Surrogates A. Maraval Matthieu Zimmer Antoine Grosnit Rasul Tutunov Jun Wang H. Ammar 35 2 0 27 May 2022
Deep interpretable ensembles Lucas Kook Andrea Götschi Philipp F. M. Baumann Torsten Hothorn Beate Sick UQCV 30 8 0 25 May 2022
Interpolating Compressed Parameter Subspaces Siddhartha Datta N. Shadbolt 37 5 0 19 May 2022
A Simple Approach to Improve Single-Model Deep Uncertainty via Distance-Awareness J. Liu Shreyas Padhy Jie Jessie Ren Zi Lin Yeming Wen Ghassen Jerfel Zachary Nado Jasper Snoek Dustin Tran Balaji Lakshminarayanan UQCV BDL 26 48 0 01 May 2022
Low-Loss Subspace Compression for Clean Gains against Multi-Agent Backdoor Attacks Siddhartha Datta N. Shadbolt AAML 32 6 0 07 Mar 2022
Scalable Uncertainty Quantification for Deep Operator Networks using Randomized Priors Yibo Yang Georgios Kissas P. Perdikaris BDL UQCV 37 40 0 06 Mar 2022
Uncertainty Estimation for Heatmap-based Landmark Localization Lawrence Schobs Andrew J Swift Haiping Lu UQCV 29 11 0 04 Mar 2022
Engineering the Neural Automatic Passenger Counter Nico Jahn Michael Siebert 13 2 0 02 Mar 2022
Theoretical Error Analysis of Entropy Approximation for Gaussian Mixture Takashi Furuya Hiroyuki Kusumoto K. Taniguchi Naoya Kanno Kazuma Suetake 19 1 0 26 Feb 2022
Multiple Importance Sampling ELBO and Deep Ensembles of Variational Approximations Oskar Kviman Harald Melin Hazal Koptagel Victor Elvira J. Lagergren DRL 75 17 0 22 Feb 2022
Continual Learning Beyond a Single Model T. Doan Seyed Iman Mirzadeh Mehrdad Farajtabar CLL 31 16 0 20 Feb 2022
Deep Ensembles Work, But Are They Necessary? Taiga Abe E. Kelly Buchanan Geoff Pleiss R. Zemel John P. Cunningham OOD UQCV 44 60 0 14 Feb 2022
PFGE: Parsimonious Fast Geometric Ensembling of DNNs Hao Guo Jiyong Jin B. Liu FedML 32 1 0 14 Feb 2022
Image-to-Image Regression with Distribution-Free Uncertainty Quantification and Applications in Imaging Anastasios Nikolas Angelopoulos Amit Kohli Stephen Bates Michael I. Jordan Jitendra Malik T. Alshaabi S. Upadhyayula Yaniv Romano UQCV OOD 16 94 0 10 Feb 2022
Verification-Aided Deep Ensemble Selection Guy Amir Tom Zelazny Guy Katz Michael Schapira AAML 30 18 0 08 Feb 2022
Evaluating natural language processing models with generalization metrics that do not need access to any training or testing data Yaoqing Yang Ryan Theisen Liam Hodgkinson Joseph E. Gonzalez Kannan Ramchandran Charles H. Martin Michael W. Mahoney 94 17 0 06 Feb 2022
Backdoors Stuck At The Frontdoor: Multi-Agent Backdoor Attacks That Backfire Siddhartha Datta N. Shadbolt AAML 38 7 0 28 Jan 2022
Learning Proximal Operators to Discover Multiple Optima Lingxiao Li Noam Aigerman Vladimir G. Kim Jiajin Li Kristjan Greenewald Mikhail Yurochkin Justin Solomon 47 1 0 28 Jan 2022
Improving robustness and calibration in ensembles with diversity regularization H. A. Mehrtens Camila González Anirban Mukhopadhyay UQCV 19 7 0 26 Jan 2022
Feature transforms for image data augmentation L. Nanni M. Paci S. Brahnam A. Lumini 38 19 0 24 Jan 2022
Representation Topology Divergence: A Method for Comparing Neural Network Representations S. Barannikov I. Trofimov Nikita Balabin Evgeny Burnaev 3DPC 40 45 0 31 Dec 2021
Modeling Mask Uncertainty in Hyperspectral Image Reconstruction Jiamian Wang Yulun Zhang X. Yuan Ziyi Meng Zhiqiang Tao 19 9 0 31 Dec 2021
Maximum Entropy on Erroneous Predictions (MEEP): Improving model calibration for medical image segmentation Agostina J. Larrazabal Cesar E. Martínez Jose Dolz Enzo Ferrante 21 15 0 22 Dec 2021
GM Score: Incorporating inter-class and intra-class generator diversity, discriminability of disentangled representation, and sample fidelity for evaluating GANs GM Harshvardhan Aanchal Sahu Mahendra Kumar Gourisaria 23 0 0 13 Dec 2021
Forward Compatible Training for Large-Scale Embedding Retrieval Systems Vivek Ramanujan Pavan Kumar Anasosalu Vasu Ali Farhadi Oncel Tuzel Hadi Pouransari VLM 32 16 0 06 Dec 2021
Transferability Metrics for Selecting Source Model Ensembles A. Agostinelli J. Uijlings Thomas Mensink V. Ferrari 15 23 0 25 Nov 2021
Towards Lightweight Controllable Audio Synthesis with Conditional Implicit Neural Representations Jan Zuiderveld Marco Federici Erik J. Bekkers AI4CE 29 6 0 14 Nov 2021
On Efficient Uncertainty Estimation for Resource-Constrained Mobile Applications J. Rock Tiago Azevedo R. D. Jong Daniel Ruiz-Munoz Partha P. Maji UQCV 35 5 0 11 Nov 2021