Deep Ensembles: A Loss Landscape Perspective

5 December 2019

Stanislav Fort

Huiyi Hu

Balaji Lakshminarayanan

OOD

UQCV

ArXiv PDF HTML

Papers citing "Deep Ensembles: A Loss Landscape Perspective"

50 / 158 papers shown

Title
Asynchronous Collaborative Localization by Integrating Spatiotemporal Graph Learning with Model-Based Estimation Peng Gao Brian Reily Rui Guo Hongsheng Lu Qingzhao Zhu Hao Zhang 52 5 0 05 Nov 2021
Diversity Matters When Learning From Ensembles G. Nam Jongmin Yoon Yoonho Lee Juho Lee UQCV FedML VLM 43 36 0 27 Oct 2021
Practical Galaxy Morphology Tools from Deep Supervised Representation Learning Mike Walmsley Anna M. M. Scaife Chris J. Lintott Michelle Lochner Yu Zhu ... Xibo Ma Sandor Kruk Zhen Lei G. Guo B. Simmons 24 29 0 25 Oct 2021
Quantifying Epistemic Uncertainty in Deep Learning Ziyi Huang Henry Lam Haofeng Zhang UQCV BDL UD PER 24 12 0 23 Oct 2021
No One Representation to Rule Them All: Overlapping Features of Training Methods Raphael Gontijo-Lopes Yann N. Dauphin E. D. Cubuk 34 60 0 20 Oct 2021
The Role of Permutation Invariance in Linear Mode Connectivity of Neural Networks R. Entezari Hanie Sedghi O. Saukh Behnam Neyshabur MoMe 39 217 0 12 Oct 2021
Connecting Low-Loss Subspace for Personalized Federated Learning S. Hahn Minwoo Jeong Junghye Lee FedML 24 18 0 16 Sep 2021
Leveraging Uncertainty for Improved Static Malware Detection Under Extreme False Positive Constraints A. Nguyen Edward Raff Charles K. Nicholas James Holt 41 21 0 09 Aug 2021
Robust Semantic Segmentation with Superpixel-Mix Gianni Franchi Nacim Belkhir Mai Lan Ha Yufei Hu Andrei Bursuc V. Blanz Angela Yao UQCV 38 22 0 02 Aug 2021
A Survey of Uncertainty in Deep Neural Networks J. Gawlikowski Cedrique Rovile Njieutcheu Tassi Mohsin Ali Jongseo Lee Matthias Humt ... R. Roscher Muhammad Shahzad Wen Yang R. Bamler Xiaoxiang Zhu BDL UQCV OOD 61 1,111 0 07 Jul 2021
What can linear interpolation of neural network loss landscapes tell us? Tiffany J. Vlaar Jonathan Frankle MoMe 30 27 0 30 Jun 2021
Detecting Errors and Estimating Accuracy on Unlabeled Data with Self-training Ensembles Jiefeng Chen Frederick Liu Besim Avci Xi Wu Yingyu Liang S. Jha 32 61 0 29 Jun 2021
Deep Ensembling with No Overhead for either Training or Testing: The All-Round Blessings of Dynamic Sparsity Shiwei Liu Tianlong Chen Zahra Atashgahi Xiaohan Chen Ghada Sokar Elena Mocanu Mykola Pechenizkiy Zhangyang Wang Decebal Constantin Mocanu OOD 31 49 0 28 Jun 2021
Revisiting Deep Learning Models for Tabular Data Yu. V. Gorishniy Ivan Rubachev Valentin Khrulkov Artem Babenko LMTD 48 703 0 22 Jun 2021
Repulsive Deep Ensembles are Bayesian Francesco DÁngelo Vincent Fortuin UQCV BDL 61 95 0 22 Jun 2021
Extracting Global Dynamics of Loss Landscape in Deep Learning Models Mohammed Eslami Hamed Eramian Marcio Gameiro W. Kalies Konstantin Mischaikow 23 1 0 14 Jun 2021
Quantifying Uncertainty in Deep Spatiotemporal Forecasting Dongxian Wu Liyao (Mars) Gao X. Xiong Matteo Chinazzi Alessandro Vespignani Yi Ma Rose Yu AI4TS 13 68 0 25 May 2021
Accuracy-Privacy Trade-off in Deep Ensemble: A Membership Inference Perspective Shahbaz Rezaei Zubair Shafiq Xin Liu FedML MIACV 40 13 0 12 May 2021
Structured Ensembles: an Approach to Reduce the Memory Footprint of Ensemble Methods Jary Pomponi Simone Scardapane A. Uncini UQCV 49 7 0 06 May 2021
Deep Learning for Bayesian Optimization of Scientific Problems with High-Dimensional Structure Samuel Kim Peter Y. Lu Charlotte Loh Jamie Smith Jasper Snoek M. Soljavcić BDL AI4CE 148 17 0 23 Apr 2021
Distill on the Go: Online knowledge distillation in self-supervised learning Prashant Shivaram Bhat Elahe Arani Bahram Zonooz SSL 22 28 0 20 Apr 2021
Does Your Dermatology Classifier Know What It Doesn't Know? Detecting the Long-Tail of Unseen Conditions Abhijit Guha Roy Jie Jessie Ren Shekoofeh Azizi Aaron Loh Vivek Natarajan ... Yun-Hui Liu taylan. cemgil Alan Karthikesalingam Balaji Lakshminarayanan Jim Winkens 18 104 0 08 Apr 2021
Automated Cleanup of the ImageNet Dataset by Model Consensus, Explainability and Confident Learning Csaba Kertész VLM SSL 28 45 0 30 Mar 2021
Accurate and Reliable Forecasting using Stochastic Differential Equations Peng Cui Zhijie Deng Wenbo Hu Jun Zhu UQCV 38 1 0 28 Mar 2021
LiBRe: A Practical Bayesian Approach to Adversarial Detection Zhijie Deng Xiao Yang Shizhen Xu Hang Su Jun Zhu BDL AAML 25 61 0 27 Mar 2021
NOMU: Neural Optimization-based Model Uncertainty Jakob Heiss Jakob Weissteiner Hanna Wutte Sven Seuken Josef Teichmann BDL 37 19 0 26 Feb 2021
Loss Surface Simplexes for Mode Connecting Volumes and Fast Ensembling Gregory W. Benton Wesley J. Maddox Sanae Lotfi A. Wilson UQCV 33 67 0 25 Feb 2021
Probabilistic Spatial Analysis in Quantitative Microscopy with Uncertainty-Aware Cell Detection using Deep Bayesian Regression of Density Maps Alvaro Gomariz Tiziano Portenier C. Nombela-Arrieta O. Goksel UQCV 28 6 0 23 Feb 2021
Learning Neural Network Subspaces Mitchell Wortsman Maxwell Horton Carlos Guestrin Ali Farhadi Mohammad Rastegari UQCV 27 85 0 20 Feb 2021
Locally Adaptive Label Smoothing for Predictive Churn Dara Bahri Heinrich Jiang NoLa 43 8 0 09 Feb 2021
Uncertainty Estimation with Deep Learning for Rainfall-Runoff Modelling D. Klotz Frederik Kratzert M. Gauch A. Sampson Günter Klambauer Sepp Hochreiter G. Nearing BDL UQCV 18 106 0 15 Dec 2020
Hypothesis Disparity Regularized Mutual Information Maximization Qicheng Lao Xiang Jiang Mohammad Havaei 33 24 0 15 Dec 2020
A Deeper Look at the Hessian Eigenspectrum of Deep Neural Networks and its Applications to Regularization Adepu Ravi Sankar Yash Khasbage Rahul Vigneswaran V. Balasubramanian 25 42 0 07 Dec 2020
Wisdom of Committees: An Overlooked Approach To Faster and More Accurate Models Xiaofang Wang Dan Kondratyuk Eric Christiansen Kris Kitani Y. Alon Elad Eban 13 46 0 03 Dec 2020
Underspecification Presents Challenges for Credibility in Modern Machine Learning Alexander DÁmour Katherine A. Heller D. Moldovan Ben Adlam B. Alipanahi ... Kellie Webster Steve Yadlowsky T. Yun Xiaohua Zhai D. Sculley OffRL 77 671 0 06 Nov 2020
deep21: a Deep Learning Method for 21cm Foreground Removal T. Lucas Makinen Lachlan Lancaster F. Villaescusa-Navarro Peter Melchior S. Ho Laurence Perreault Levasseur D. Spergel 3DPC 30 28 0 29 Oct 2020
PEP: Parameter Ensembling by Perturbation Alireza Mehrtash Purang Abolmaesumi Polina Golland Tina Kapur Demian Wassermann W. Wells 25 10 0 24 Oct 2020
Combining Ensembles and Data Augmentation can Harm your Calibration Yeming Wen Ghassen Jerfel Rafael Muller Michael W. Dusenberry Jasper Snoek Balaji Lakshminarayanan Dustin Tran UQCV 32 63 0 19 Oct 2020
Training independent subnetworks for robust prediction Marton Havasi Rodolphe Jenatton Stanislav Fort Jeremiah Zhe Liu Jasper Snoek Balaji Lakshminarayanan Andrew M. Dai Dustin Tran UQCV OOD 41 208 0 13 Oct 2020
Linear Mode Connectivity in Multitask and Continual Learning Seyed Iman Mirzadeh Mehrdad Farajtabar Dilan Görür Razvan Pascanu H. Ghasemzadeh CLL 37 139 0 09 Oct 2020
Gradient Flow in Sparse Neural Networks and How Lottery Tickets Win Utku Evci Yani Andrew Ioannou Cem Keskin Yann N. Dauphin 40 87 0 07 Oct 2020
Neural Bootstrapper Minsuk Shin Hyungjoon Cho Hyun-Seok Min Sungbin Lim UQCV BDL 22 7 0 02 Oct 2020
Dataset Cartography: Mapping and Diagnosing Datasets with Training Dynamics Swabha Swayamdipta Roy Schwartz Nicholas Lourie Yizhong Wang Hannaneh Hajishirzi Noah A. Smith Yejin Choi 51 429 0 22 Sep 2020
Beyond Point Estimate: Inferring Ensemble Prediction Variation from Neuron Activation Strength in Recommender Systems Zhe Chen Yuyan Wang Dong Lin D. Cheng Lichan Hong Ed H. Chi Claire Cui 31 16 0 17 Aug 2020
Prediction Intervals: Split Normal Mixture from Quality-Driven Deep Ensembles Tárik S. Salem H. Langseth H. Ramampiaro UQCV 21 36 0 19 Jul 2020
Hyperparameter Ensembles for Robustness and Uncertainty Quantification F. Wenzel Jasper Snoek Dustin Tran Rodolphe Jenatton UQCV 33 204 0 24 Jun 2020
Neural Ensemble Search for Uncertainty Estimation and Dataset Shift Sheheryar Zaidi Arber Zela T. Elsken Chris Holmes Frank Hutter Yee Whye Teh OOD UQCV 18 71 0 15 Jun 2020
A benchmark study on reliable molecular supervised learning via Bayesian learning Doyeong Hwang Grace Lee Hanseok Jo Seyoul Yoon Seongok Ryu 32 9 0 12 Jun 2020
Efficient Ensemble Model Generation for Uncertainty Estimation with Bayesian Approximation in Segmentation Hong Joo Lee S. T. Kim Hakmin Lee Nassir Navab Yong Man Ro UQCV 16 7 0 21 May 2020
Superkernel Neural Architecture Search for Image Denoising Marcin Mo.zejko Tomasz Latkowski Lukasz Treszczotko Michal Szafraniuk K. Trojanowski SupR 27 16 0 19 Apr 2020