v1v2 (latest)

Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shift

6 June 2019

Balaji Lakshminarayanan

Jasper Snoek

UQCV

ArXiv (abs)PDF HTML

Papers citing "Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shift"

50 / 1,062 papers shown

Title
UATTA-EB: Uncertainty-Aware Test-Time Augmented Ensemble of BERTs for Classifying Common Mental Illnesses on Social Media Posts Pratinav Seth Mihir Agarwal AI4MH 60 1 0 10 Apr 2023
Deep Anti-Regularized Ensembles provide reliable out-of-distribution uncertainty quantification Antoine de Mathelin Francois Deheeger Mathilde Mougeot Nicolas Vayatis OOD UQCV 70 3 0 08 Apr 2023
ASPEST: Bridging the Gap Between Active Learning and Selective Prediction Jiefeng Chen Jinsung Yoon Sayna Ebrahimi Sercan O. Arik S. Jha Tomas Pfister 106 1 0 07 Apr 2023
Source-free Domain Adaptation Requires Penalized Diversity Laya Rafiee Sevyeri Ivaxi Sheth Farhood Farahnak Alexandre See Samira Ebrahimi Kahou T. Fevens Mohammad Havaei TTA 53 0 0 06 Apr 2023
Multi-annotator Deep Learning: A Probabilistic Framework for Classification M. Herde Denis Huseljic Bernhard Sick 80 9 0 05 Apr 2023
Adopting Two Supervisors for Efficient Use of Large-Scale Remote Deep Neural Networks Michael Weiss Paolo Tonella AI4CE 54 0 0 05 Apr 2023
Uncertainty estimation in Deep Learning for Panoptic segmentation Michael J. Smith F. Ferrie OOD UQCV 65 0 0 04 Apr 2023
Incorporating Unlabelled Data into Bayesian Neural Networks Mrinank Sharma Tom Rainforth Yee Whye Teh Vincent Fortuin SSL UQCV BDL 98 10 0 04 Apr 2023
Uncertainty Propagation in Node Classification Zhao Xu Carolin (Haas) Lawrence Ammar Shaker Raman Siarheyeu BDL UQCV 138 2 0 03 Apr 2023
Towards Reliable Uncertainty Quantification via Deep Ensembles in Multi-output Regression Task Sunwoong Yang K. Yee UQCV 88 6 0 28 Mar 2023
Image Quality-aware Diagnosis via Meta-knowledge Co-embedding Haoxuan Che Si Chen Haoxing Chen 89 16 0 27 Mar 2023
Spatio-Temporal Graph Neural Networks for Predictive Learning in Urban Computing: A Survey G. Jin Yuxuan Liang Yuchen Fang Zezhi Shao Jincai Huang Junbo Zhang Yu Zheng AI4TS AI4CE 138 209 0 25 Mar 2023
Bridging Precision and Confidence: A Train-Time Loss for Calibrating Object Detection Muhammad Akhtar Munir Muhammad Haris Khan Salman Khan Fahad Shahbaz Khan UQCV 86 15 0 25 Mar 2023
Collaborative Multi-Object Tracking with Conformal Uncertainty Propagation Sanbao Su Songyang Han Yiming Li Zhili Zhang Chen Feng Caiwen Ding Fei Miao VOT 110 26 0 25 Mar 2023
A Survey of Historical Learning: Learning Models with Learning History Xiang Li Ge Wu Lingfeng Yang Wenzhe Wang Renjie Song Jian Yang MU AI4TS 103 2 0 23 Mar 2023
Human Uncertainty in Concept-Based AI Systems Katherine M. Collins Matthew Barker M. Zarlenga Naveen Raman Umang Bhatt M. Jamnik Ilia Sucholutsky Adrian Weller Krishnamurthy Dvijotham 113 41 0 22 Mar 2023
Reliability in Semantic Segmentation: Are We on the Right Track? Pau de Jorge Riccardo Volpi Philip Torr Grégory Rogez UQCV 65 21 0 20 Mar 2023
Uncertainty-aware U-Net for Medical Landmark Detection Ziyang Ye Haiyang Yu Bin Li 33 2 0 18 Mar 2023
Unleashing the Potential of Spiking Neural Networks by Dynamic Confidence Chen Li Edward Jones Steve Furber 75 19 0 17 Mar 2023
DUDES: Deep Uncertainty Distillation using Ensembles for Semantic Segmentation S. Landgraf Kira Wursthorn Markus Hillemann Markus Ulrich UQCV 57 11 0 17 Mar 2023
Window-Based Early-Exit Cascades for Uncertainty Estimation: When Deep Ensembles are More Efficient than Single Models Guoxuan Xia C. Bouganis UQCV 113 12 0 14 Mar 2023
Trust your neighbours: Penalty-based constraints for model calibration Balamurali Murugesan V. SukeshAdiga Bingyuan Liu H. Lombaert Ismail Ben Ayed Jose Dolz UQCV 86 10 0 11 Mar 2023
Uncertainty quantification in neural network classifiers -- a local linear approach Magnus Malmström Isaac Skog Daniel Axehill Fredrik K. Gustafsson UQCV 60 1 0 10 Mar 2023
Training, Architecture, and Prior for Deterministic Uncertainty Methods Bertrand Charpentier Chenxiang Zhang Stephan Günnemann UQCV OOD AI4CE 95 7 0 10 Mar 2023
Adaptive Calibrator Ensemble for Model Calibration under Distribution Shift Yu-Hui Zou Weijian Deng Liang Zheng OODD 32 2 0 09 Mar 2023
Scalable Stochastic Gradient Riemannian Langevin Dynamics in Non-Diagonal Metrics Hanlin Yu M. Hartmann Bernardo Williams Arto Klami BDL 75 6 0 09 Mar 2023
To Stay or Not to Stay in the Pre-train Basin: Insights on Ensembling in Transfer Learning Ildus Sadrtdinov Dmitrii Pozdeev Dmitry Vetrov E. Lobacheva 93 6 0 06 Mar 2023
Rethinking Confidence Calibration for Failure Prediction Fei Zhu Zhen Cheng Xu-Yao Zhang Cheng-Lin Liu UQCV 91 41 0 06 Mar 2023
Multi-Symmetry Ensembles: Improving Diversity and Generalization via Opposing Symmetries Charlotte Loh Seung-Jun Han Shivchander Sudalairaj Rumen Dangovski Kai Xu F. Wenzel Marin Soljacic Akash Srivastava UQCV 85 1 0 04 Mar 2023
ESD: Expected Squared Difference as a Tuning-Free Trainable Calibration Measure Hee Suk Yoon Joshua Tian Jin Tee Eunseop Yoon Sunjae Yoon G. Kim Yingzhen Li Changdong Yoo UQCV MQ 60 11 0 04 Mar 2023
Uncertainty Estimation by Fisher Information-based Evidential Deep Learning Danruo Deng Guangyong Chen Yang Yu Fu-Lun Liu Pheng-Ann Heng EDL UQCV FedML 126 47 0 03 Mar 2023
Safe AI for health and beyond -- Monitoring to transform a health service Mahed Abroshan Michael C. Burkhart Oscar Giles Sam F. Greenbury Zoe Kourtzi Jack Roberts M. Schaar Jannetta S. Steyn Alan Wilson M. Yong 45 1 0 02 Mar 2023
Multi-Head Multi-Loss Model Calibration Adrian Galdran Johan Verjans G. Carneiro M. A. G. Ballester UQCV 66 7 0 02 Mar 2023
A Survey on Uncertainty Quantification Methods for Deep Learning Wenchong He Zhe Jiang Tingsong Xiao Zelin Xu Yukun Li BDL UQCV AI4CE 193 24 0 26 Feb 2023
Deep active learning for nonlinear system identification E. Lundby Adil Rasheed I. Halvorsen D. Reinhardt S. Gros J. Gravdahl 57 2 0 24 Feb 2023
Variational Linearized Laplace Approximation for Bayesian Deep Learning Luis A. Ortega Simón Rodríguez Santana Daniel Hernández-Lobato BDL UQCV 135 4 0 24 Feb 2023
Distributionally Robust Recourse Action D. Nguyen Ngoc H. Bui Viet Anh Nguyen 92 8 0 22 Feb 2023
What Are Effective Labels for Augmented Data? Improving Calibration and Robustness with AutoLabel Yao Qin Xuezhi Wang Balaji Lakshminarayanan Ed H. Chi Alex Beutel UQCV 69 5 0 22 Feb 2023
Likelihood Annealing: Fast Calibrated Uncertainty for Regression Uddeshya Upadhyay Jae Myung Kim Cordelia Schmidt Bernhard Schölkopf Zeynep Akata BDL UQCV 91 1 0 21 Feb 2023
Semantic Uncertainty: Linguistic Invariances for Uncertainty Estimation in Natural Language Generation Lorenz Kuhn Y. Gal Sebastian Farquhar UQLM 233 313 0 19 Feb 2023
Competent but Rigid: Identifying the Gap in Empowering AI to Participate Equally in Group Decision-Making Chengbo Zheng Yuheng Wu Chuhan Shi Shuai Ma Jiehui Luo Xiaojuan Ma 90 28 0 17 Feb 2023
Bag of Tricks for In-Distribution Calibration of Pretrained Transformers Jaeyoung Kim Dongbin Na Sungchul Choi Sungbin Lim VLM 85 5 0 13 Feb 2023
Probabilistic Circuits That Know What They Don't Know Fabrizio G. Ventola Steven Braun Zhongjie Yu Martin Mundt Kristian Kersting UQCV TPM 63 7 0 13 Feb 2023
Density-Softmax: Efficient Test-time Model for Uncertainty Estimation and Robustness under Distribution Shifts H. Bui Anqi Liu OOD UQCV 185 6 0 13 Feb 2023
Calibrating a Deep Neural Network with Its Predecessors Linwei Tao Minjing Dong Daochang Liu Changming Sun Chang Xu BDL UQCV 60 5 0 13 Feb 2023
Pushing the Accuracy-Group Robustness Frontier with Introspective Self-play J. Liu Krishnamurthy Dvijotham Jihyeon Janel Lee Quan Yuan Martin Strobel Balaji Lakshminarayanan Deepak Ramachandran 75 5 0 11 Feb 2023
Verifying Generalization in Deep Learning Guy Amir Osher Maayan Tom Zelazny Guy Katz Michael Schapira AAML AI4CE 81 14 0 11 Feb 2023
Beyond In-Domain Scenarios: Robust Density-Aware Calibration Christian Tomani Futa Waseda Yuesong Shen Daniel Cremers UQCV 54 5 0 10 Feb 2023
Confidence-based Reliable Learning under Dual Noises Peng Cui Yang Yue Zhijie Deng Jun Zhu NoLa 40 8 0 10 Feb 2023
A Benchmark on Uncertainty Quantification for Deep Learning Prognostics Luis Basora Arthur Viens M. A. Chao X. Olive UQCV BDL OOD 96 11 0 09 Feb 2023