Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shift

6 June 2019

Balaji Lakshminarayanan

Jasper Snoek

UQCV

ArXiv PDF HTML

Papers citing "Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shift"

50 / 1,042 papers shown

Title
A Rigorous Link between Deep Ensembles and (Variational) Bayesian Methods Veit Wild Sahra Ghalebikesabi Dino Sejdinovic Jeremias Knoblauch BDL UQCV 40 13 0 24 May 2023
Just Ask for Calibration: Strategies for Eliciting Calibrated Confidence Scores from Language Models Fine-Tuned with Human Feedback Katherine Tian E. Mitchell Allan Zhou Archit Sharma Rafael Rafailov Huaxiu Yao Chelsea Finn Christopher D. Manning 66 291 0 24 May 2023
Uncertainty Quantification over Graph with Conformalized Graph Neural Networks Kexin Huang Ying Jin Emmanuel Candès J. Leskovec 43 58 0 23 May 2023
Improving Classifier Robustness through Active Generation of Pairwise Counterfactuals Ananth Balashankar Xuezhi Wang Yao Qin Ben Packer Nithum Thain Jilin Chen Ed H. Chi Alex Beutel 25 0 0 22 May 2023
Hystoc: Obtaining word confidences for fusion of end-to-end ASR systems Karel Beneš M. Kocour L. Burget 37 2 0 21 May 2023
When are ensembles really effective? Ryan Theisen Hyunsuk Kim Yaoqing Yang Liam Hodgkinson Michael W. Mahoney FedML UQCV 35 15 0 21 May 2023
Annealing Self-Distillation Rectification Improves Adversarial Training Yuehua Wu Hung-Jui Wang Shang-Tse Chen AAML 24 3 0 20 May 2023
Learning for Transductive Threshold Calibration in Open-World Recognition Qin Zhang Dongsheng An Tianjun Xiao Tong He Qingming Tang Ying Nian Wu Joseph Tighe Yifan Xing Stefano Soatto 38 0 0 19 May 2023
Semantic Anomaly Detection with Large Language Models Amine Elhafsi Rohan Sinha Christopher Agia Edward Schmerling I. Nesnas Marco Pavone 37 65 0 18 May 2023
Variational Classification S. Dhuliawala Mrinmaya Sachan Carl Allen BDL 28 5 0 17 May 2023
Logit-Based Ensemble Distribution Distillation for Robust Autoregressive Sequence Uncertainties Yassir Fathullah Guoxuan Xia Mark Gales UQCV 35 2 0 17 May 2023
A Probabilistic Transformation of Distance-Based Outliers David Muhr M. Affenzeller Josef Küng 24 11 0 16 May 2023
Towards unraveling calibration biases in medical image analysis María Agustina Ricci Lara Candelaria Mosquera Enzo Ferrante Rodrigo Echeveste 33 9 0 09 May 2023
A Unified Evaluation Framework for Novelty Detection and Accommodation in NLP with an Instantiation in Authorship Attribution Neeraj Varshney Himanshu Gupta Eric Robertson Bin Liu Chitta Baral 27 1 0 08 May 2023
Uncertainty Quantification in Machine Learning for Engineering Design and Health Prognostics: A Tutorial V. Nemani Luca Biggio Xun Huan Zhen Hu Olga Fink Anh Tran Yan Wang Xiaoge Zhang Chao Hu AI4CE 33 75 0 07 May 2023
A Survey on Out-of-Distribution Detection in NLP Hao Lang Yinhe Zheng Yixuan Li Jian Sun Feiling Huang Yongbin Li 34 20 0 05 May 2023
Inferential Moments of Uncertain Multivariable Systems Junheng Li 28 1 0 03 May 2023
Expectation Maximization Pseudo Labels Moucheng Xu Yukun Zhou Chen Jin M. Groot Daniel C. Alexander N. Oxtoby Yipeng Hu Joseph Jacob 71 2 0 02 May 2023
Great Models Think Alike: Improving Model Reliability via Inter-Model Latent Agreement Ailin Deng Miao Xiong Bryan Hooi 49 6 0 02 May 2023
Calibration Error Estimation Using Fuzzy Binning Geetanjali Bihani Julia Taylor Rayz 100 2 0 30 Apr 2023
QuantProb: Generalizing Probabilities along with Predictions for a Pre-trained Classifier Aditya Challa Snehanshu Saha S. Dhavala UQCV 33 2 0 25 Apr 2023
Efficient Uncertainty Estimation in Spiking Neural Networks via MC-dropout Tao Sun Bojian Yin S. Bohté BDL 30 5 0 20 Apr 2023
Learning Sample Difficulty from Pre-trained Models for Reliable Prediction Peng Cui Dan Zhang Zhijie Deng Yinpeng Dong Junyi Zhu 24 12 0 20 Apr 2023
SATA: Source Anchoring and Target Alignment Network for Continual Test Time Adaptation Goirik Chakrabarty Manogna Sreenivas Soma Biswas TTA 41 6 0 20 Apr 2023
Decoupled Training for Long-Tailed Classification With Stochastic Representations G. Nam Sunguk Jang Juho Lee OOD BDL OODD 30 13 0 19 Apr 2023
A Domain-Region Based Evaluation of ML Performance Robustness to Covariate Shift Firas Bayram Bestoun S. Ahmed OOD 18 4 0 18 Apr 2023
K-means Clustering Based Feature Consistency Alignment for Label-free Model Evaluation Shuyu Miao Lin Zheng Qingbin Liu and Hong Jin 39 5 0 17 Apr 2023
Approaching Test Time Augmentation in the Context of Uncertainty Calibration for Deep Neural Networks Pedro Conde T. Barros Rui L. Lopes C. Premebida U. J. Nunes UQCV 32 7 0 11 Apr 2023
UATTA-EB: Uncertainty-Aware Test-Time Augmented Ensemble of BERTs for Classifying Common Mental Illnesses on Social Media Posts Pratinav Seth Mihir Agarwal AI4MH 23 1 0 10 Apr 2023
Deep Anti-Regularized Ensembles provide reliable out-of-distribution uncertainty quantification Antoine de Mathelin Francois Deheeger Mathilde Mougeot Nicolas Vayatis OOD UQCV 25 2 0 08 Apr 2023
ASPEST: Bridging the Gap Between Active Learning and Selective Prediction Jiefeng Chen Jinsung Yoon Sayna Ebrahimi Sercan Ö. Arik S. Jha Tomas Pfister 36 1 0 07 Apr 2023
Source-free Domain Adaptation Requires Penalized Diversity Laya Rafiee Sevyeri Ivaxi Sheth Farhood Farahnak Alexandre See Samira Ebrahimi Kahou T. Fevens Mohammad Havaei TTA 24 0 0 06 Apr 2023
Multi-annotator Deep Learning: A Probabilistic Framework for Classification M. Herde Denis Huseljic Bernhard Sick 38 9 0 05 Apr 2023
Adopting Two Supervisors for Efficient Use of Large-Scale Remote Deep Neural Networks Michael Weiss Paolo Tonella AI4CE 21 0 0 05 Apr 2023
Uncertainty estimation in Deep Learning for Panoptic segmentation Michael J. Smith F. Ferrie OOD UQCV 38 0 0 04 Apr 2023
Incorporating Unlabelled Data into Bayesian Neural Networks Mrinank Sharma Tom Rainforth Yee Whye Teh Vincent Fortuin SSL UQCV BDL 46 9 0 04 Apr 2023
Uncertainty Propagation in Node Classification Zhao Xu Carolin (Haas) Lawrence Ammar Shaker Raman Siarheyeu BDL UQCV 50 2 0 03 Apr 2023
Towards Reliable Uncertainty Quantification via Deep Ensembles in Multi-output Regression Task Sunwoong Yang K. Yee UQCV 37 5 0 28 Mar 2023
Image Quality-aware Diagnosis via Meta-knowledge Co-embedding Haoxuan Che Si Chen Haoxing Chen 38 16 0 27 Mar 2023
Spatio-Temporal Graph Neural Networks for Predictive Learning in Urban Computing: A Survey G. Jin Keli Zhang Yuchen Fang Zezhi Shao Jincai Huang Junbo Zhang Yu Zheng AI4TS AI4CE 85 183 0 25 Mar 2023
Bridging Precision and Confidence: A Train-Time Loss for Calibrating Object Detection Muhammad Akhtar Munir Muhammad Haris Khan Salman Khan Fahad Shahbaz Khan UQCV 50 15 0 25 Mar 2023
Collaborative Multi-Object Tracking with Conformal Uncertainty Propagation Sanbao Su Songyang Han Yiming Li Zhili Zhang Chen Feng Caiwen Ding Fei Miao VOT 36 23 0 25 Mar 2023
A Survey of Historical Learning: Learning Models with Learning History Xiang Li Ge Wu Lingfeng Yang Wenzhe Wang Renjie Song Jian Yang MU AI4TS 31 2 0 23 Mar 2023
Human Uncertainty in Concept-Based AI Systems Katherine M. Collins Matthew Barker M. Zarlenga Naveen Raman Umang Bhatt M. Jamnik Ilia Sucholutsky Adrian Weller Krishnamurthy Dvijotham 66 39 0 22 Mar 2023
Reliability in Semantic Segmentation: Are We on the Right Track? Pau de Jorge Riccardo Volpi Philip Torr Grégory Rogez UQCV 26 19 0 20 Mar 2023
Uncertainty-aware U-Net for Medical Landmark Detection Ziyang Ye Haiyang Yu Bin Li 8 2 0 18 Mar 2023
Unleashing the Potential of Spiking Neural Networks by Dynamic Confidence Chen Li Edward Jones Steve Furber 29 17 0 17 Mar 2023
DUDES: Deep Uncertainty Distillation using Ensembles for Semantic Segmentation S. Landgraf Kira Wursthorn Markus Hillemann Markus Ulrich UQCV 19 10 0 17 Mar 2023
Window-Based Early-Exit Cascades for Uncertainty Estimation: When Deep Ensembles are More Efficient than Single Models Guoxuan Xia C. Bouganis UQCV 52 12 0 14 Mar 2023
Trust your neighbours: Penalty-based constraints for model calibration Balamurali Murugesan V. SukeshAdiga Bingyuan Liu H. Lombaert Ismail Ben Ayed Jose Dolz UQCV 26 9 0 11 Mar 2023