v1v2 (latest)

Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shift

6 June 2019

Balaji Lakshminarayanan

Jasper Snoek

UQCV

ArXiv (abs)PDF HTML

Papers citing "Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shift"

50 / 1,062 papers shown

Title
Deep Gaussian Mixture Ensembles Yousef El-Laham Niccolò Dalmasso Elizabeth Fons Svitlana Vyetrenko BDL UQCV 60 2 0 12 Jun 2023
Variational Imbalanced Regression: Fair Uncertainty Quantification via Probabilistic Smoothing Ziyan Wang Hao Wang UQCV 82 0 0 11 Jun 2023
Explaining Predictive Uncertainty with Information Theoretic Shapley Values David S. Watson Joshua O'Hara Niek Tax Richard Mudd Ido Guy TDI FAtt 68 24 0 09 Jun 2023
On the Joint Interaction of Models, Data, and Features Yiding Jiang Christina Baek J. Zico Kolter FedML 54 4 0 07 Jun 2023
ViDA: Homeostatic Visual Domain Adapter for Continual Test Time Adaptation Jiaming Liu Senqiao Yang Peidong Jia Renrui Zhang Ming Lu Yandong Guo Wei Xue Shanghang Zhang TTA OOD VLM 103 40 0 07 Jun 2023
Asymptotics of Bayesian Uncertainty Estimation in Random Features Regression You-Hyun Baek S. Berchuck Sayan Mukherjee 123 0 0 06 Jun 2023
Using Multiple Dermoscopic Photographs of One Lesion Improves Melanoma Classification via Deep Learning: A Prognostic Diagnostic Accuracy Study A. Hekler Roman C. Maron Sarah Haggenmuller Max Schmitt Christoph Wies ... Matthias Goebeler Bastian Schilling Jakob N. Kather E. Krieghoff-Henning T. Brinker 58 4 0 05 Jun 2023
Input-gradient space particle inference for neural network ensembles Trung Trinh Markus Heinonen Luigi Acerbi Samuel Kaski UQCV 75 4 0 05 Jun 2023
Uncertainty in Natural Language Processing: Sources, Quantification, and Applications Mengting Hu Zhen Zhang Shiwan Zhao Minlie Huang Bingzhe Wu BDL 103 39 0 05 Jun 2023
Sen2Pro: A Probabilistic Perspective to Sentence Embedding from Pre-trained Language Model Lingfeng Shen Haiyun Jiang Lemao Liu Shuming Shi 54 2 0 04 Jun 2023
A Data-Driven Measure of Relative Uncertainty for Misclassification Detection Eduardo Dadalto Camara Gomes Marco Romanelli Georg Pichler Pablo Piantanida UQCV 95 5 0 02 Jun 2023
Estimating Semantic Similarity between In-Domain and Out-of-Domain Samples Rhitabrat Pokharel Ameeta Agrawal OODD 74 2 0 01 Jun 2023
On the Limitations of Temperature Scaling for Distributions with Overlaps Muthuraman Chidambaram Rong Ge UQCV 91 4 0 01 Jun 2023
(Almost) Provable Error Bounds Under Distribution Shift via Disagreement Discrepancy Elan Rosenfeld Saurabh Garg UQCV 68 7 0 01 Jun 2023
ActiveAED: A Human in the Loop Improves Annotation Error Detection Leon Weber Barbara Plank 74 11 0 31 May 2023
A Study of Bayesian Neural Network Surrogates for Bayesian Optimization Y. Li Tim G. J. Rudner A. Wilson BDL 97 34 0 31 May 2023
Perception and Semantic Aware Regularization for Sequential Confidence Calibration Zhenghua Peng Yuanmao Luo Tianshui Chen Keke Xu Shuangping Huang AI4TS 83 2 0 31 May 2023
Trustworthy Sensor Fusion against Inaudible Command Attacks in Advanced Driver-Assistance System Jiwei Guan Lei Pan Chen Wang Shui Yu Longxiang Gao Xi Zheng AAML 58 4 0 30 May 2023
Beyond Confidence: Reliable Models Should Also Consider Atypicality Mert Yuksekgonul Linjun Zhang James Zou Carlos Guestrin 101 22 0 29 May 2023
Federated Conformal Predictors for Distributed Uncertainty Quantification Charles Lu Yaodong Yu Sai Praneeth Karimireddy Michael I. Jordan Ramesh Raskar FedML 118 24 0 27 May 2023
Characterizing Out-of-Distribution Error via Optimal Transport Yuzhe Lu Yilong Qin Runtian Zhai Andrew Shen Ketong Chen Zhenlin Wang Soheil Kolouri Simon Stepputtis Joseph Campbell Katia Sycara OODD 93 12 0 25 May 2023
How to Fix a Broken Confidence Estimator: Evaluating Post-hoc Methods for Selective Classification with Deep Neural Networks L. F. P. Cattelan Danilo Silva UQCV 119 6 0 24 May 2023
A Rigorous Link between Deep Ensembles and (Variational) Bayesian Methods Veit Wild Sahra Ghalebikesabi Dino Sejdinovic Jeremias Knoblauch BDL UQCV 98 16 0 24 May 2023
Just Ask for Calibration: Strategies for Eliciting Calibrated Confidence Scores from Language Models Fine-Tuned with Human Feedback Katherine Tian E. Mitchell Allan Zhou Archit Sharma Rafael Rafailov Huaxiu Yao Chelsea Finn Christopher D. Manning 152 355 0 24 May 2023
Uncertainty Quantification over Graph with Conformalized Graph Neural Networks Kexin Huang Ying Jin Emmanuel Candès J. Leskovec 262 63 0 23 May 2023
Improving Classifier Robustness through Active Generation of Pairwise Counterfactuals Ananth Balashankar Xuezhi Wang Yao Qin Ben Packer Nithum Thain Jilin Chen Ed H. Chi Alex Beutel 65 0 0 22 May 2023
Hystoc: Obtaining word confidences for fusion of end-to-end ASR systems Karel Beneš M. Kocour L. Burget 61 2 0 21 May 2023
When are ensembles really effective? Ryan Theisen Hyunsuk Kim Yaoqing Yang Liam Hodgkinson Michael W. Mahoney FedML UQCV 94 15 0 21 May 2023
Annealing Self-Distillation Rectification Improves Adversarial Training Yuehua Wu Hung-Jui Wang Shang-Tse Chen AAML 97 5 0 20 May 2023
Learning for Transductive Threshold Calibration in Open-World Recognition Qin Zhang Dongsheng An Tianjun Xiao Tong He Qingming Tang Ying Nian Wu Joseph Tighe Yifan Xing Stefano Soatto 83 0 0 19 May 2023
Semantic Anomaly Detection with Large Language Models Amine Elhafsi Rohan Sinha Christopher Agia Edward Schmerling I. Nesnas Marco Pavone 99 75 0 18 May 2023
Variational Classification Shehzaad Dhuliawala Mrinmaya Sachan Carl Allen BDL 58 7 0 17 May 2023
Logit-Based Ensemble Distribution Distillation for Robust Autoregressive Sequence Uncertainties Yassir Fathullah Guoxuan Xia Mark Gales UQCV 61 5 0 17 May 2023
A Probabilistic Transformation of Distance-Based Outliers David Muhr M. Affenzeller Josef Küng 57 12 0 16 May 2023
Towards unraveling calibration biases in medical image analysis María Agustina Ricci Lara Candelaria Mosquera Enzo Ferrante Rodrigo Echeveste 85 9 0 09 May 2023
A Unified Evaluation Framework for Novelty Detection and Accommodation in NLP with an Instantiation in Authorship Attribution Neeraj Varshney Himanshu Gupta Eric Robertson Bin Liu Chitta Baral 65 1 0 08 May 2023
Uncertainty Quantification in Machine Learning for Engineering Design and Health Prognostics: A Tutorial V. Nemani Luca Biggio Xun Huan Zhen Hu Olga Fink Anh Tran Yan Wang Xiaoge Zhang Chao Hu AI4CE 116 81 0 07 May 2023
A Survey on Out-of-Distribution Detection in NLP Hao Lang Yinhe Zheng Yixuan Li Jian Sun Feiling Huang Yongbin Li 91 25 0 05 May 2023
Inferential Moments of Uncertain Multivariable Systems Junheng Li 60 1 0 03 May 2023
Expectation Maximization Pseudo Labels Moucheng Xu Yukun Zhou Chen Jin M. Groot Daniel C. Alexander N. Oxtoby Yipeng Hu Joseph Jacob 123 3 0 02 May 2023
Great Models Think Alike: Improving Model Reliability via Inter-Model Latent Agreement Ailin Deng Miao Xiong Bryan Hooi 205 7 0 02 May 2023
Calibration Error Estimation Using Fuzzy Binning Geetanjali Bihani Julia Taylor Rayz 215 2 0 30 Apr 2023
QuantProb: Generalizing Probabilities along with Predictions for a Pre-trained Classifier Aditya Challa Snehanshu Saha S. Dhavala UQCV 74 2 0 25 Apr 2023
Efficient Uncertainty Estimation in Spiking Neural Networks via MC-dropout Tao Sun Bojian Yin S. Bohté BDL 81 5 0 20 Apr 2023
Learning Sample Difficulty from Pre-trained Models for Reliable Prediction Peng Cui Dan Zhang Zhijie Deng Yinpeng Dong Junyi Zhu 60 12 0 20 Apr 2023
SATA: Source Anchoring and Target Alignment Network for Continual Test Time Adaptation Goirik Chakrabarty Manogna Sreenivas Soma Biswas TTA 72 7 0 20 Apr 2023
Decoupled Training for Long-Tailed Classification With Stochastic Representations G. Nam Sunguk Jang Juho Lee OOD BDL OODD 66 14 0 19 Apr 2023
A Domain-Region Based Evaluation of ML Performance Robustness to Covariate Shift Firas Bayram Bestoun S. Ahmed OOD 55 4 0 18 Apr 2023
K-means Clustering Based Feature Consistency Alignment for Label-free Model Evaluation Shuyu Miao Lin Zheng Qingbin Liu and Hong Jin 77 6 0 17 Apr 2023
Approaching Test Time Augmentation in the Context of Uncertainty Calibration for Deep Neural Networks Pedro Conde T. Barros Rui L. Lopes C. Premebida U. J. Nunes UQCV 67 7 0 11 Apr 2023