Beyond Confidence: Reliable Models Should Also Consider Atypicality

29 May 2023

Mert Yuksekgonul

Papers citing "Beyond Confidence: Reliable Models Should Also Consider Atypicality"

26 / 26 papers shown

Title
Aerial Image Classification in Scarce and Unconstrained Environments via Conformal Prediction Farhad Pourkamali-Anaraki 166 0 0 24 Apr 2025
Understanding and Mitigating Miscalibration in Prompt Tuning for Vision-Language Models Shuoyuan Wang Yixuan Li Hongxin Wei VLM 95 2 0 03 Oct 2024
Targeted synthetic data generation for tabular data via hardness characterization Tommaso Ferracci Leonie Goldmann Anton Hinel Francesco Sanna Passino 182 0 0 01 Oct 2024
Demystifying Prompts in Language Models via Perplexity Estimation Hila Gonen Srini Iyer Terra Blevins Noah A. Smith Luke Zettlemoyer LRM 113 210 0 08 Dec 2022
Beyond calibration: estimating the grouping loss of modern neural networks Alexandre Perez-Lebel Marine Le Morvan Gaël Varoquaux UQCV 39 27 0 28 Oct 2022
Sample-dependent Adaptive Temperature Scaling for Improved Calibration Thomas Joy Francesco Pinto Ser-Nam Lim Philip Torr P. Dokania UQCV 50 34 0 13 Jul 2022
Disparities in Dermatology AI Performance on a Diverse, Curated Clinical Image Set Roxana Daneshjou Kailas Vodrahalli R. Novoa Melissa Jenkins Weixin Liang ... Rachna Sahasrabudhe Johan A. C. Allerup Utako Okata-Karigane James Zou A. Chiou 93 229 0 15 Mar 2022
Theoretical characterization of uncertainty in high-dimensional linear classification Lucas Clarté Bruno Loureiro Florent Krzakala Lenka Zdeborová 58 20 0 07 Feb 2022
Datasets: A Community Library for Natural Language Processing Quentin Lhoest Albert Villanova del Moral Yacine Jernite A. Thakur Patrick von Platen ... Thibault Goehringer Victor Mustar François Lagunas Alexander M. Rush Thomas Wolf 171 605 0 07 Sep 2021
A Gentle Introduction to Conformal Prediction and Distribution-Free Uncertainty Quantification Anastasios Nikolas Angelopoulos Stephen Bates OOD 164 615 0 15 Jul 2021
Understanding Softmax Confidence and Uncertainty Tim Pearce Alexandra Brintrup Jun Zhu UQCV 106 92 0 09 Jun 2021
Fairness in Machine Learning L. Oneto Silvia Chiappa FaML 277 494 0 31 Dec 2020
Uncertainty Sets for Image Classifiers using Conformal Prediction Anastasios Nikolas Angelopoulos Stephen Bates Jitendra Malik Michael I. Jordan UQCV 170 332 0 29 Sep 2020
Simple and Principled Uncertainty Estimation with Deterministic Deep Learning via Distance Awareness Jeremiah Zhe Liu Zi Lin Shreyas Padhy Dustin Tran Tania Bedrax-Weiss Balaji Lakshminarayanan UQCV BDL 142 446 0 17 Jun 2020
Classification with Valid and Adaptive Coverage Yaniv Romano Matteo Sesia Emmanuel J. Candès 277 323 0 03 Jun 2020
Calibrating Deep Neural Networks using Focal Loss Jishnu Mukhoti Viveka Kulharia Amartya Sanyal Stuart Golodetz Philip Torr P. Dokania UQCV 81 459 0 21 Feb 2020
Your Classifier is Secretly an Energy Based Model and You Should Treat it Like One Will Grathwohl Kuan-Chieh Wang J. Jacobsen David Duvenaud Mohammad Norouzi Kevin Swersky VLM 76 542 0 06 Dec 2019
With Malice Towards None: Assessing Uncertainty via Equalized Coverage Yaniv Romano Rina Foygel Barber C. Sabatti Emmanuel J. Candès UQCV 127 73 0 15 Aug 2019
RoBERTa: A Robustly Optimized BERT Pretraining Approach Yinhan Liu Myle Ott Naman Goyal Jingfei Du Mandar Joshi Danqi Chen Omer Levy M. Lewis Luke Zettlemoyer Veselin Stoyanov AIMat 507 24,351 0 26 Jul 2019
Learning Imbalanced Datasets with Label-Distribution-Aware Margin Loss Kaidi Cao Colin Wei Adrien Gaidon Nikos Arechiga Tengyu Ma 107 1,594 0 18 Jun 2019
Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shift Yaniv Ovadia Emily Fertig Jie Jessie Ren Zachary Nado D. Sculley Sebastian Nowozin Joshua V. Dillon Balaji Lakshminarayanan Jasper Snoek UQCV 151 1,688 0 06 Jun 2019
Deep Anomaly Detection with Outlier Exposure Dan Hendrycks Mantas Mazeika Thomas G. Dietterich OODD 157 1,475 0 11 Dec 2018
To Trust Or Not To Trust A Classifier Heinrich Jiang Been Kim Melody Y. Guan Maya R. Gupta UQCV 146 471 0 30 May 2018
A Broad-Coverage Challenge Corpus for Sentence Understanding through Inference Adina Williams Nikita Nangia Samuel R. Bowman 483 4,473 0 18 Apr 2017
Wide Residual Networks Sergey Zagoruyko N. Komodakis 304 7,971 0 23 May 2016
A tutorial on conformal prediction Glenn Shafer V. Vovk 359 1,135 0 21 Jun 2007