Revisiting the Calibration of Modern Neural Networks

15 June 2021

Papers citing "Revisiting the Calibration of Modern Neural Networks"

50 / 254 papers shown

Title
When Does Metadata Conditioning (NOT) Work for Language Model Pre-Training? A Study with Context-Free Grammars Rei Higuchi Ryotaro Kawata Naoki Nishikawa Kazusato Oko Shoichiro Yamaguchi Sosuke Kobayashi Seiya Tokui K. Hayashi Daisuke Okanohara Taiji Suzuki AI4CE 35 0 0 24 Apr 2025
Aerial Image Classification in Scarce and Unconstrained Environments via Conformal Prediction Farhad Pourkamali-Anaraki 36 0 0 24 Apr 2025
On the calibration of Just-in-time Defect Prediction Xhulja Shahini Jone Bartel Klaus Pohl 21 0 0 16 Apr 2025
FLOSS: Free Lunch in Open-vocabulary Semantic Segmentation Yasser Benigmim Mohammad Fahes Tuan-Hung Vu Andrei Bursuc Raoul de Charette VLM 40 0 0 14 Apr 2025
Learning from Reference Answers: Versatile Language Model Alignment without Binary Human Preference Data Shuai Zhao Linchao Zhu Yi Yang 39 1 0 14 Apr 2025
High dimensional online calibration in polynomial time Binghui Peng 24 0 0 12 Apr 2025
Beyond Accuracy: What Matters in Designing Well-Behaved Models? Robin Hesse Doğukan Bağcı Bernt Schiele Simone Schaub-Meyer Stefan Roth VLM 62 0 0 21 Mar 2025
Exploring the Potential of Bilevel Optimization for Calibrating Neural Networks Gabriele Sanguin Arjun Pakrashi Marco Viola Francesco Rinaldi 58 0 0 17 Mar 2025
Conformal Prediction and Human Decision Making Jessica Hullman Yifan Wu Dawei Xie Ziyang Guo Andrew Gelman 42 0 0 12 Mar 2025
A Helping (Human) Hand in Kinematic Structure Estimation Adrian Pfisterer Xing Li Vito Mengers Oliver Brock 45 0 0 07 Mar 2025
An Efficient Plugin Method for Metric Optimization of Black-Box Models Siddartha Devic Nurendra Choudhary Anirudh Srinivasan Sahika Genc B. Kveton G. Hiranandani 39 0 0 03 Mar 2025
A Guide to Failure in Machine Learning: Reliability and Robustness from Foundations to Practice Eric Heim Oren Wright David Shriver OOD FaML 68 0 0 01 Mar 2025
Exploring the Impact of Temperature Scaling in Softmax for Classification and Adversarial Robustness Hao Xuan Bokai Yang Xingyu Li AAML 49 1 0 28 Feb 2025
Optimizing Estimators of Squared Calibration Errors in Classification Sebastian G. Gruber Francis Bach 77 1 0 24 Feb 2025
Interpretable Failure Detection with Human-Level Concepts Kien X. Nguyen Tang Li Xi Peng 53 0 0 07 Feb 2025
Rethinking Early Stopping: Refine, Then Calibrate Eugene Berta David Holzmüller Michael I. Jordan Francis Bach 67 0 0 31 Jan 2025
Pretraining with random noise for uncertainty calibration Jeonghwan Cheon Se-Bum Paik OnRL 43 0 0 23 Dec 2024
Distribution Shifts at Scale: Out-of-distribution Detection in Earth Observation Burak Ekim G. Tadesse Caleb Robinson G. Q. Hacheme Michael Schmitt Rahul Dodhia J. L. Ferres OODD 102 1 0 18 Dec 2024
SMARTCAL: An Approach to Self-Aware Tool-Use Evaluation and Calibration Yuanhao Shen Xiaodan Zhu L. Chen 87 3 0 11 Dec 2024
Enhancing Trust in Large Language Models with Uncertainty-Aware Fine-Tuning R. Krishnan Piyush Khanna Omesh Tickoo HILM 72 1 0 03 Dec 2024
Labels in Extremes: How Well Calibrated are Extreme Multi-label Classifiers? Nasib Ullah Erik Schultheis Jinbin Zhang Rohit Babbar 26 0 0 06 Nov 2024
Confidence Calibration of Classifiers with Many Classes Adrien LeCoz Stéphane Herbin Faouzi Adjed UQCV 37 1 0 05 Nov 2024
Energy-Aware Dynamic Neural Inference Marcello Bullo Seifallah Jardak P. Carnelli Deniz Gündüz 29 0 0 04 Nov 2024
Calibrating Deep Neural Network using Euclidean Distance Wenhao Liang Chang Dong L. Zheng Zhengyang Li W. Zhang Weitong Chen UQCV 21 2 0 23 Oct 2024
Consistency Calibration: Improving Uncertainty Calibration via Consistency among Perturbed Neighbors Linwei Tao Haolan Guo Minjing Dong Chang Xu UQCV AAML 15 2 0 16 Oct 2024
Feature Clipping for Uncertainty Calibration Linwei Tao Minjing Dong Chang Xu UQCV 23 2 0 16 Oct 2024
On Calibration of LLM-based Guard Models for Reliable Content Moderation Hongfu Liu Hengguan Huang Hao Wang Xiangming Gu Ye Wang 55 2 0 14 Oct 2024
Taming Overconfidence in LLMs: Reward Calibration in RLHF Jixuan Leng Chengsong Huang Banghua Zhu Jiaxin Huang 34 7 0 13 Oct 2024
Ranking over Regression for Bayesian Optimization and Molecule Selection Gary Tom Stanley Lo Samantha Corapi Alán Aspuru-Guzik Benjamín Sánchez-Lengeling BDL 41 0 0 11 Oct 2024
Calibrating Verbalized Probabilities for Large Language Models Cheng Wang Gyuri Szarvas Georges Balazs Pavel Danchenko P. Ernst 15 0 0 09 Oct 2024
Fill In The Gaps: Model Calibration and Generalization with Synthetic Data Yang Ba M. Mancenido Rong Pan SyDa 21 1 0 07 Oct 2024
Improving Predictor Reliability with Selective Recalibration Thomas P. Zollo Zhun Deng Jake C. Snell T. Pitassi Richard Zemel OOD 41 0 0 07 Oct 2024
Look Around and Find Out: OOD Detection with Relative Angles Berker Demirel Marco Fumero Francesco Locatello 29 0 0 06 Oct 2024
Impact of Regularization on Calibration and Robustness: from the Representation Space Perspective Jonghyun Park Juyeop Kim Jong-Seok Lee 23 1 0 05 Oct 2024
Understanding and Mitigating Miscalibration in Prompt Tuning for Vision-Language Models Shuoyuan Wang Yixuan Li Hongxin Wei VLM 51 2 0 03 Oct 2024
Toward a Holistic Evaluation of Robustness in CLIP Models Weijie Tu Weijian Deng Tom Gedeon VLM 38 5 0 02 Oct 2024
DOTA: Distributional Test-Time Adaptation of Vision-Language Models Zongbo Han Jialong Yang Junfan Li Qinghua Hu Qianli Xu Mike Zheng Shou Changqing Zhang TTA VLM 51 2 0 28 Sep 2024
Can Language Model Understand Word Semantics as A Chatbot? An Empirical Study of Language Model Internal External Mismatch Jinman Zhao Xueyan Zhang Xingyu Yue Weizhe Chen Zifan Qian Ruiyu Wang LRM 34 0 0 21 Sep 2024
A Likelihood Ratio-Based Approach to Segmenting Unknown Objects Nazir Nayal Youssef Shoeb Fatma Güney OODD 38 4 0 10 Sep 2024
Evaluating Posterior Probabilities: Decision Theory, Proper Scoring Rules, and Calibration Luciana Ferrer Daniel Ramos UQCV 27 4 0 05 Aug 2024
DECIDER: Leveraging Foundation Model Priors for Improved Model Failure Detection and Explanation Rakshith Subramanyam Kowshik Thopalli V. Narayanaswamy Jayaraman J.Thiagarajan 27 2 0 01 Aug 2024
Achieving Well-Informed Decision-Making in Drug Discovery: A Comprehensive Calibration Study using Neural Network-Based Structure-Activity Models Hannah Rosa Friesacher O. Engkvist Lewis H. Mervin Yves Moreau Adam Arany 39 0 0 19 Jul 2024
Uncertainty Calibration with Energy Based Instance-wise Scaling in the Wild Dataset Mijoo Kim Junseok Kwon UQCV 30 1 0 17 Jul 2024
CALICO: Confident Active Learning with Integrated Calibration L. S. Querol Hajime Nagahara Hideaki Hayashi 25 0 0 02 Jul 2024
VeriFlow: Modeling Distributions for Neural Network Verification Faried Abu Zaid Daniel Neider Mustafa Yalçıner 88 0 0 20 Jun 2024
Detecting Errors through Ensembling Prompts (DEEP): An End-to-End LLM Framework for Detecting Factual Errors Alex Chandler Devesh Surve Hui Su HILM UQCV 26 1 0 18 Jun 2024
Calibrating Where It Matters: Constrained Temperature Scaling Stephen McKenna Jacob Carse 23 0 0 17 Jun 2024
What Does Softmax Probability Tell Us about Classifiers Ranking Across Diverse Test Conditions? Weijie Tu Weijian Deng Liang Zheng Tom Gedeon 40 0 0 14 Jun 2024
Flexible Heteroscedastic Count Regression with Deep Double Poisson Networks Spencer Young P. Jenkins Lonchao Da Jeff Dotson Hua Wei UQCV BDL 44 2 0 13 Jun 2024
When is Multicalibration Post-Processing Necessary? Dutch Hansen Siddartha Devic Preetum Nakkiran Vatsal Sharan 43 4 0 10 Jun 2024