Papers
Communities
Events
Blog
Pricing
Search
Open menu
Home
Papers
2106.04015
Cited By
Uncertainty Baselines: Benchmarks for Uncertainty & Robustness in Deep Learning
7 June 2021
Zachary Nado
Neil Band
Mark Collier
Josip Djolonga
Michael W. Dusenberry
Sebastian Farquhar
Qixuan Feng
Angelos Filos
Marton Havasi
Rodolphe Jenatton
Ghassen Jerfel
J. Liu
Zelda E. Mariet
Jeremy Nixon
Shreyas Padhy
Jie Jessie Ren
Tim G. J. Rudner
Faris Sbahi
Yeming Wen
F. Wenzel
Kevin Patrick Murphy
D. Sculley
Balaji Lakshminarayanan
Jasper Snoek
Y. Gal
Dustin Tran
UQCV
ELM
Re-assign community
ArXiv
PDF
HTML
Papers citing
"Uncertainty Baselines: Benchmarks for Uncertainty & Robustness in Deep Learning"
50 / 71 papers shown
Title
Lightning UQ Box: A Comprehensive Framework for Uncertainty Quantification in Deep Learning
Nils Lehmann
Jakob Gawlikowski
Adam J. Stewart
Vytautas Jancauskas
Stefan Depeweg
Eric T. Nalisnick
N. Gottschling
42
0
0
04 Oct 2024
Unveiling AI's Blind Spots: An Oracle for In-Domain, Out-of-Domain, and Adversarial Errors
Shuangpeng Han
Mengmi Zhang
137
0
0
03 Oct 2024
End-to-End Conformal Calibration for Optimization Under Uncertainty
Christopher Yeh
Nicolas H. Christianson
Alan Wu
Adam Wierman
Yisong Yue
28
3
0
30 Sep 2024
LUMA: A Benchmark Dataset for Learning from Uncertain and Multimodal Data
Grigor Bezirganyan
Sana Sellami
Laure Berti-Équille
Sébastien Fournier
37
3
0
14 Jun 2024
Online Safety Analysis for LLMs: a Benchmark, an Assessment, and a Path Forward
Xuan Xie
Jiayang Song
Zhehua Zhou
Yuheng Huang
Da Song
Lei Ma
OffRL
53
6
0
12 Apr 2024
Density-Regression: Efficient and Distance-Aware Deep Regressor for Uncertainty Estimation under Distribution Shifts
H. Bui
Anqi Liu
OOD
BDL
UQCV
46
4
0
07 Mar 2024
Benchmarking Uncertainty Disentanglement: Specialized Uncertainties for Specialized Tasks
Bálint Mucsányi
Michael Kirchhof
Seong Joon Oh
UQCV
BDL
OODD
431
20
1
29 Feb 2024
Uncertainty-Based Extensible Codebook for Discrete Federated Learning in Heterogeneous Data Silos
Tianyi Zhang
Yu Cao
Dianbo Liu
FedML
21
0
0
29 Feb 2024
Stochastic Subnetwork Annealing: A Regularization Technique for Fine Tuning Pruned Subnetworks
Tim Whitaker
Darrell Whitley
33
0
0
16 Jan 2024
Function-Space Regularization in Neural Networks: A Probabilistic Perspective
Tim G. J. Rudner
Sanyam Kapoor
Shikai Qiu
A. Wilson
37
12
0
28 Dec 2023
Implicit Variational Inference for High-Dimensional Posteriors
Anshuk Uppal
Kristoffer Stensbo-Smidt
Wouter Boomsma
J. Frellsen
BDL
26
1
0
10 Oct 2023
Pi-DUAL: Using Privileged Information to Distinguish Clean from Noisy Labels
Ke Wang
Guillermo Ortiz-Jimenez
Rodolphe Jenatton
Mark Collier
Efi Kokiopoulou
Pascal Frossard
AAML
37
2
0
10 Oct 2023
Unified Uncertainty Calibration
Kamalika Chaudhuri
David Lopez-Paz
24
0
0
02 Oct 2023
Benchmarking Encoder-Decoder Architectures for Biplanar X-ray to 3D Shape Reconstruction
M. Shakya
Bishesh Khanal
27
1
0
24 Sep 2023
Uncertainty Quantification for Image-based Traffic Prediction across Cities
Alexander Timans
Nina Wiedemann
Nishant Kumar
Ye Hong
Martin Raubal
18
1
0
11 Aug 2023
Comparing the quality of neural network uncertainty estimates for classification problems
Daniel Ries
Joshua J. Michalenko
T. Ganter
R. Baiyasi
Jason Adams
UQCV
BDL
29
1
0
11 Aug 2023
Capsa: A Unified Framework for Quantifying Risk in Deep Neural Networks
Sadhana Lolla
I. Elistratov
Alejandro Perez
Elaheh Ahmadi
Daniela Rus
Alexander Amini
UQCV
22
0
0
01 Aug 2023
Learning Expressive Priors for Generalization and Uncertainty Estimation in Neural Networks
Dominik Schnaus
Jongseok Lee
Daniel Cremers
Rudolph Triebel
UQCV
BDL
38
1
0
15 Jul 2023
URL: A Representation Learning Benchmark for Transferable Uncertainty Estimates
Michael Kirchhof
Bálint Mucsányi
Seong Joon Oh
Enkelejda Kasneci
UQCV
374
13
0
07 Jul 2023
Beyond Deep Ensembles: A Large-Scale Evaluation of Bayesian Deep Learning under Distribution Shift
Florian Seligmann
P. Becker
Michael Volpp
Gerhard Neumann
UQCV
21
14
0
21 Jun 2023
MUBen: Benchmarking the Uncertainty of Molecular Representation Models
Yinghao Li
Lingkai Kong
Yuanqi Du
Yue Yu
Yuchen Zhuang
Wenhao Mu
Chao Zhang
32
9
0
14 Jun 2023
Measuring and Mitigating Local Instability in Deep Neural Networks
Arghya Datta
Subhrangshu Nandi
Jingcheng Xu
Greg Ver Steeg
He Xie
Anoop Kumar
Aram Galstyan
20
3
0
18 May 2023
On Uncertainty Calibration and Selective Generation in Probabilistic Neural Summarization: A Benchmark Study
Polina Zablotskaia
Du Phan
Joshua Maynez
Shashi Narayan
Jie Jessie Ren
J. Liu
UQLM
UQCV
25
18
0
17 Apr 2023
When does Privileged Information Explain Away Label Noise?
Guillermo Ortiz-Jiménez
Mark Collier
Anant Nawalgaria
Alexander DÁmour
Jesse Berent
Rodolphe Jenatton
E. Kokiopoulou
NoLa
167
7
0
03 Mar 2023
What Can We Learn From The Selective Prediction And Uncertainty Estimation Performance Of 523 Imagenet Classifiers
Ido Galil
Mohammed Dabbah
Ran El-Yaniv
UQCV
35
24
0
23 Feb 2023
Density-Softmax: Efficient Test-time Model for Uncertainty Estimation and Robustness under Distribution Shifts
H. Bui
Anqi Liu
OOD
UQCV
23
6
0
13 Feb 2023
A Simple Zero-shot Prompt Weighting Technique to Improve Prompt Ensembling in Text-Image Models
J. Allingham
Jie Jessie Ren
Michael W. Dusenberry
Xiuye Gu
Huayu Chen
Dustin Tran
J. Liu
Balaji Lakshminarayanan
LLMAG
VLM
35
33
0
13 Feb 2023
Fortuna: A Library for Uncertainty Quantification in Deep Learning
Gianluca Detommaso
Alberto Gasparin
Michele Donini
Matthias Seeger
A. Wilson
Cédric Archambeau
UQCV
BDL
36
14
0
08 Feb 2023
Massively Scaling Heteroscedastic Classifiers
Mark Collier
Rodolphe Jenatton
Basil Mustafa
N. Houlsby
Jesse Berent
E. Kokiopoulou
26
8
0
30 Jan 2023
On the role of Model Uncertainties in Bayesian Optimization
Jonathan Foldager
Mikkel Jordahn
Lars Kai Hansen
Michael Riis Andersen
19
4
0
14 Jan 2023
How Does Traffic Environment Quantitatively Affect the Autonomous Driving Prediction?
Wenbo Shao
Yan Xu
Jun Yu Li
Chen Lv
Weida Wang
Hong Wang
29
9
0
11 Jan 2023
Benchmark for Uncertainty & Robustness in Self-Supervised Learning
H. Bui
Iliana Maifeld-Carucci
OOD
19
1
0
23 Dec 2022
Task Bias in Vision-Language Models
Sachit Menon
I. Chandratreya
Carl Vondrick
VLM
SSL
22
6
0
08 Dec 2022
Calibration and generalizability of probabilistic models on low-data chemical datasets with DIONYSUS
Gary Tom
Riley J. Hickman
Aniket N. Zinzuwadia
A. Mohajeri
Benjamín Sánchez-Lengeling
A. Aspuru‐Guzik
21
16
0
03 Dec 2022
MP-GELU Bayesian Neural Networks: Moment Propagation by GELU Nonlinearity
Yuki Hirayama
Sinya Takamaeda-Yamazaki
BDL
24
0
0
24 Nov 2022
Benchmarking Bayesian Deep Learning on Diabetic Retinopathy Detection Tasks
Neil Band
Tim G. J. Rudner
Qixuan Feng
Angelos Filos
Zachary Nado
Michael W. Dusenberry
Ghassen Jerfel
Dustin Tran
Y. Gal
OOD
UQCV
BDL
29
50
0
23 Nov 2022
Layer-Stack Temperature Scaling
Amr Khalifa
Michael C. Mozer
Hanie Sedghi
Behnam Neyshabur
Ibrahim M. Alabdulmohsin
78
2
0
18 Nov 2022
Do Bayesian Neural Networks Need To Be Fully Stochastic?
Mrinank Sharma
Sebastian Farquhar
Eric T. Nalisnick
Tom Rainforth
BDL
23
52
0
11 Nov 2022
Data Models for Dataset Drift Controls in Machine Learning With Optical Images
Luis Oala
Marco Aversa
Gabriel Nobis
Kurt Willis
Yoan Neuenschwander
...
E. Pomarico
Wojciech Samek
Roderick Murray-Smith
Christoph Clausen
B. Sanguinetti
28
5
0
04 Nov 2022
GFlowOut: Dropout with Generative Flow Networks
Dianbo Liu
Moksh Jain
Bonaventure F. P. Dossou
Qianli Shen
Salem Lahlou
...
Dinghuai Zhang
N. Hassen
Xu Ji
Kenji Kawaguchi
Yoshua Bengio
UQCV
BDL
OOD
33
20
0
24 Oct 2022
Window-Based Distribution Shift Detection for Deep Neural Networks
Guy Bar-Shalom
Yonatan Geifman
Ran El-Yaniv
20
3
0
19 Oct 2022
Ambiguous Images With Human Judgments for Robust Visual Event Classification
Kate Sanders
Reno Kriz
Anqi Liu
Benjamin Van Durme
65
12
0
06 Oct 2022
A Comprehensive Review of Digital Twin -- Part 2: Roles of Uncertainty Quantification and Optimization, a Battery Digital Twin, and Perspectives
Adam Thelen
Xiaoge Zhang
Olga Fink
Yan Lu
Sayan Ghosh
B. Youn
Michael D. Todd
S. Mahadevan
Chao Hu
Zhen Hu
25
86
0
27 Aug 2022
Success of Uncertainty-Aware Deep Models Depends on Data Manifold Geometry
M. Penrod
Harrison Termotto
Varshini Reddy
Jiayu Yao
Finale Doshi-Velez
Weiwei Pan
AAML
OOD
40
1
0
02 Aug 2022
Towards Clear Expectations for Uncertainty Estimation
Victor Bouvier
Simona Maggio
A. Abraham
L. Dreyfus-Schmidt
UQCV
28
1
0
27 Jul 2022
Plex: Towards Reliability using Pretrained Large Model Extensions
Dustin Tran
J. Liu
Michael W. Dusenberry
Du Phan
Mark Collier
...
D. Sculley
Y. Gal
Zoubin Ghahramani
Jasper Snoek
Balaji Lakshminarayanan
VLM
39
124
0
15 Jul 2022
Single Model Uncertainty Estimation via Stochastic Data Centering
Jayaraman J. Thiagarajan
Rushil Anirudh
V. Narayanaswamy
P. Bremer
UQCV
OOD
27
26
0
14 Jul 2022
Is one annotation enough? A data-centric image classification benchmark for noisy and ambiguous label estimation
Lars Schmarje
Vasco Grossmann
Claudius Zelenka
S. Dippel
R. Kiko
...
M. Pastell
J. Stracke
A. Valros
N. Volkmann
Reinahrd Koch
43
34
0
13 Jul 2022
Shifts 2.0: Extending The Dataset of Real Distributional Shifts
A. Malinin
A. Athanasopoulos
M. Barakovic
Meritxell Bach Cuadra
Mark J. F. Gales
...
Francesco La Rosa
Eli Sivena
V. Tsarsitalidis
Efi Tsompopoulou
E. Volf
OOD
30
28
0
30 Jun 2022
Ensembling over Classifiers: a Bias-Variance Perspective
Neha Gupta
Jamie Smith
Ben Adlam
Zelda E. Mariet
FedML
UQCV
FaML
13
6
0
21 Jun 2022
1
2
Next