Why ReLU networks yield high-confidence predictions far away from the training data and how to mitigate the problem

13 December 2018

Matthias Hein

Maksym Andriushchenko

Julian Bitterwolf

OODD

ArXiv PDF HTML

Papers citing "Why ReLU networks yield high-confidence predictions far away from the training data and how to mitigate the problem"

50 / 349 papers shown

Title
Self-Supervised Anomaly Detection by Self-Distillation and Negative Sampling Nima Rafiee Rahil Gholamipoorfard Nikolas Adaloglou Simon Jaxy Julius Ramakers M. Kollmann OODD 22 8 0 17 Jan 2022
Spatial-Temporal-Fusion BNN: Variational Bayesian Feature Layer Shiye Lei Zhuozhuo Tu Leszek Rutkowski Feng Zhou Li Shen Fengxiang He Dacheng Tao BDL 23 2 0 12 Dec 2021
Hyperdimensional Feature Fusion for Out-Of-Distribution Detection Samuel Wilson Tobias Fischer Niko Sünderhauf Feras Dayoub OODD 35 16 0 10 Dec 2021
Provable Guarantees for Understanding Out-of-distribution Detection Peyman Morteza Yixuan Li OODD 35 86 0 01 Dec 2021
FROB: Few-shot ROBust Model for Classification and Out-of-Distribution Detection Nikolaos Dionelis Mehrdad Yaghoobi Sotirios A. Tsaftaris OODD 19 4 0 30 Nov 2021
ReAct: Out-of-distribution Detection With Rectified Activations Yiyou Sun Chuan Guo Yixuan Li OODD 43 456 0 24 Nov 2021
DICE: Leveraging Sparsification for Out-of-Distribution Detection Yiyou Sun Yixuan Li OODD 38 151 0 18 Nov 2021
To Trust or Not To Trust Prediction Scores for Membership Inference Attacks Dominik Hintersdorf Lukas Struppek Kristian Kersting 26 14 0 17 Nov 2021
Detecting Fake Points of Interest from Location Data Syed Raza Bashir Vojislav B. Mišić 14 0 0 11 Nov 2021
Mixtures of Laplace Approximations for Improved Post-Hoc Uncertainty in Deep Learning Runa Eschenhagen Erik A. Daxberger Philipp Hennig Agustinus Kristiadi UQCV BDL 30 22 0 05 Nov 2021
PnPOOD : Out-Of-Distribution Detection for Text Classification via Plug andPlay Data Augmentation Mrinal Rawat R. Hebbalaguppe L. Vig OODD 6 10 0 31 Oct 2021
A Unified Survey on Anomaly, Novelty, Open-Set, and Out-of-Distribution Detection: Solutions and Future Challenges Mohammadreza Salehi Hossein Mirzaei Dan Hendrycks Yixuan Li M. Rohban Mohammad Sabokrou OOD 38 191 0 26 Oct 2021
Graph Posterior Network: Bayesian Predictive Uncertainty for Node Classification Maximilian Stadler Bertrand Charpentier Simon Geisler Daniel Zügner Stephan Günnemann UQCV BDL 41 81 0 26 Oct 2021
Periodic Activation Functions Induce Stationarity Lassi Meronen Martin Trapp Arno Solin BDL 17 20 0 26 Oct 2021
Generalized Out-of-Distribution Detection: A Survey Jingkang Yang Kaiyang Zhou Yixuan Li Ziwei Liu 188 879 0 21 Oct 2021
Meta Learning Low Rank Covariance Factors for Energy-Based Deterministic Uncertainty Jeffrey Willette Haebeom Lee Juho Lee Sung Ju Hwang OODD OOD 41 1 0 12 Oct 2021
Prior and Posterior Networks: A Survey on Evidential Deep Learning Methods For Uncertainty Estimation Dennis Ulmer Christian Hardmeier J. Frellsen BDL UQCV UD EDL PER 48 48 0 06 Oct 2021
Out-of-Distribution Detection for Medical Applications: Guidelines for Practical Evaluation Karina Zadorozhny P. Thoral Paul Elbers Giovanni Cina OODD OOD 27 12 0 30 Sep 2021
Activation Functions in Deep Learning: A Comprehensive Survey and Benchmark S. Dubey S. Singh B. B. Chaudhuri 41 643 0 29 Sep 2021
$f$ -Cal: Calibrated aleatoric uncertainty estimation from neural networks for robot perception Dhaivat Bhatt Kaustubh Mani Dishank Bansal Krishna Murthy Jatavallabhula Hanju Lee Liam Paull UQCV 23 5 0 28 Sep 2021
Improving Uncertainty of Deep Learning-based Object Classification on Radar Spectra using Label Smoothing Kanil Patel William H. Beluch K. Rambach Michael Pfeiffer B. Yang UQCV 38 9 0 27 Sep 2021
A novel network training approach for open set image recognition Md Tahmid Hossaina S. Teng Guojun Lu Ferdous Sohel 26 0 0 27 Sep 2021
A Physics inspired Functional Operator for Model Uncertainty Quantification in the RKHS Rishabh Singh José C. Príncipe 17 4 0 22 Sep 2021
SoK: Machine Learning Governance Varun Chandrasekaran Hengrui Jia Anvith Thudi Adelin Travers Mohammad Yaghini Nicolas Papernot 38 16 0 20 Sep 2021
Efficient Action Recognition Using Confidence Distillation Shervin Manzuri Shalmani Fei Chiang Ronghuo Zheng 27 6 0 05 Sep 2021
Reiterative Domain Aware Multi-Target Adaptation Sudipan Saha Shan Zhao Nasrullah Sheikh Xiao Xiang Zhu 24 1 0 26 Aug 2021
Influence Selection for Active Learning Zhuoming Liu Hao Ding Huaping Zhong Weijia Li Jifeng Dai Conghui He TDI 24 92 0 20 Aug 2021
CODEs: Chamfer Out-of-Distribution Examples against Overconfidence Issue Keke Tang Dingruibo Miao Weilong Peng Jianpeng Wu Yawen Shi Zhaoquan Gu Zhihong Tian Wenping Wang OODD 145 30 0 13 Aug 2021
Triggering Failures: Out-Of-Distribution detection by learning from local adversarial attacks in Semantic Segmentation Victor Besnier Andrei Bursuc David Picard Alexandre Briot UQCV 24 48 0 03 Aug 2021
Robust Semantic Segmentation with Superpixel-Mix Gianni Franchi Nacim Belkhir Mai Lan Ha Yufei Hu Andrei Bursuc V. Blanz Angela Yao UQCV 36 22 0 02 Aug 2021
Energy-Based Open-World Uncertainty Modeling for Confidence Calibration Yezhen Wang Bo-wen Li Tong Che Kaiyang Zhou Ziwei Liu Dongsheng Li UQCV 22 47 0 27 Jul 2021
How to Certify Machine Learning Based Safety-critical Systems? A Systematic Literature Review Florian Tambon Gabriel Laberge Le An Amin Nikanjam Paulina Stevia Nouwou Mindom Y. Pequignot Foutse Khomh G. Antoniol E. Merlo François Laviolette 37 66 0 26 Jul 2021
Responsible and Regulatory Conform Machine Learning for Medicine: A Survey of Challenges and Solutions Eike Petersen Yannik Potdevin Esfandiar Mohammadi Stephan Zidowitz Sabrina Breyer ... Sandra Henn Ludwig Pechmann M. Leucker P. Rostalski Christian Herzog FaML AILaw OOD 38 21 0 20 Jul 2021
Transductive image segmentation: Self-training and effect of uncertainty estimation Konstantinos Kamnitsas S. Winzeck E. Kornaropoulos Daniel Whitehouse Cameron Englman ... David Menon Daniel Rueckert T. Das Virginia Newcombe Ben Glocker MedIm 13 1 0 19 Jul 2021
Mediated Uncoupled Learning: Learning Functions without Direct Input-output Correspondences Ikko Yamane Junya Honda Florian Yger Masashi Sugiyama SSL FedML OOD 21 1 0 16 Jul 2021
Uncertainty-Aware Reliable Text Classification Yibo Hu Latifur Khan EDL UQCV 33 33 0 15 Jul 2021
What classifiers know what they don't? Mohamed Ishmael Belghazi David Lopez-Paz 25 6 0 13 Jul 2021
A Survey of Uncertainty in Deep Neural Networks J. Gawlikowski Cedrique Rovile Njieutcheu Tassi Mohsin Ali Jongseo Lee Matthias Humt ... R. Roscher Muhammad Shahzad Wen Yang R. Bamler Xiaoxiang Zhu BDL UQCV OOD 59 1,111 0 07 Jul 2021
On Out-of-distribution Detection with Energy-based Models Sven Elflein Bertrand Charpentier Daniel Zügner Stephan Günnemann OODD 33 18 0 03 Jul 2021
Valid prediction intervals for regression problems Nicolas Dewolf B. De Baets Willem Waegeman 13 44 0 01 Jul 2021
Deep Ensembling with No Overhead for either Training or Testing: The All-Round Blessings of Dynamic Sparsity Shiwei Liu Tianlong Chen Zahra Atashgahi Xiaohan Chen Ghada Sokar Elena Mocanu Mykola Pechenizkiy Zhangyang Wang Decebal Constantin Mocanu OOD 31 49 0 28 Jun 2021
A Knowledge-Grounded Dialog System Based on Pre-Trained Language Models Weijie Zhang Jiaoxuan Chen Haipang Wu Sanhui Wan Gongfeng Li 25 4 0 28 Jun 2021
Graceful Degradation and Related Fields J. Dymond 31 4 0 21 Jun 2021
Open-set Label Noise Can Improve Robustness Against Inherent Label Noise Hongxin Wei Lue Tao Renchunzi Xie Bo An NoLa 27 83 0 21 Jun 2021
Less is More: Feature Selection for Adversarial Robustness with Compressive Counter-Adversarial Attacks Emre Ozfatura Muhammad Zaid Hameed Kerem Ozfatura Deniz Gunduz AAML 8 1 0 18 Jun 2021
Being a Bit Frequentist Improves Bayesian Neural Networks Agustinus Kristiadi Matthias Hein Philipp Hennig BDL UQCV 23 15 0 18 Jun 2021
Understanding Softmax Confidence and Uncertainty Tim Pearce Alexandra Brintrup Jun Zhu UQCV 19 87 0 09 Jun 2021
Taxonomy of Machine Learning Safety: A Survey and Primer Sina Mohseni Haotao Wang Zhiding Yu Chaowei Xiao Zhangyang Wang J. Yadawa 21 31 0 09 Jun 2021
Provably Robust Detection of Out-of-distribution Data (almost) for free Alexander Meinke Julian Bitterwolf Matthias Hein OODD 33 22 0 08 Jun 2021
Shifting Transformation Learning for Out-of-Distribution Detection Sina Mohseni Arash Vahdat J. Yadawa OODD 30 7 0 07 Jun 2021