An Exploratory Study of AI System Risk Assessment from the Lens of Data Distribution and Uncertainty

13 December 2022

Papers citing "An Exploratory Study of AI System Risk Assessment from the Lens of Data Distribution and Uncertainty"

50 / 67 papers shown

Title
AugLy: Data Augmentations for Robustness Zoe Papakipos Joanna Bitton AAML 46 53 0 17 Jan 2022
Provable Guarantees for Understanding Out-of-distribution Detection Peyman Morteza Yixuan Li OODD 83 90 0 01 Dec 2021
ByteTrack: Multi-Object Tracking by Associating Every Detection Box Yifu Zhang Pei Sun Yi Jiang Dongdong Yu Fucheng Weng Zehuan Yuan Ping Luo Wenyu Liu Xinggang Wang VOT 146 1,349 0 13 Oct 2021
YOLOX: Exceeding YOLO Series in 2021 Zheng Ge Songtao Liu Feng Wang Zeming Li Jian Sun ObjD 112 4,025 0 18 Jul 2021
A Survey of Uncertainty in Deep Neural Networks J. Gawlikowski Cedrique Rovile Njieutcheu Tassi Mohsin Ali Jongseo Lee Matthias Humt ... R. Roscher Muhammad Shahzad Wen Yang R. Bamler Xiaoxiang Zhu BDL UQCV OOD 167 1,136 0 07 Jul 2021
WILDS: A Benchmark of in-the-Wild Distribution Shifts Pang Wei Koh Shiori Sagawa Henrik Marklund Sang Michael Xie Marvin Zhang ... A. Kundaje Emma Pierson Sergey Levine Chelsea Finn Percy Liang OOD 146 1,418 0 14 Dec 2020
Know Your Limits: Uncertainty Estimation with ReLU Classifiers Fails at Reliable OOD Detection Dennis Ulmer Giovanni Cina OODD 73 32 0 09 Dec 2020
A Review of Uncertainty Quantification in Deep Learning: Techniques, Applications and Challenges Moloud Abdar Farhad Pourpanah Sadiq Hussain Dana Rezazadegan Li Liu ... Xiaochun Cao Abbas Khosravi U. Acharya V. Makarenkov S. Nahavandi BDL UQCV 193 1,893 0 12 Nov 2020
Rethinking the competition between detection and ReID in Multi-Object Tracking Chao Liang Zhipeng Zhang Xue Zhou Bing Li Xiyong Ye Jianxiao Zou VOT 46 281 0 23 Oct 2020
The NVIDIA PilotNet Experiments Mariusz Bojarski Chenyi Chen Joyjit Daw Alperen Deugirmenci Joya A. Deri ... Neha Tadimeti Jesper E. van Engelen Haiguang Wen Eric Yang Zongyi Yang 9 25 0 17 Oct 2020
Energy-based Out-of-distribution Detection Weitang Liu Xiaoyun Wang John Douglas Owens Yixuan Li OODD 211 1,332 0 08 Oct 2020
MultiWOZ 2.2 : A Dialogue Dataset with Additional Annotation Corrections and State Tracking Baselines Xiaoxue Zang Abhinav Rastogi Srinivas Sunkara Raghav Gupta Jianguo Zhang Jindong Chen 56 276 0 10 Jul 2020
wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations Alexei Baevski Henry Zhou Abdel-rahman Mohamed Michael Auli SSL 179 5,734 0 20 Jun 2020
Towards Characterizing Adversarial Defects of Deep Learning Software from the Lens of Uncertainty Xiyue Zhang Xiaofei Xie Lei Ma Xiaoning Du Q. Hu Yang Liu Jianjun Zhao Meng Sun AAML 35 76 0 24 Apr 2020
Generalized ODIN: Detecting Out-of-distribution Image without Learning from Out-of-distribution Data Yen-Chang Hsu Yilin Shen Hongxia Jin Z. Kira OODD 54 567 0 26 Feb 2020
ConvLab-2: An Open-Source Toolkit for Building, Evaluating, and Diagnosing Dialogue Systems Qi Zhu Zheng Zhang Yan Fang Xiang Li Ryuichi Takanobu Jinchao Li Baolin Peng Jianfeng Gao Xiaoyan Zhu Minlie Huang 63 105 0 12 Feb 2020
Common Voice: A Massively-Multilingual Speech Corpus Rosana Ardila Megan Branson Kelly Davis Michael Henretty M. Kohler Josh Meyer Reuben Morais Lindsay Saunders Francis M. Tyers Gregor Weber VLM 61 1,571 0 13 Dec 2019
Self-Driving Car Steering Angle Prediction Based on Image Recognition Shuyang Du Haoli Guo Andrew Simpson LLMSV 37 86 0 11 Dec 2019
End-to-end ASR: from Supervised to Semi-Supervised Learning with Modern Architectures Gabriel Synnaeve Qiantong Xu Jacob Kahn Tatiana Likhomanenko Edouard Grave Vineel Pratap Anuroop Sriram Vitaliy Liptchinsky R. Collobert SSL AI4TS 95 245 0 19 Nov 2019
Self-Training for End-to-End Speech Recognition Jacob Kahn Ann Lee Awni Y. Hannun SSL 49 234 0 19 Sep 2019
Guided Dialog Policy Learning: Reward Estimation for Multi-Domain Task-Oriented Dialog Ryuichi Takanobu Hanlin Zhu Minlie Huang 68 90 0 28 Aug 2019
Density estimation in representation space to predict model uncertainty Tiago Ramalho M. Corbalan UQCV BDL 23 38 0 20 Aug 2019
Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shift Yaniv Ovadia Emily Fertig Jie Jessie Ren Zachary Nado D. Sculley Sebastian Nowozin Joshua V. Dillon Balaji Lakshminarayanan Jasper Snoek UQCV 137 1,677 0 06 Jun 2019
Evaluating Scalable Bayesian Deep Learning Methods for Robust Computer Vision Fredrik K. Gustafsson Martin Danelljan Thomas B. Schon OOD UQCV BDL 59 298 0 04 Jun 2019
Test Selection for Deep Learning Systems Wei Ma Mike Papadakis Anestis Tsakmalis Maxime Cordy Yves Le Traon OOD 41 92 0 30 Apr 2019
ConvLab: Multi-Domain End-to-End Dialog System Platform Sungjin Lee Qi Zhu Ryuichi Takanobu Xiang Li Yaoqin Zhang ... Jinchao Li Baolin Peng Xiujun Li Minlie Huang Jianfeng Gao VLM 70 110 0 18 Apr 2019
Objects as Points Xingyi Zhou Dequan Wang Philipp Krahenbuhl 3DPC 91 3,240 0 16 Apr 2019
Benchmarking Neural Network Robustness to Common Corruptions and Perturbations Dan Hendrycks Thomas G. Dietterich OOD VLM 107 3,399 0 28 Mar 2019
Repairing without Retraining: Avoiding Disparate Impact with Counterfactual Distributions Hao Wang Berk Ustun Flavio du Pin Calmon FaML 62 85 0 29 Jan 2019
SelectiveNet: A Deep Neural Network with an Integrated Reject Option Yonatan Geifman Ran El-Yaniv CVBM OOD 112 309 0 26 Jan 2019
DeepBillboard: Systematic Physical-World Testing of Autonomous Driving Systems Husheng Zhou Wei Li Yuankun Zhu Yuqun Zhang Bei Yu Lingming Zhang Cong Liu AAML 53 176 0 27 Dec 2018
Deep Anomaly Detection with Outlier Exposure Dan Hendrycks Mantas Mazeika Thomas G. Dietterich OODD 114 1,468 0 11 Dec 2018
Learning to Steer by Mimicking Features from Heterogeneous Auxiliary Networks Yuenan Hou Zheng Ma Slobodan Mitrovic Chen Change Loy 54 64 0 07 Nov 2018
Guiding Deep Learning System Testing using Surprise Adequacy Jinhan Kim R. Feldt S. Yoo AAML ELM 51 431 0 25 Aug 2018
Aleatoric uncertainty estimation with test-time augmentation for medical image segmentation with convolutional neural networks Guotai Wang Wenqi Li Michael Aertsen Jan Deprest Sebastien Ourselin Tom Vercauteren UQCV MedIm OOD 130 588 0 19 Jul 2018
A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attacks Kimin Lee Kibok Lee Honglak Lee Jinwoo Shin OODD 113 2,024 0 10 Jul 2018
Direct Uncertainty Prediction for Medical Second Opinions M. Raghu Katy Blumer Rory Sayres Ziad Obermeyer Robert D. Kleinberg S. Mullainathan Jon M. Kleinberg OOD UD 71 136 0 04 Jul 2018
Evidential Deep Learning to Quantify Classification Uncertainty Murat Sensoy Lance M. Kaplan M. Kandemir OOD UQCV EDL BDL 134 969 0 05 Jun 2018
Towards Safe Autonomous Driving: Capture Uncertainty in the Deep Neural Network For Lidar 3D Vehicle Detection Di Feng Lars Rosenbaum Klaus C. J. Dietmayer 3DPC UQCV 60 244 0 13 Apr 2018
YOLOv3: An Incremental Improvement Joseph Redmon Ali Farhadi ObjD 93 21,306 0 08 Apr 2018
DeepGauge: Multi-Granularity Testing Criteria for Deep Learning Systems Lei Ma Felix Juefei Xu Fuyuan Zhang Jiyuan Sun Minhui Xue ... Ting Su Li Li Yang Liu Jianjun Zhao Yadong Wang ELM 62 620 0 20 Mar 2018
Predictive Uncertainty Estimation via Prior Networks A. Malinin Mark Gales UD BDL EDL UQCV PER 168 907 0 28 Feb 2018
CosFace: Large Margin Cosine Loss for Deep Face Recognition Haobo Wang Yitong Wang Zheng Zhou Xing Ji Dihong Gong Jin Zhou Zhifeng Li Wei Liu CVBM MQ 114 2,488 0 29 Jan 2018
End-to-end Multi-Modal Multi-Task Vehicle Control for Self-Driving Cars with Visual Perception Zhengyuan Yang Yixuan Zhang Jerry Yu Junjie Cai Jiebo Luo 35 153 0 20 Jan 2018
Real-to-Virtual Domain Unification for End-to-End Autonomous Driving Luona Yang Xiaodan Liang Tairui Wang Eric Xing 44 56 0 10 Jan 2018
Training Confidence-calibrated Classifiers for Detecting Out-of-Distribution Samples Kimin Lee Honglak Lee Kibok Lee Jinwoo Shin OODD 98 880 0 26 Nov 2017
DeepTest: Automated Testing of Deep-Neural-Network-driven Autonomous Cars Yuchi Tian Kexin Pei Suman Jana Baishakhi Ray AAML 59 1,353 0 28 Aug 2017
Deep Steering: Learning End-to-End Driving Model from Spatial and Temporal Visual Cues Lu Chi Yadong Mu LLMSV 47 110 0 12 Aug 2017
Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networks Shiyu Liang Yixuan Li R. Srikant UQCV OODD 100 2,054 0 08 Jun 2017
DeepXplore: Automated Whitebox Testing of Deep Learning Systems Kexin Pei Yinzhi Cao Junfeng Yang Suman Jana AAML 75 1,357 0 18 May 2017