Title
Predicting the Performance of Foundation Models via Agreement-on-the-Line Aman Mehra Rahul Saxena Taeyoun Kim Christina Baek Zico Kolter Aditi Raghunathan UQCV 84 2 0 02 Apr 2024
AETTA: Label-Free Accuracy Estimation for Test-Time Adaptation Taeckyung Lee Sorn Chottananurak Taesik Gong Sung-Ju Lee 85 3 0 01 Apr 2024
Controlled Training Data Generation with Diffusion Models Teresa Yeo Andrei Atanov Harold Benoit Aleksandr Alekseev Ruchira Ray Pooya Esmaeil Akhoondi Amir Zamir 109 6 0 22 Mar 2024
Securely Fine-tuning Pre-trained Encoders Against Adversarial Examples Ziqi Zhou Minghui Li Wei Liu Shengshan Hu Yechao Zhang Wei Wan Lulu Xue Leo Yu Zhang Dezhong Yao Hai Jin SILM AAML 114 11 0 16 Mar 2024
Model Reprogramming Outperforms Fine-tuning on Out-of-distribution Data in Text-Image Encoders Andrew Geng Pin-Yu Chen OODD 85 1 0 16 Mar 2024
Towards Robust Out-of-Distribution Generalization Bounds via Sharpness Yingtian Zou Kenji Kawaguchi Yingnan Liu Jiashuo Liu Mong Li Lee Wynne Hsu 81 7 0 11 Mar 2024
A Survey on Evaluation of Out-of-Distribution Generalization Han Yu Jiashuo Liu Xingxuan Zhang Jiayun Wu Peng Cui OOD 101 9 0 04 Mar 2024
Ask Your Distribution Shift if Pre-Training is Right for You Benjamin Cohen-Wang Joshua Vendrow Aleksander Madry OOD 94 3 0 29 Feb 2024
Stable Neural Stochastic Differential Equations in Analyzing Irregular Time Series Data YongKyung Oh Dongyoung Lim Sungil Kim AI4TS 145 17 0 22 Feb 2024
A Closer Look at the Robustness of Contrastive Language-Image Pre-Training (CLIP) Weijie Tu Weijian Deng Tom Gedeon UQCV VLM 73 35 0 12 Feb 2024
Mitigating Covariate Shift in Misspecified Regression with Applications to Reinforcement Learning Philip Amortila Tongyi Cao Akshay Krishnamurthy OffRL OOD 76 3 0 22 Jan 2024
AutoFT: Learning an Objective for Robust Fine-Tuning Caroline Choi Yoonho Lee Annie S. Chen Allan Zhou Aditi Raghunathan Chelsea Finn OOD 111 0 0 18 Jan 2024
Reliability in Semantic Segmentation: Can We Use Synthetic Data? Thibaut Loiseau Tuan-Hung Vu Mickaël Chen Patrick Pérez Matthieu Cord UQCV 82 15 0 14 Dec 2023
Beyond Top-Class Agreement: Using Divergences to Forecast Performance under Distribution Shift Mona Schirmer Dan Zhang Eric T. Nalisnick 43 0 0 13 Dec 2023
The Limits of Fair Medical Imaging AI In The Wild Yuzhe Yang Haoran Zhang Judy W. Gichoya Dina Katabi Marzyeh Ghassemi 77 6 0 11 Dec 2023
Benchmarking Distribution Shift in Tabular Data with TableShift Josh Gardner Zoran Popovic Ludwig Schmidt OOD 86 45 0 10 Dec 2023
Understanding the Detrimental Class-level Effects of Data Augmentation Polina Kirichenko Mark Ibrahim Randall Balestriero Diane Bouchacourt Ramakrishna Vedantam Hamed Firooz Andrew Gordon Wilson 73 12 0 07 Dec 2023
Describing Differences in Image Sets with Natural Language Lisa Dunlap Yuhui Zhang Xiaohan Wang Ruiqi Zhong Trevor Darrell Jacob Steinhardt Joseph E. Gonzalez Serena Yeung-Levy CoGe VLM 125 32 0 05 Dec 2023
Eliciting Latent Knowledge from Quirky Language Models Alex Troy Mallen Madeline Brumley Julia Kharchenko Nora Belrose HILM RALM KELM 92 33 0 02 Dec 2023
On the Out of Distribution Robustness of Foundation Models in Medical Image Segmentation D. M. Nguyen Tan Ngoc Pham Nghiem Tuong Diep Nghi Quoc Phan Quang Pham ... Ngan Hoang Le Nhat Ho Pengtao Xie Daniel Sonntag Mathias Niepert VLM UQCV OOD 80 7 0 18 Nov 2023
ConvNet vs Transformer, Supervised vs CLIP: Beyond ImageNet Accuracy Kirill Vishniakov Zhiqiang Shen Zhuang Liu CLIP 106 16 0 15 Nov 2023
What Makes Pre-Trained Visual Representations Successful for Robust Manipulation? Kaylee Burns Zach Witzel Jubayer Ibn Hamid Tianhe Yu Chelsea Finn Karol Hausman OOD SSL 90 25 0 03 Nov 2023
Invariant-Feature Subspace Recovery: A New Class of Provable Domain Generalization Algorithms Haoxiang Wang Gargi Balasubramaniam Haozhe Si Bo Li Han Zhao OOD 79 2 0 02 Nov 2023
ArcheType: A Novel Framework for Open-Source Column Type Annotation using Large Language Models Ben Feuer Yurong Liu Chinmay Hegde Juliana Freire AI4TS VLM 77 10 0 27 Oct 2023
Revisiting Deep Ensemble for Out-of-Distribution Detection: A Loss Landscape Perspective Kun Fang Qinghua Tao Xiaolin Huang Jie Yang OODD 112 3 0 22 Oct 2023
OODRobustBench: a Benchmark and Large-Scale Analysis of Adversarial Robustness under Distribution Shift Lin Li Yifei Wang Chawin Sitawarin Michael W. Spratling 56 4 0 19 Oct 2023
It's an Alignment, Not a Trade-off: Revisiting Bias and Variance in Deep Models Lin Chen Michal Lukasik Wittawat Jitkrittum Chong You Sanjiv Kumar 77 1 0 13 Oct 2023
Robustness May be More Brittle than We Think under Different Degrees of Distribution Shifts Kaican Li Yifan Zhang Lanqing Hong Zhenguo Li Nevin L. Zhang OOD 124 0 0 10 Oct 2023
CIFAR-10-Warehouse: Broad and More Realistic Testbeds in Model Generalization Analysis Chong You Xingjian Leng Zijian Wang Yang Yang Zi Huang Liang Zheng OOD 104 8 0 06 Oct 2023
TRAM: Bridging Trust Regions and Sharpness Aware Minimization Tom Sherborne Naomi Saphra Pradeep Dasigi Hao Peng 58 5 0 05 Oct 2023
Towards Stable Backdoor Purification through Feature Shift Tuning Rui Min Zeyu Qin Li Shen Minhao Cheng AAML 113 22 0 03 Oct 2023
Deep Neural Networks Tend To Extrapolate Predictably Katie Kang Amrith Rajagopal Setlur Claire Tomlin Sergey Levine 57 0 0 02 Oct 2023
Impact of architecture on robustness and interpretability of multispectral deep neural networks Charles Godfrey Elise Bishoff Myles Mckay E. Byler 59 0 0 21 Sep 2023
Selecting which Dense Retriever to use for Zero-Shot Search Ekaterina Khramtsova Shengyao Zhuang Mahsa Baktashmotlagh Xi Wang Guido Zuccon 66 9 0 18 Sep 2023
Anchor Points: Benchmarking Models with Much Fewer Examples Rajan Vivek Kawin Ethayarajh Diyi Yang Douwe Kiela ALM 116 28 0 14 Sep 2023
Distance Matters For Improving Performance Estimation Under Covariate Shift Mélanie Roschewitz Ben Glocker 62 1 0 14 Aug 2023
On genuine invariance learning without weight-tying A. Moskalev A. Sepliarskaia Erik J. Bekkers A. Smeulders CML OOD 67 9 0 07 Aug 2023
Distributionally Robust Classification on a Data Budget Ben Feuer Ameya Joshi Minh Pham Chinmay Hegde OOD 75 2 0 07 Aug 2023
Improving Generalization of Adversarial Training via Robust Critical Fine-Tuning Kaijie Zhu Jindong Wang Xixu Hu Xingxu Xie G. Yang AAML 74 25 0 01 Aug 2023
How Does Diffusion Influence Pretrained Language Models on Out-of-Distribution Data? Huazheng Wang Daixuan Cheng Haifeng Sun Jingyu Wang Q. Qi Jianxin Liao Jing Wang Cong Liu 63 0 0 26 Jul 2023
Does Progress On Object Recognition Benchmarks Improve Real-World Generalization? Megan Richards Polina Kirichenko Diane Bouchacourt Mark Ibrahim VLM 101 13 0 24 Jul 2023
On the Connection between Pre-training Data Diversity and Fine-tuning Robustness Vivek Ramanujan Thao Nguyen Sewoong Oh Ludwig Schmidt Ali Farhadi OOD 46 26 0 24 Jul 2023
GIST: Generating Image-Specific Text for Fine-grained Object Classification Kathleen M. Lewis Emily Mu Adrian Dalca John Guttag VLM 65 7 0 21 Jul 2023
A Holistic Assessment of the Reliability of Machine Learning Systems Anthony Corso David Karamadian Romeo Valentin Mary Cooper Mykel J. Kochenderfer 77 7 0 20 Jul 2023
A Causal Framework to Unify Common Domain Generalization Approaches N. Zhang Kaican Li Han Gao Weiyan Xie Zhi Lin Zechao Li Luning Wang Yongxiang Huang FedML OOD AI4CE 83 3 0 13 Jul 2023
Neural Priming for Sample-Efficient Adaptation Matthew Wallingford Vivek Ramanujan Alex Fang Aditya Kusupati Roozbeh Mottaghi Aniruddha Kembhavi Ludwig Schmidt Ali Farhadi VLM 189 15 0 16 Jun 2023
On the Joint Interaction of Models, Data, and Features Yiding Jiang Christina Baek J. Zico Kolter FedML 54 4 0 07 Jun 2023
Revisiting Out-of-distribution Robustness in NLP: Benchmark, Analysis, and LLMs Evaluations Lifan Yuan Yangyi Chen Ganqu Cui Hongcheng Gao Fangyuan Zou Xingyi Cheng Heng Ji Zhiyuan Liu Maosong Sun 144 84 0 07 Jun 2023
From Adversarial Arms Race to Model-centric Evaluation: Motivating a Unified Automatic Robustness Evaluation Framework Yangyi Chen Hongcheng Gao Ganqu Cui Lifan Yuan Dehan Kong ... Longtao Huang H. Xue Zhiyuan Liu Maosong Sun Heng Ji AAML ELM 101 6 0 29 May 2023
Accuracy on the Curve: On the Nonlinear Correlation of ML Performance Between Data Subpopulations Weixin Liang Yining Mao Yongchan Kwon Xinyu Yang James Zou OODD 88 3 0 04 May 2023