BREEDS: Benchmarks for Subpopulation Shift

11 August 2020

ArXiv (abs)PDF HTML Github (55★)

Papers citing "BREEDS: Benchmarks for Subpopulation Shift"

44 / 44 papers shown

Title
GeneralizeFormer: Layer-Adaptive Model Generation across Test-Time Distribution Shifts Sameer Ambekar Zehao Xiao Xiantong Zhen Cees G. M. Snoek OOD 149 1 0 15 Feb 2025
Learning Structured Representations by Embedding Class Hierarchy with Fast Optimal Transport Siqi Zeng Sixian Du M. Yamada Han Zhao OT 84 1 0 04 Oct 2024
Leveraging Gradients for Unsupervised Accuracy Estimation under Distribution Shift Renchunzi Xie Ambroise Odonnat Vasilii Feofanov I. Redko Jianfeng Zhang Bo An UQCV 118 1 0 17 Jan 2024
Do Adversarially Robust ImageNet Models Transfer Better? Hadi Salman Andrew Ilyas Logan Engstrom Ashish Kapoor Aleksander Madry 86 425 0 16 Jul 2020
Adversarially-Trained Deep Nets Transfer Better: Illustration on Image Classification Francisco Utrera Evan Kravitz N. Benjamin Erichson Rekha Khanna Michael W. Mahoney GAN 60 33 0 11 Jul 2020
Measuring Robustness to Natural Distribution Shifts in Image Classification Rohan Taori Achal Dave Vaishaal Shankar Nicholas Carlini Benjamin Recht Ludwig Schmidt OOD 120 548 0 01 Jul 2020
From ImageNet to Image Classification: Contextualizing Progress on Benchmarks Dimitris Tsipras Shibani Santurkar Logan Engstrom Andrew Ilyas Aleksander Madry 75 135 0 22 May 2020
Identifying Statistical Bias in Dataset Replication Logan Engstrom Andrew Ilyas Shibani Santurkar Dimitris Tsipras Jacob Steinhardt Aleksander Madry 58 51 0 19 May 2020
Distributionally Robust Neural Networks for Group Shifts: On the Importance of Regularization for Worst-Case Generalization Shiori Sagawa Pang Wei Koh Tatsunori B. Hashimoto Percy Liang OOD 108 1,247 0 20 Nov 2019
Distributionally Robust Language Modeling Yonatan Oren Shiori Sagawa Tatsunori B. Hashimoto Percy Liang OOD 73 175 0 04 Sep 2019
Invariant Risk Minimization Martín Arjovsky Léon Bottou Ishaan Gulrajani David Lopez-Paz OOD 195 2,242 0 05 Jul 2019
Do Image Classifiers Generalize Across Time? Vaishaal Shankar Achal Dave Rebecca Roelofs Deva Ramanan Benjamin Recht Ludwig Schmidt 124 83 0 05 Jun 2019
Adversarial Robustness as a Prior for Learned Representations Logan Engstrom Andrew Ilyas Shibani Santurkar Dimitris Tsipras Brandon Tran Aleksander Madry OOD AAML 61 63 0 03 Jun 2019
Do ImageNet Classifiers Generalize to ImageNet? Benjamin Recht Rebecca Roelofs Ludwig Schmidt Vaishaal Shankar OOD SSeg VLM 118 1,726 0 13 Feb 2019
Adversarial Examples Are a Natural Consequence of Test Error in Noise Nic Ford Justin Gilmer Nicholas Carlini E. D. Cubuk AAML 104 320 0 29 Jan 2019
Moment Matching for Multi-Source Domain Adaptation Xingchao Peng Qinxun Bai Xide Xia Zijun Huang Kate Saenko Bo Wang OOD 143 1,809 0 04 Dec 2018
LEAF: A Benchmark for Federated Settings S. Caldas Sai Meher Karthik Duddu Peter Wu Tian Li Jakub Konecný H. B. McMahan Virginia Smith Ameet Talwalkar FedML 153 1,422 0 03 Dec 2018
ImageNet-trained CNNs are biased towards texture; increasing shape bias improves accuracy and robustness Robert Geirhos Patricia Rubisch Claudio Michaelis Matthias Bethge Felix Wichmann Wieland Brendel 121 2,673 0 29 Nov 2018
The Open Images Dataset V4: Unified image classification, object detection, and visual relationship detection at scale Alina Kuznetsova H. Rom N. Alldrin J. Uijlings Ivan Krasin ... S. Popov Matteo Malloci Alexander Kolesnikov Tom Duerig V. Ferrari ObjD VLM 118 1,348 0 02 Nov 2018
Learning Models with Uniform Performance via Distributionally Robust Optimization John C. Duchi Hongseok Namkoong OOD 63 423 0 20 Oct 2018
Recognition in Terra Incognita Sara Beery Grant Van Horn Pietro Perona 97 852 0 13 Jul 2018
Benchmarking Neural Network Robustness to Common Corruptions and Surface Variations Dan Hendrycks Thomas G. Dietterich OOD 79 200 0 04 Jul 2018
Fairness Without Demographics in Repeated Loss Minimization Tatsunori B. Hashimoto Megha Srivastava Hongseok Namkoong Percy Liang FaML 113 584 0 20 Jun 2018
Deeper, Broader and Artier Domain Generalization Da Li Yongxin Yang Yi-Zhe Song Timothy M. Hospedales OOD 124 1,451 0 09 Oct 2017
Random Erasing Data Augmentation Zhun Zhong Liang Zheng Guoliang Kang Shaozi Li Yi Yang 96 3,644 0 16 Aug 2017
Towards Deep Learning Models Resistant to Adversarial Attacks Aleksander Madry Aleksandar Makelov Ludwig Schmidt Dimitris Tsipras Adrian Vladu SILM OOD 315 12,131 0 19 Jun 2017
Zero-Shot Learning -- The Good, the Bad and the Ugly Yongqin Xian Bernt Schiele Zeynep Akata 77 843 0 13 Mar 2017
COCO-Stuff: Thing and Stuff Classes in Context Holger Caesar J. Uijlings V. Ferrari 137 1,394 0 12 Dec 2016
Statistics of Robust Optimization: A Generalized Empirical Likelihood Approach John C. Duchi Peter Glynn Hongseok Namkoong 106 323 0 11 Oct 2016
Inherent Trade-Offs in the Fair Determination of Risk Scores Jon M. Kleinberg S. Mullainathan Manish Raghavan FaML 121 1,775 0 19 Sep 2016
Robustness of classifiers: from adversarial to random noise Alhussein Fawzi Seyed-Mohsen Moosavi-Dezfooli P. Frossard AAML 92 376 0 31 Aug 2016
What makes ImageNet good for transfer learning? Minyoung Huh Pulkit Agrawal Alexei A. Efros OOD SSeg VLM SSL 105 676 0 30 Aug 2016
Manitest: Are classifiers really invariant? Alhussein Fawzi P. Frossard 57 118 0 23 Jul 2015
Optimal Transport for Domain Adaptation Nicolas Courty Rémi Flamary D. Tuia A. Rakotomamonjy OT OOD 145 1,123 0 02 Jul 2015
Data-driven Distributionally Robust Optimization Using the Wasserstein Metric: Performance Guarantees and Tractable Reformulations Peyman Mohajerin Esfahani Daniel Kuhn 94 1,664 0 19 May 2015
Unsupervised Domain Adaptation by Backpropagation Yaroslav Ganin Victor Lempitsky OOD 235 6,041 0 26 Sep 2014
ImageNet Large Scale Visual Recognition Challenge Olga Russakovsky Jia Deng Hao Su J. Krause S. Satheesh ... A. Karpathy A. Khosla Michael S. Bernstein Alexander C. Berg Li Fei-Fei VLM ObjD 1.7K 39,590 0 01 Sep 2014
CNN Features off-the-shelf: an Astounding Baseline for Recognition A. Razavian Hossein Azizpour Josephine Sullivan S. Carlsson 159 4,945 0 23 Mar 2014
A Testbed for Cross-Dataset Analysis Tatiana Tommasi Tinne Tuytelaars Barbara Caputo 211 95 0 24 Feb 2014
Intriguing properties of neural networks Christian Szegedy Wojciech Zaremba Ilya Sutskever Joan Bruna D. Erhan Ian Goodfellow Rob Fergus AAML 282 14,961 1 21 Dec 2013
Distributed Representations of Words and Phrases and their Compositionality Tomas Mikolov Ilya Sutskever Kai Chen G. Corrado J. Dean NAI OCL 402 33,560 0 16 Oct 2013
DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition Jeff Donahue Yangqing Jia Oriol Vinyals Judy Hoffman Ning Zhang Eric Tzeng Trevor Darrell VLM ObjD 191 4,951 0 06 Oct 2013
Zero-Shot Learning Through Cross-Modal Transfer R. Socher M. Ganjoo Hamsa Sridhar Osbert Bastani Christopher D. Manning A. Ng BDL VLM 124 1,469 0 16 Jan 2013
Domain Generalization via Invariant Feature Representation Krikamol Muandet David Balduzzi Bernhard Schölkopf OOD 142 1,185 0 10 Jan 2013