Complementary Benefits of Contrastive Learning and Self-Training Under Distribution Shift

6 December 2023

Saurabh Garg

Amrith Rajagopal Setlur

Zachary Chase Lipton

Sivaraman Balakrishnan

Papers citing "Complementary Benefits of Contrastive Learning and Self-Training Under Distribution Shift"

43 / 43 papers shown

Title
The SSL Interplay: Augmentations, Inductive Bias, and Generalization Vivien A. Cabannes B. Kiani Randall Balestriero Yann LeCun A. Bietti SSL 63 32 0 06 Feb 2023
Unsupervised Learning under Latent Label Shift Manley Roberts P. Mani Saurabh Garg Zachary Chase Lipton OOD 89 9 0 26 Jul 2022
Domain Adaptation under Open Set Label Shift Saurabh Garg Sivaraman Balakrishnan Zachary Chase Lipton OOD VLM 35 42 0 26 Jul 2022
Last Layer Re-Training is Sufficient for Robustness to Spurious Correlations Polina Kirichenko Pavel Izmailov A. Wilson OOD 76 333 0 06 Apr 2022
Beyond Separability: Analyzing the Linear Transferability of Contrastive Representations to Related Subpopulations Jeff Z. HaoChen Colin Wei Ananya Kumar Tengyu Ma 62 37 0 06 Apr 2022
Fine-Tuning can Distort Pretrained Features and Underperform Out-of-Distribution Ananya Kumar Aditi Raghunathan Robbie Jones Tengyu Ma Percy Liang OODD 109 671 0 21 Feb 2022
Leveraging Unlabeled Data to Predict Out-of-Distribution Performance Saurabh Garg Sivaraman Balakrishnan Zachary Chase Lipton Behnam Neyshabur Hanie Sedghi OODD OOD 62 128 0 11 Jan 2022
Provable Guarantees for Self-Supervised Deep Learning with Spectral Contrastive Loss Jeff Z. HaoChen Colin Wei Adrien Gaidon Tengyu Ma SSL 54 315 0 08 Jun 2021
VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learning Adrien Bardes Jean Ponce Yann LeCun SSL DML 149 932 0 11 May 2021
Emerging Properties in Self-Supervised Vision Transformers Mathilde Caron Hugo Touvron Ishan Misra Hervé Jégou Julien Mairal Piotr Bojanowski Armand Joulin 642 6,059 0 29 Apr 2021
Barlow Twins: Self-Supervised Learning via Redundancy Reduction Jure Zbontar Li Jing Ishan Misra Yann LeCun Stéphane Deny SSL 300 2,343 0 04 Mar 2021
A Survey on Deep Semi-supervised Learning Xiangli Yang Zixing Song Irwin King Zenglin Xu 97 581 0 28 Feb 2021
A Theory of Label Propagation for Subpopulation Shift Tianle Cai Ruiqi Gao Jason D. Lee Qi Lei 58 50 0 22 Feb 2021
Surprisingly Simple Semi-Supervised Domain Adaptation with Pretraining and Consistency Samarth Mishra Kate Saenko Venkatesh Saligrama 65 28 0 29 Jan 2021
WILDS: A Benchmark of in-the-Wild Distribution Shifts Pang Wei Koh Shiori Sagawa Henrik Marklund Sang Michael Xie Marvin Zhang ... A. Kundaje Emma Pierson Sergey Levine Chelsea Finn Percy Liang OOD 172 1,428 0 14 Dec 2020
Understanding the Failure Modes of Out-of-Distribution Generalization Vaishnavh Nagarajan Anders Andreassen Behnam Neyshabur OOD OODD 48 177 0 29 Oct 2020
Coping with Label Shift via Distributionally Robust Optimisation J.N. Zhang A. Menon Andreas Veit Srinadh Bhojanapalli Sanjiv Kumar S. Sra OOD 58 71 0 23 Oct 2020
In Search of Lost Domain Generalization Ishaan Gulrajani David Lopez-Paz OOD 76 1,143 0 02 Jul 2020
Unsupervised Learning of Visual Features by Contrasting Cluster Assignments Mathilde Caron Ishan Misra Julien Mairal Priya Goyal Piotr Bojanowski Armand Joulin OCL SSL 215 4,073 0 17 Jun 2020
Bootstrap your own latent: A new approach to self-supervised Learning Jean-Bastien Grill Florian Strub Florent Altché Corentin Tallec Pierre Harvey Richemond ... M. G. Azar Bilal Piot Koray Kavukcuoglu Rémi Munos Michal Valko SSL 353 6,792 0 13 Jun 2020
An Investigation of Why Overparameterization Exacerbates Spurious Correlations Shiori Sagawa Aditi Raghunathan Pang Wei Koh Percy Liang 182 379 0 09 May 2020
A Unified View of Label Shift Estimation Saurabh Garg Yifan Wu Sivaraman Balakrishnan Zachary Chase Lipton 52 143 0 17 Mar 2020
A Simple Framework for Contrastive Learning of Visual Representations Ting-Li Chen Simon Kornblith Mohammad Norouzi Geoffrey E. Hinton SSL 345 18,739 0 13 Feb 2020
FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidence Kihyuk Sohn David Berthelot Chun-Liang Li Zizhao Zhang Nicholas Carlini E. D. Cubuk Alexey Kurakin Han Zhang Colin Raffel AAML 155 3,545 0 21 Jan 2020
ReMixMatch: Semi-Supervised Learning with Distribution Alignment and Augmentation Anchoring David Berthelot Nicholas Carlini E. D. Cubuk Alexey Kurakin Kihyuk Sohn Han Zhang Colin Raffel 89 681 0 21 Nov 2019
Self-training with Noisy Student improves ImageNet classification Qizhe Xie Minh-Thang Luong Eduard H. Hovy Quoc V. Le NoLa 304 2,387 0 11 Nov 2019
RandAugment: Practical automated data augmentation with a reduced search space E. D. Cubuk Barret Zoph Jonathon Shlens Quoc V. Le MQ 212 3,485 0 30 Sep 2019
Making Convolutional Networks Shift-Invariant Again Richard Y. Zhang OOD 89 797 0 25 Apr 2019
Learning from positive and unlabeled data: a survey Jessa Bekker Jesse Davis 72 560 0 12 Nov 2018
Syn2Real: A New Benchmark forSynthetic-to-Real Visual Domain Adaptation Xingchao Peng Ben Usman Kuniaki Saito Neela Kaushik Judy Hoffman Kate Saenko 44 77 0 26 Jun 2018
Unsupervised Feature Learning via Non-Parametric Instance-level Discrimination Zhirong Wu Yuanjun Xiong Stella X. Yu Dahua Lin SSL 170 3,452 0 05 May 2018
A DIRT-T Approach to Unsupervised Domain Adaptation Rui Shu Hung Bui Hirokazu Narui Stefano Ermon 72 621 0 23 Feb 2018
Detecting and Correcting for Label Shift with Black Box Predictors Zachary Chase Lipton Yu Wang Alex Smola OOD 58 553 0 12 Feb 2018
Functional Map of the World Gordon A. Christie Neil Fendley James Wilson R. Mukherjee VGen 73 392 0 21 Nov 2017
Deep Hashing Network for Unsupervised Domain Adaptation Hemanth Venkateswara José Eusébio Shayok Chakraborty S. Panchanathan OOD 138 2,042 0 22 Jun 2017
Understanding deep learning requires rethinking generalization Chiyuan Zhang Samy Bengio Moritz Hardt Benjamin Recht Oriol Vinyals HAI 334 4,624 0 10 Nov 2016
SGDR: Stochastic Gradient Descent with Warm Restarts I. Loshchilov Frank Hutter ODL 305 8,114 0 13 Aug 2016
Deep CORAL: Correlation Alignment for Deep Domain Adaptation Baochen Sun Kate Saenko OOD 97 3,151 0 06 Jul 2016
Domain-Adversarial Training of Neural Networks Yaroslav Ganin E. Ustinova Hana Ajakan Pascal Germain Hugo Larochelle François Laviolette M. Marchand Victor Lempitsky GAN OOD 366 9,484 0 28 May 2015
Learning Transferable Features with Deep Adaptation Networks Mingsheng Long Yue Cao Jianmin Wang Michael I. Jordan OOD 217 5,194 0 10 Feb 2015
ImageNet Large Scale Visual Recognition Challenge Olga Russakovsky Jia Deng Hao Su J. Krause S. Satheesh ... A. Karpathy A. Khosla Michael S. Bernstein Alexander C. Berg Li Fei-Fei VLM ObjD 1.6K 39,509 0 01 Sep 2014
Domain Generalization via Invariant Feature Representation Krikamol Muandet David Balduzzi Bernhard Schölkopf OOD 124 1,179 0 10 Jan 2013
On Causal and Anticausal Learning Bernhard Schölkopf Dominik Janzing J. Peters Eleni Sgouritsa Kun Zhang Joris Mooij CML 81 607 0 27 Jun 2012