Contrastive learning, multi-view redundancy, and linear models

24 August 2020

Papers citing "Contrastive learning, multi-view redundancy, and linear models"

50 / 126 papers shown

Title
InfoNCE Loss Provably Learns Cluster-Preserving Representations Advait Parulekar Liam Collins Karthikeyan Shanmugam Aryan Mokhtari Sanjay Shakkottai SSL 34 20 0 15 Feb 2023
Evaluating Self-Supervised Learning via Risk Decomposition Yann Dubois Tatsunori Hashimoto Percy Liang 14 9 0 06 Feb 2023
The SSL Interplay: Augmentations, Inductive Bias, and Generalization Vivien A. Cabannes B. Kiani Randall Balestriero Yann LeCun A. Bietti SSL 19 31 0 06 Feb 2023
Revisiting Discriminative vs. Generative Classifiers: Theory and Implications Chenyu Zheng Guoqiang Wu Fan Bao Yue Cao Chongxuan Li Jun Zhu BDL 30 30 0 05 Feb 2023
Deciphering the Projection Head: Representation Evaluation Self-supervised Learning Jiajun Ma Tianyang Hu Wei Cao 17 8 0 28 Jan 2023
A Survey on Self-supervised Learning: Algorithms, Applications, and Future Trends Jie Gui Tuo Chen Jing Zhang Qiong Cao Zhe Sun Haoran Luo Dacheng Tao 31 124 0 13 Jan 2023
On the Power of Foundation Models Yang Yuan 17 36 0 29 Nov 2022
A Theoretical Study of Inductive Biases in Contrastive Learning Jeff Z. HaoChen Tengyu Ma UQCV SSL 36 31 0 27 Nov 2022
Single-Pass Contrastive Learning Can Work for Both Homophilic and Heterophilic Graph Hong Wang Jieyu Zhang Qi Zhu Wei Huang Kenji Kawaguchi X. Xiao 39 11 0 20 Nov 2022
Homomorphic Self-Supervised Learning Thomas Anderson Keller Xavier Suau Luca Zappella SSL 19 2 0 15 Nov 2022
Augmentation Invariant Manifold Learning Shulei Wang 39 1 0 01 Nov 2022
Spectral Representation Learning for Conditional Moment Models Ziyu Wang Yucen Luo Yueru Li Jun Zhu Bernhard Schölkopf CML 34 7 0 29 Oct 2022
Neural Eigenfunctions Are Structured Representation Learners Zhijie Deng Jiaxin Shi Hao Zhang Peng Cui Cewu Lu Jun Zhu 53 14 0 23 Oct 2022
Does Learning from Decentralized Non-IID Unlabeled Data Benefit from Self Supervision? Lirui Wang Kaipeng Zhang Yunzhu Li Yonglong Tian Russ Tedrake 34 16 0 20 Oct 2022
Correlation between Alignment-Uniformity and Performance of Dense Contrastive Representations Jong Hak Moon Wonjae Kim Edward Choi 26 3 0 17 Oct 2022
Linear Video Transformer with Feature Fixation Kaiyue Lu Zexia Liu Jianyuan Wang Weixuan Sun Zhen Qin ... Xuyang Shen Huizhong Deng Xiaodong Han Yuchao Dai Yiran Zhong 30 4 0 15 Oct 2022
A Kernel-Based View of Language Model Fine-Tuning Sadhika Malladi Alexander Wettig Dingli Yu Danqi Chen Sanjeev Arora VLM 73 61 0 11 Oct 2022
Contrastive Learning Can Find An Optimal Basis For Approximately View-Invariant Functions Daniel D. Johnson Ayoub El Hanchi Chris J. Maddison SSL 24 22 0 04 Oct 2022
What shapes the loss landscape of self-supervised learning? Liu Ziyin Ekdeep Singh Lubana Masakuni Ueda Hidenori Tanaka 50 20 0 02 Oct 2022
Efficient Medical Image Assessment via Self-supervised Learning Chun-Yin Huang Qi Lei Xiaoxiao Li 25 2 0 28 Sep 2022
Improving Self-Supervised Learning by Characterizing Idealized Representations Yann Dubois Tatsunori Hashimoto Stefano Ermon Percy Liang SSL 83 40 0 13 Sep 2022
Blessing of Class Diversity in Pre-training Yulai Zhao Jianshu Chen S. Du AI4CE 17 3 0 07 Sep 2022
Foundations and Trends in Multimodal Machine Learning: Principles, Challenges, and Open Questions Paul Pu Liang Amir Zadeh Louis-Philippe Morency 18 62 0 07 Sep 2022
Making Linear MDPs Practical via Contrastive Representation Learning Tianjun Zhang Tongzheng Ren Mengjiao Yang Joseph E. Gonzalez Dale Schuurmans Bo Dai 25 44 0 14 Jul 2022
On Finite-Sample Identifiability of Contrastive Learning-Based Nonlinear Independent Component Analysis Qi Lyu Xiao Fu CML 20 4 0 14 Jun 2022
An Empirical Study on Disentanglement of Negative-free Contrastive Learning Jinkun Cao Ruiqian Nai Qing Yang Jialei Huang Yang Gao CoGe DRL 27 9 0 09 Jun 2022
Towards Understanding Why Mask-Reconstruction Pretraining Helps in Downstream Tasks Jia-Yu Pan Pan Zhou Shuicheng Yan SSL 26 15 0 08 Jun 2022
Augmentation Component Analysis: Modeling Similarity via the Augmentation Overlaps Lu Han Han-Jia Ye De-Chuan Zhan 11 4 0 01 Jun 2022
Your Contrastive Learning Is Secretly Doing Stochastic Neighbor Embedding Tianyang Hu Zhili Liu Fengwei Zhou Wei Cao Weiran Huang SSL 47 26 0 30 May 2022
Contrastive and Non-Contrastive Self-Supervised Learning Recover Global and Local Spectral Embedding Methods Randall Balestriero Yann LeCun SSL 18 129 0 23 May 2022
The Mechanism of Prediction Head in Non-contrastive Self-supervised Learning Zixin Wen Yuanzhi Li SSL 27 34 0 12 May 2022
Empirical Evaluation and Theoretical Analysis for Representation Learning: A Survey Kento Nozawa Issei Sato AI4TS 21 4 0 18 Apr 2022
Augmentation-Free Graph Contrastive Learning with Performance Guarantee Haonan Wang Jieyu Zhang Qi Zhu Wei Huang 30 31 0 11 Apr 2022
Beyond Separability: Analyzing the Linear Transferability of Contrastive Representations to Related Subpopulations Jeff Z. HaoChen Colin Wei Ananya Kumar Tengyu Ma 28 37 0 06 Apr 2022
Chaos is a Ladder: A New Theoretical Understanding of Contrastive Learning via Augmentation Overlap Yifei Wang Qi Zhang Yisen Wang Jiansheng Yang Zhouchen Lin 27 98 0 25 Mar 2022
Measuring Self-Supervised Representation Quality for Downstream Classification using Discriminative Features Neha Kalibhat Kanika Narang Hamed Firooz Maziar Sanjabi S. Feizi SSL 38 7 0 03 Mar 2022
Audio Self-supervised Learning: A Survey Shuo Liu Adria Mallol-Ragolta Emilia Parada-Cabeleiro Kun Qian Xingshuo Jing Alexander Kathan Bin Hu Bjoern W. Schuller SSL 35 106 0 02 Mar 2022
Understanding Contrastive Learning Requires Incorporating Inductive Biases Nikunj Saunshi Jordan T. Ash Surbhi Goel Dipendra Kumar Misra Cyril Zhang Sanjeev Arora Sham Kakade A. Krishnamurthy SSL 27 109 0 28 Feb 2022
Masked prediction tasks: a parameter identifiability view Bingbin Liu Daniel J. Hsu Pradeep Ravikumar Andrej Risteski SSL OOD 21 4 0 18 Feb 2022
Augment with Care: Contrastive Learning for Combinatorial Problems Haonan Duan Pashootan Vaezipoor Max B. Paulus Yangjun Ruan Chris J. Maddison SSL 20 19 0 17 Feb 2022
Unlabeled Data Help: Minimax Analysis and Adversarial Robustness Yue Xing Qifan Song Guang Cheng 14 4 0 14 Feb 2022
Understanding The Robustness of Self-supervised Learning Through Topic Modeling Zeping Luo Shiyou Wu C. Weng Mo Zhou Rong Ge OOD SSL 14 3 0 02 Feb 2022
Object-Aware Cropping for Self-Supervised Learning Shlok Kumar Mishra Anshul B. Shah Ankan Bansal Abhyuday N. Jagannatha Janit Anjaria Abhishek Sharma David Jacobs Dilip Krishnan SSL 26 22 0 01 Dec 2021
Cross-Task Consistency Learning Framework for Multi-Task Learning Akihiro Nakano Shi Chen K. Demachi CVBM 22 3 0 28 Nov 2021
Leveraging Time Irreversibility with Order-Contrastive Pre-training Monica Agrawal Hunter Lang M. Offin L. Gazit David Sontag 27 6 0 04 Nov 2021
Understanding Dimensional Collapse in Contrastive Self-supervised Learning Li Jing Pascal Vincent Yann LeCun Yuandong Tian SSL 25 338 0 18 Oct 2021
Self-supervised Learning is More Robust to Dataset Imbalance Hong Liu Jeff Z. HaoChen Adrien Gaidon Tengyu Ma OOD SSL 33 157 0 11 Oct 2021
Towards Demystifying Representation Learning with Non-contrastive Self-supervision Xiang Wang Xinlei Chen S. Du Yuandong Tian SSL 21 26 0 11 Oct 2021
On the Surrogate Gap between Contrastive and Supervised Losses Han Bao Yoshihiro Nagano Kento Nozawa SSL UQCV 41 19 0 06 Oct 2021
The Power of Contrast for Feature Learning: A Theoretical Analysis Wenlong Ji Zhun Deng Ryumei Nakada James Zou Linjun Zhang SSL 53 49 0 06 Oct 2021