Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hypersphere

20 May 2020

Papers citing "Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hypersphere"

50 / 318 papers shown

Title
Towards the Generalization of Contrastive Self-Supervised Learning Weiran Huang Mingyang Yi Xuyang Zhao Zihao Jiang SSL 21 105 0 01 Nov 2021
CLOOB: Modern Hopfield Networks with InfoLOOB Outperform CLIP Andreas Fürst Elisabeth Rumetshofer Johannes Lehner Viet-Hung Tran Fei Tang ... David P. Kreil Michael K Kopp G. Klambauer Angela Bitto-Nemling Sepp Hochreiter VLM CLIP 207 102 0 21 Oct 2021
Mitigating Memorization of Noisy Labels via Regularization between Representations Hao Cheng Zhaowei Zhu Xing Sun Yang Liu NoLa 38 28 0 18 Oct 2021
Virtual Augmentation Supported Contrastive Learning of Sentence Representations Dejiao Zhang Wei Xiao Henghui Zhu Xiaofei Ma Andrew O. Arnold SSL 51 29 0 16 Oct 2021
Surrogate- and invariance-boosted contrastive learning for data-scarce applications in science Charlotte Loh T. Christensen Rumen Dangovski Samuel Kim Marin Soljacic 26 16 0 15 Oct 2021
Decoupled Contrastive Learning Chun-Hsiao Yeh Cheng-Yao Hong Yen-Chi Hsu Tyng-Luh Liu Yubei Chen Yann LeCun 178 182 0 13 Oct 2021
Towards Demystifying Representation Learning with Non-contrastive Self-supervision Xiang Wang Xinlei Chen S. Du Yuandong Tian SSL 21 26 0 11 Oct 2021
Weakly Supervised Contrastive Learning Mingkai Zheng Fei-Yue Wang Shan You Chao Qian Changshui Zhang Xiaogang Wang Chang Xu SSL 34 121 0 10 Oct 2021
Pre-training Molecular Graph Representation with 3D Geometry Shengchao Liu Hanchen Wang Weiyang Liu Joan Lasenby Hongyu Guo Jian Tang 120 302 0 07 Oct 2021
On the Surrogate Gap between Contrastive and Supervised Losses Han Bao Yoshihiro Nagano Kento Nozawa SSL UQCV 41 19 0 06 Oct 2021
The Power of Contrast for Feature Learning: A Theoretical Analysis Wenlong Ji Zhun Deng Ryumei Nakada James Y. Zou Linjun Zhang SSL 51 48 0 06 Oct 2021
Robust Contrastive Active Learning with Feature-guided Query Strategies R. Krishnan Nilesh A. Ahuja Alok Sinha Mahesh Subedar Omesh Tickoo Ravi Iyer 18 1 0 13 Sep 2021
Complementary Calibration: Boosting General Continual Learning with Collaborative Distillation and Self-Supervision Zhong Ji Jin Li Qiang Wang Zhongfei Zhang CLL 25 18 0 03 Sep 2021
Sentence-T5: Scalable Sentence Encoders from Pre-trained Text-to-Text Models Jianmo Ni Gustavo Hernández Ábrego Noah Constant Ji Ma Keith B. Hall Daniel Matthew Cer Yinfei Yang 46 527 0 19 Aug 2021
Improving Contrastive Learning by Visualizing Feature Transformation Rui Zhu Bingchen Zhao Jingen Liu Zhenglong Sun C. L. P. Chen SSL 96 78 0 06 Aug 2021
A Low Rank Promoting Prior for Unsupervised Contrastive Learning Yu Wang Jingyang Lin Qi Cai Yingwei Pan Ting Yao Hongyang Chao Tao Mei SSL 27 16 0 05 Aug 2021
On the Efficacy of Small Self-Supervised Contrastive Models without Distillation Signals Haizhou Shi Youcai Zhang Siliang Tang Wenjie Zhu Yaqian Li Yandong Guo Yueting Zhuang SyDa 23 14 0 30 Jul 2021
Improve Unsupervised Pretraining for Few-label Transfer Suichan Li Dongdong Chen Yinpeng Chen Lu Yuan Lei Zhang Qi Chu B. Liu Nenghai Yu SSL 18 20 0 26 Jul 2021
ReSSL: Relational Self-Supervised Learning with Weak Augmentation Mingkai Zheng Shan You Fei-Yue Wang Chao Qian Changshui Zhang Xiaogang Wang Chang Xu 23 113 0 20 Jul 2021
SelfCF: A Simple Framework for Self-supervised Collaborative Filtering Xin Zhou Aixin Sun Yong-jin Liu Jie M. Zhang C. Miao SSL 27 76 0 07 Jul 2021
SCARF: Self-Supervised Contrastive Learning using Random Feature Corruption Dara Bahri Heinrich Jiang Yi Tay Donald Metzler SSL 19 163 0 29 Jun 2021
Decomposed Mutual Information Estimation for Contrastive Representation Learning Alessandro Sordoni Nouha Dziri Hannes Schulz Geoffrey J. Gordon Philip Bachman Rémi Tachet des Combes SSL 24 29 0 25 Jun 2021
Co-advise: Cross Inductive Bias Distillation Sucheng Ren Zhengqi Gao Tianyu Hua Zihui Xue Yonglong Tian Shengfeng He Hang Zhao 44 53 0 23 Jun 2021
Can contrastive learning avoid shortcut solutions? Joshua Robinson Li Sun Ke Yu Kayhan Batmanghelich Stefanie Jegelka S. Sra SSL 19 142 0 21 Jun 2021
Multi-level Feature Learning for Contrastive Multi-view Clustering Jie Xu Huayi Tang Yazhou Ren Liang Peng Xiao-lan Zhu Lifang He 24 161 0 21 Jun 2021
Investigating the Role of Negatives in Contrastive Representation Learning Jordan T. Ash Surbhi Goel A. Krishnamurthy Dipendra Kumar Misra SSL 29 49 0 18 Jun 2021
Bridging Multi-Task Learning and Meta-Learning: Towards Efficient Training and Effective Adaptation Haoxiang Wang Han Zhao Bo-wen Li 37 88 0 16 Jun 2021
Learning to See by Looking at Noise Manel Baradad Jonas Wulff Tongzhou Wang Phillip Isola Antonio Torralba 26 89 0 10 Jun 2021
Neighborhood Contrastive Learning Applied to Online Patient Monitoring Hugo Yèche Gideon Dresdner Francesco Locatello Matthias Huser Gunnar Rätsch 21 46 0 09 Jun 2021
Toward Understanding the Feature Learning Process of Self-supervised Contrastive Learning Zixin Wen Yuanzhi Li SSL MLT 26 131 0 31 May 2021
Backdoor Attacks on Self-Supervised Learning Aniruddha Saha Ajinkya Tejankar Soroush Abbasi Koohpayegani Hamed Pirsiavash SSL AAML 27 100 0 21 May 2021
Divide and Contrast: Self-supervised Learning from Uncurated Data Yonglong Tian Olivier J. Hénaff Aaron van den Oord SSL 56 96 0 17 May 2021
TCL: Transformer-based Dynamic Graph Modelling via Contrastive Learning Lu Wang Xiaofu Chang Shuang Li Yunfei Chu Hui Li Wei Zhang Xiaofeng He Le Song Jingren Zhou Hongxia Yang 21 51 0 17 May 2021
Contrastive Attraction and Contrastive Repulsion for Representation Learning Huangjie Zheng Xu Chen Jiangchao Yao Hongxia Yang Chunyuan Li Ya-Qin Zhang Hao Zhang Ivor Tsang Jingren Zhou Mingyuan Zhou SSL 42 12 0 08 May 2021
On Feature Decorrelation in Self-Supervised Learning Tianyu Hua Wenxiao Wang Zihui Xue Sucheng Ren Yue Wang Hang Zhao SSL OOD 124 187 0 02 May 2021
Disentangled Contrastive Learning for Learning Robust Textual Representations Xiang Chen Xin Xie Zhen Bi Hongbin Ye Shumin Deng Ningyu Zhang Huajun Chen 33 5 0 11 Apr 2021
Self-Supervised Learning for Gastritis Detection with Gastric X-ray Images Guang Li Ren Togo Takahiro Ogawa Miki Haseyama 20 11 0 07 Apr 2021
Contrastive Syn-to-Real Generalization Wuyang Chen Zhiding Yu Shalini De Mello Sifei Liu J. Álvarez Zhangyang Wang Anima Anandkumar 15 46 0 06 Apr 2021
Elsa: Energy-based learning for semi-supervised anomaly detection Sungwon Han Hyeonho Song Seungeon Lee Sungwon Park M. Cha 27 12 0 29 Mar 2021
Behavior From the Void: Unsupervised Active Pre-Training Hao Liu Pieter Abbeel VLM SSL 34 194 0 08 Mar 2021
CoDeGAN: Contrastive Disentanglement for Generative Adversarial Network Lili Pan Peijun Tang Zhiyong Chen Zenglin Xu GAN DRL 11 6 0 05 Mar 2021
Self-supervised Mean Teacher for Semi-supervised Chest X-ray Classification Fengbei Liu Yu Tian F. Cordeiro Vasileios Belagiannis Ian Reid G. Carneiro 21 42 0 05 Mar 2021
Barlow Twins: Self-Supervised Learning via Redundancy Reduction Jure Zbontar Li Jing Ishan Misra Yann LeCun Stéphane Deny SSL 57 2,287 0 04 Mar 2021
A Primer on Contrastive Pretraining in Language Processing: Methods, Lessons Learned and Perspectives Nils Rethmeier Isabelle Augenstein SSL VLM 90 90 0 25 Feb 2021
Learning Disentangled Representation by Exploiting Pretrained Generative Models: A Contrastive Learning View Xuanchi Ren Tao Yang Yuwang Wang W. Zeng CoGe OCL DRL 31 36 0 21 Feb 2021
On Fast Adversarial Robustness Adaptation in Model-Agnostic Meta-Learning Ren Wang Kaidi Xu Sijia Liu Pin-Yu Chen Tsui-Wei Weng Chuang Gan Meng Wang AAML 13 46 0 20 Feb 2021
Contrastive Learning Inverts the Data Generating Process Roland S. Zimmermann Yash Sharma Steffen Schneider Matthias Bethge Wieland Brendel SSL 238 207 0 17 Feb 2021
Understanding Negative Samples in Instance Discriminative Self-supervised Representation Learning Kento Nozawa Issei Sato SSL 20 43 0 13 Feb 2021
Addressing Feature Suppression in Unsupervised Visual Representations Tianhong Li Lijie Fan Yuan. Yuan Hao He Yonglong Tian Rogerio Feris Piotr Indyk Dina Katabi SSL 33 15 0 17 Dec 2020
Neural Collapse with Cross-Entropy Loss Jianfeng Lu Stefan Steinerberger MLT 16 65 0 15 Dec 2020