Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hypersphere

20 May 2020

Papers citing "Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hypersphere"

50 / 325 papers shown

Title
Prompt Pre-Training with Twenty-Thousand Classes for Open-Vocabulary Visual Recognition Shuhuai Ren Aston Zhang Yi Zhu Shuai Zhang Shuai Zheng Mu Li Alexander J. Smola Xu Sun VPVLM VLM 21 28 0 10 Apr 2023
Optimal Goal-Reaching Reinforcement Learning via Quasimetric Learning Tongzhou Wang Antonio Torralba Phillip Isola Amy Zhang OffRL 29 31 0 03 Apr 2023
Accelerating exploration and representation learning with offline pre-training Bogdan Mazoure Jake Bruce Doina Precup Rob Fergus Ankit Anand OffRL 31 5 0 31 Mar 2023
On the Stepwise Nature of Self-Supervised Learning James B. Simon Maksis Knutins Liu Ziyin Daniel Geisz Abraham J. Fetterman Joshua Albrecht SSL 32 29 0 27 Mar 2023
Preventing Dimensional Collapse of Incomplete Multi-View Clustering via Direct Contrastive Learning Kaiwu Zhang Shiqiang Du Bao-Yu Liu Shengxia Gao 17 0 0 22 Mar 2023
PRISE: Demystifying Deep Lucas-Kanade with Strongly Star-Convex Constraints for Multimodel Image Alignment Yiqing Zhang Xinming Huang Ziming Zhang 36 4 0 21 Mar 2023
Generalizing and Decoupling Neural Collapse via Hyperspherical Uniformity Gap Weiyang Liu L. Yu Adrian Weller Bernhard Schölkopf 37 17 0 11 Mar 2023
Improving Self-Supervised Learning for Audio Representations by Feature Diversity and Decorrelation Bac Nguyen Stefan Uhlich Fabien Cardinaux SSL 42 3 0 07 Mar 2023
Learning Common Rationale to Improve Self-Supervised Representation for Fine-Grained Visual Recognition Problems Yangyang Shu Anton Van Den Hengel Lingqiao Liu SSL 30 14 0 03 Mar 2023
Amortised Invariance Learning for Contrastive Self-Supervision Ruchika Chavhan H. Gouk Jan Stuehmer Calum Heggan Mehrdad Yaghoobi Timothy M. Hospedales SSL 40 11 0 24 Feb 2023
Steerable Equivariant Representation Learning Sangnie Bhardwaj Willie McClinton Tongzhou Wang Guillaume Lajoie Chen Sun Phillip Isola Dilip Krishnan OOD LLMSV 31 5 0 22 Feb 2023
Contrastive Representation Learning for Acoustic Parameter Estimation Philipp Götz Cagdas Tuna Andreas Walther Emanuel Habets SSL 17 7 0 22 Feb 2023
Unsupervised Learning on a DIET: Datum IndEx as Target Free of Self-Supervision, Reconstruction, Projector Head Randall Balestriero 38 3 0 20 Feb 2023
Detecting Contextomized Quotes in News Headlines by Contrastive Learning Seonyeong Song Hyeonho Song Kunwoo Park Jiyoung Han M. Cha 19 1 0 09 Feb 2023
Multi-view Feature Extraction based on Dual Contrastive Head Hongjie Zhang 18 1 0 08 Feb 2023
Aggregation of Disentanglement: Reconsidering Domain Variations in Domain Generalization Daoan Zhang Mingkai Chen Chenming Li Lingyun Huang Jianguo Zhang OOD 21 9 0 05 Feb 2023
Contrastive Learning with Consistent Representations Zihu Wang Yu Wang Hanbin Hu Peng Li CLL 26 5 0 03 Feb 2023
Mutual Wasserstein Discrepancy Minimization for Sequential Recommendation Ziwei Fan Zhiwei Liu Hao Peng Philip S Yu 29 15 0 28 Jan 2023
Deciphering the Projection Head: Representation Evaluation Self-supervised Learning Jiajun Ma Tianyang Hu Wenjia Wang 17 8 0 28 Jan 2023
Bayesian Self-Supervised Contrastive Learning B. Liu Bang-wei Wang Tianrui Li SSL BDL 21 4 0 27 Jan 2023
Simplifying Open-Set Video Domain Adaptation with Contrastive Learning Giacomo Zara Victor G. Turrisi da Costa Subhankar Roy Paolo Rota Elisa Ricci 38 1 0 09 Jan 2023
Learning the Relation between Similarity Loss and Clustering Loss in Self-Supervised Learning Jidong Ge YuXiang Liu Jie Gui Lanting Fang Ming Lin James T. Kwok LiGuo Huang B. Luo SSL 16 5 0 08 Jan 2023
Transferring Pre-trained Multimodal Representations with Cross-modal Similarity Matching Byoungjip Kim Sun Choi Dasol Hwang Moontae Lee Honglak Lee 27 10 0 07 Jan 2023
Learning Decorrelated Representations Efficiently Using Fast Fourier Transform Yutaro Shigeto Masashi Shimbo Yuya Yoshikawa A. Takeuchi 19 0 0 04 Jan 2023
GEDI: GEnerative and DIscriminative Training for Self-Supervised Learning Emanuele Sansone Robin Manhaeve SSL 20 9 0 27 Dec 2022
Principled and Efficient Transfer Learning of Deep Models via Neural Collapse Xiao Li Sheng Liu Jin-li Zhou Xin Lu C. Fernandez‐Granda Zhihui Zhu Q. Qu AAML 28 18 0 23 Dec 2022
Similarity Contrastive Estimation for Image and Video Soft Contrastive Self-Supervised Learning J. Denize Jaonary Rabarisoa Astrid Orcesi Romain Hérault SSL 19 6 0 21 Dec 2022
NBC-Softmax : Darkweb Author fingerprinting and migration tracking Gayan K. Kulatilleke Shekhar S. Chandra Marius Portmann 36 0 0 15 Dec 2022
MA-GCL: Model Augmentation Tricks for Graph Contrastive Learning Xumeng Gong Cheng Yang Chuan Shi VLM 22 41 0 14 Dec 2022
Spectral Feature Augmentation for Graph Contrastive Learning and Beyond Yifei Zhang Hao Zhu Zixing Song Piotr Koniusz Irwin King 39 87 0 02 Dec 2022
CL4CTR: A Contrastive Learning Framework for CTR Prediction Fang Wang Yingxu Wang Dongsheng Li Hansu Gu T. Lu Peng-Zhen Zhang Ning Gu SSL 20 42 0 01 Dec 2022
Task Discovery: Finding the Tasks that Neural Networks Generalize on Andrei Atanov Andrei Filatov Teresa Yeo Ajay Sohmshetty Amir Zamir OOD 40 10 0 01 Dec 2022
A Novel Semisupervised Contrastive Regression Framework for Forest Inventory Mapping with Multisensor Satellite Data Shaojia Ge Hong Gu W. Su Anne Lonnqvist O. Antropov 30 4 0 01 Dec 2022
Improved Representation of Asymmetrical Distances with Interval Quasimetric Embeddings Tongzhou Wang Phillip Isola 19 6 0 28 Nov 2022
Pose-disentangled Contrastive Learning for Self-supervised Facial Representation Y. Liu Wenbin Wang Yibing Zhan Shaoze Feng Li-Yu Daisy Liu Zhe Chen SSL 14 13 0 24 Nov 2022
Delving into Out-of-Distribution Detection with Vision-Language Representations Yifei Ming Ziyan Cai Jiuxiang Gu Yiyou Sun W. Li Yixuan Li VLM OODD 45 157 0 24 Nov 2022
Cross-Modal Contrastive Learning for Robust Reasoning in VQA Qinjie Zheng Chaoyue Wang Daqing Liu Dadong Wang Dacheng Tao LRM 29 0 0 21 Nov 2022
Self-Supervised Visual Representation Learning via Residual Momentum T. Pham Axi Niu Zhang Kang Sultan Rizky Hikmawan Madjid Jiajing Hong Daehyeok Kim Joshua Tian Jin Tee Chang-Dong Yoo SSL 46 6 0 17 Nov 2022
Self-supervised remote sensing feature learning: Learning Paradigms, Challenges, and Future Works Chao Tao Ji Qi Mingning Guo Qing Zhu Haifeng Li SSL 24 56 0 15 Nov 2022
The Role of Local Alignment and Uniformity in Image-Text Contrastive Learning on Medical Images Philip Muller Georgios Kaissis Daniel Rueckert MedIm 21 7 0 14 Nov 2022
Contrastive learning for regression in multi-site brain age prediction C. Barbano Benoit Dufumier Edouard Duchesnay Marco Grangetto Pietro Gori 22 14 0 14 Nov 2022
Self-supervised learning of audio representations using angular contrastive loss Shanshan Wang S. Tripathy A. Mesaros SSL 24 4 0 10 Nov 2022
Contrastive Value Learning: Implicit Models for Simple Offline RL Bogdan Mazoure Benjamin Eysenbach Ofir Nachum Jonathan Tompson SSL OffRL 35 7 0 03 Nov 2022
Adversarial Auto-Augment with Label Preservation: A Representation Learning Principle Guided Approach Kaiwen Yang Yanchao Sun Jiahao Su Fengxiang He Xinmei Tian Furong Huang Tianyi Zhou Dacheng Tao 35 13 0 02 Nov 2022
SDCL: Self-Distillation Contrastive Learning for Chinese Spell Checking Xiaotian Zhang Hang Yan Sun Yu Xipeng Qiu 24 4 0 31 Oct 2022
A simple, efficient and scalable contrastive masked autoencoder for learning visual representations Shlok Kumar Mishra Joshua Robinson Huiwen Chang David Jacobs Aaron Sarna Aaron Maschinot Dilip Krishnan DiffM 43 30 0 30 Oct 2022
Discriminative Speaker Representation via Contrastive Learning with Class-Aware Attention in Angular Space Zhe Li Man-Wai Mak Helen M. Meng 26 9 0 29 Oct 2022
COCO-DR: Combating Distribution Shifts in Zero-Shot Dense Retrieval with Contrastive and Distributionally Robust Learning Yue Yu Chenyan Xiong Si Sun Chao Zhang Arnold Overwijk VLM OOD 50 22 0 27 Oct 2022
Bootstrapping meaning through listening: Unsupervised learning of spoken sentence embeddings Jian Zhu Zuoyu Tian Yadong Liu Cong Zhang Chia-wen Lo SSL 32 2 0 23 Oct 2022
Self-Supervised Learning via Maximum Entropy Coding Xin Liu Zhongdao Wang Yali Li Shengjin Wang SSL 24 40 0 20 Oct 2022