A Theoretical Analysis of Contrastive Unsupervised Representation Learning

25 February 2019

Papers citing "A Theoretical Analysis of Contrastive Unsupervised Representation Learning"

50 / 504 papers shown

Title
Limits of Model Selection under Transfer Learning Steve Hanneke Samory Kpotufe Yasaman Mahdaviyeh 42 6 0 29 Apr 2023
Sample-Specific Debiasing for Better Image-Text Models Peiqi Wang Yingcheng Liu Ching-Yun Ko W. Wells Seth Berkowitz Steven Horng Polina Golland SSL MedIm 22 1 0 25 Apr 2023
No Free Lunch in Self Supervised Representation Learning Ihab Bendidi Adrien Bardes E. Cohen Alexis Lamiable Guillaume Bollot Auguste Genovesio OOD 57 11 0 23 Apr 2023
Contrastive Tuning: A Little Help to Make Masked Autoencoders Forget Johannes Lehner Benedikt Alkin Andreas Fürst Elisabeth Rumetshofer Lukas Miklautz Sepp Hochreiter 36 18 0 20 Apr 2023
Denoising Cosine Similarity: A Theory-Driven Approach for Efficient Representation Learning Takumi Nakagawa Y. Sanada Hiroki Waida Yuhui Zhang Yuichiro Wada K. Takanashi Tomonori Yamada Takafumi Kanamori DiffM 19 5 0 19 Apr 2023
To Compress or Not to Compress- Self-Supervised Learning and Information Theory: A Review Ravid Shwartz-Ziv Yann LeCun SSL 40 72 0 19 Apr 2023
Looking Similar, Sounding Different: Leveraging Counterfactual Cross-Modal Pairs for Audiovisual Representation Learning Nikhil Singh Chih-Wei Wu Iroro Orife Mahdi M. Kalayeh 30 2 0 12 Apr 2023
InfoCTM: A Mutual Information Maximization Perspective of Cross-Lingual Topic Modeling Xiaobao Wu Xinshuai Dong Thong Nguyen Chaoqun Liu Liangming Pan Anh Tuan Luu 36 23 0 07 Apr 2023
Towards Understanding the Mechanism of Contrastive Learning via Similarity Structure: A Theoretical Analysis Hiroki Waida Yuichiro Wada Léo Andéol Takumi Nakagawa Yuhui Zhang Takafumi Kanamori SSL 31 5 0 01 Apr 2023
Self-Supervised Multimodal Learning: A Survey Yongshuo Zong Oisin Mac Aodha Timothy M. Hospedales SSL 24 44 0 31 Mar 2023
On the Stepwise Nature of Self-Supervised Learning James B. Simon Maksis Knutins Liu Ziyin Daniel Geisz Abraham J. Fetterman Joshua Albrecht SSL 37 30 0 27 Mar 2023
Contrastive Learning Is Spectral Clustering On Similarity Graph Zhi-Hao Tan Yifan Zhang Jingqin Yang Yang Yuan SSL 56 18 0 27 Mar 2023
Temperature Schedules for Self-Supervised Contrastive Methods on Long-Tail Data Anna Kukleva Moritz Bohle Bernt Schiele Hilde Kuehne Christian Rupprecht 36 40 0 23 Mar 2023
Multi-view Feature Extraction based on Triple Contrastive Heads Hongjie Zhang 11 0 0 22 Mar 2023
PRISE: Demystifying Deep Lucas-Kanade with Strongly Star-Convex Constraints for Multimodel Image Alignment Yiqing Zhang Xinming Huang Ziming Zhang 36 4 0 21 Mar 2023
Learning Audio-Visual Source Localization via False Negative Aware Contrastive Learning Weixuan Sun Jiayi Zhang Jianyuan Wang Zheyuan Liu Yiran Zhong Tianpeng Feng Yandong Guo Yanhao Zhang Nick Barnes SSL 27 44 0 20 Mar 2023
A Message Passing Perspective on Learning Dynamics of Contrastive Learning Yifei Wang Qi Zhang Tianqi Du Jiansheng Yang Zhouchen Lin Yisen Wang SSL 32 18 0 08 Mar 2023
MAST: Masked Augmentation Subspace Training for Generalizable Self-Supervised Priors Chen Huang Hanlin Goh Jiatao Gu J. Susskind SSL OOD 60 6 0 07 Mar 2023
CoRTX: Contrastive Framework for Real-time Explanation Yu-Neng Chuang Guanchu Wang Fan Yang Quan-Gen Zhou Pushkar Tripathi Xuanting Cai Xia Hu 46 20 0 05 Mar 2023
Towards a Unified Theoretical Understanding of Non-contrastive Learning via Rank Differential Mechanism Zhijian Zhuo Yifei Wang Jinwen Ma Yisen Wang 50 25 0 04 Mar 2023
On the Provable Advantage of Unsupervised Pretraining Jiawei Ge Shange Tang Jianqing Fan Chi Jin SSL 33 16 0 02 Mar 2023
ArCL: Enhancing Contrastive Learning with Augmentation-Robust Representations Xuyang Zhao Tianqi Du Yisen Wang Jun Yao Weiran Huang 38 13 0 02 Mar 2023
An Information-Theoretic Perspective on Variance-Invariance-Covariance Regularization Ravid Shwartz-Ziv Randall Balestriero Kenji Kawaguchi Tim G. J. Rudner Yann LeCun 38 23 0 01 Mar 2023
The Trade-off between Universality and Label Efficiency of Representations from Contrastive Learning Zhenmei Shi Jiefeng Chen Kunyang Li Jayaram Raghuram Xi Wu Yingyu Liang S. Jha SSL 30 18 0 28 Feb 2023
Membership Inference Attacks against Synthetic Data through Overfitting Detection B. V. Breugel Hao Sun Zhaozhi Qian M. Schaar 33 45 0 24 Feb 2023
Generalization Analysis for Contrastive Representation Learning Yunwen Lei Tianbao Yang Yiming Ying Ding-Xuan Zhou 28 8 0 24 Feb 2023
Generalization Bounds for Adversarial Contrastive Learning Xin Zou Weiwei Liu AAML 33 11 0 21 Feb 2023
DrasCLR: A Self-supervised Framework of Learning Disease-related and Anatomy-specific Representation for 3D Medical Images K. Yu Li Sun Junxiang Chen Maxwell Reynolds Tigmanshu Chaudhary Kayhan Batmanghelich 25 1 0 21 Feb 2023
Data-Efficient Contrastive Self-supervised Learning: Most Beneficial Examples for Supervised Learning Contribute the Least S. Joshi Baharan Mirzasoleiman SSL 35 20 0 18 Feb 2023
InfoNCE Loss Provably Learns Cluster-Preserving Representations Advait Parulekar Liam Collins Karthikeyan Shanmugam Aryan Mokhtari Sanjay Shakkottai SSL 34 20 0 15 Feb 2023
Cliff-Learning T. T. Wang I. Zablotchi Nir Shavit Jonathan S. Rosenfeld 44 0 0 14 Feb 2023
Understanding Multimodal Contrastive Learning and Incorporating Unpaired Data Ryumei Nakada Halil Ibrahim Gulluk Zhun Deng Wenlong Ji James Zou Linjun Zhang SSL VLM 42 37 0 13 Feb 2023
Multi-view Feature Extraction based on Dual Contrastive Head Hongjie Zhang 18 1 0 08 Feb 2023
Evaluating Self-Supervised Learning via Risk Decomposition Yann Dubois Tatsunori Hashimoto Percy Liang 14 9 0 06 Feb 2023
The SSL Interplay: Augmentations, Inductive Bias, and Generalization Vivien A. Cabannes B. Kiani Randall Balestriero Yann LeCun A. Bietti SSL 24 31 0 06 Feb 2023
Multi-View Masked World Models for Visual Robotic Manipulation Younggyo Seo Junsup Kim Stephen James Kimin Lee Jinwoo Shin Pieter Abbeel VGen 25 56 0 05 Feb 2023
Revisiting Discriminative vs. Generative Classifiers: Theory and Implications Chenyu Zheng Guoqiang Wu Fan Bao Yue Cao Chongxuan Li Jun Zhu BDL 33 30 0 05 Feb 2023
Hyperbolic Contrastive Learning Yun Yue Fangzhou Lin Kazunori D Yamada Ziming Zhang SSL 35 18 0 02 Feb 2023
Deciphering the Projection Head: Representation Evaluation Self-supervised Learning Jiajun Ma Tianyang Hu Wei Cao 23 8 0 28 Jan 2023
Bayesian Self-Supervised Contrastive Learning B. Liu Bang-wei Wang Tianrui Li SSL BDL 29 4 0 27 Jan 2023
Few-shot Font Generation by Learning Style Difference and Similarity Xiao He Mingrui Zhu N. Wang Xinbo Gao Heng Yang 17 8 0 24 Jan 2023
Optimizing the Noise in Self-Supervised Learning: from Importance Sampling to Noise-Contrastive Estimation O. Chehab Alexandre Gramfort Aapo Hyvarinen SSL 38 3 0 23 Jan 2023
A Survey on Self-supervised Learning: Algorithms, Applications, and Future Trends Jie Gui Tuo Chen Jing Zhang Qiong Cao Zhe Sun Haoran Luo Dacheng Tao 31 130 0 13 Jan 2023
GEDI: GEnerative and DIscriminative Training for Self-Supervised Learning Emanuele Sansone Robin Manhaeve SSL 20 9 0 27 Dec 2022
NBC-Softmax : Darkweb Author fingerprinting and migration tracking Gayan K. Kulatilleke Shekhar S. Chandra Marius Portmann 44 0 0 15 Dec 2022
Statistical Physics of Deep Neural Networks: Initialization toward Optimal Channels Kangyu Weng Aohua Cheng Ziyang Zhang Pei Sun Yang Tian 53 2 0 04 Dec 2022
On the Power of Foundation Models Yang Yuan 23 36 0 29 Nov 2022
A Theoretical Study of Inductive Biases in Contrastive Learning Jeff Z. HaoChen Tengyu Ma UQCV SSL 36 31 0 27 Nov 2022
Ladder Siamese Network: a Method and Insights for Multi-level Self-Supervised Learning Ryota Yoshihashi Shuhei Nishimura Dai Yonebayashi Yuya Otsuka Tomohiro Tanaka Takashi Miyazaki SSL 26 2 0 25 Nov 2022
Few-shot Object Detection with Refined Contrastive Learning Zeyu Shangguan Lian Huai Tong Liu Xingqun Jiang 25 7 0 24 Nov 2022