A Theoretical Analysis of Contrastive Unsupervised Representation Learning

25 February 2019

Papers citing "A Theoretical Analysis of Contrastive Unsupervised Representation Learning"

50 / 504 papers shown

Title
Towards Generalizable Graph Contrastive Learning: An Information Theory Perspective Yige Yuan Bingbing Xu Huawei Shen Qi Cao Keting Cen Wen Zheng Xueqi Cheng 24 13 0 20 Nov 2022
Single-Pass Contrastive Learning Can Work for Both Homophilic and Heterophilic Graph Hong Wang Jieyu Zhang Qi Zhu Wei Huang Kenji Kawaguchi X. Xiao 39 11 0 20 Nov 2022
Weighted Ensemble Self-Supervised Learning Yangjun Ruan Saurabh Singh Warren Morningstar Alexander A. Alemi Sergey Ioffe Ian S. Fischer Joshua V. Dillon FedML 29 15 0 18 Nov 2022
Homomorphic Self-Supervised Learning Thomas Anderson Keller Xavier Suau Luca Zappella SSL 21 2 0 15 Nov 2022
PMR: Prototypical Modal Rebalance for Multimodal Learning Yunfeng Fan Wenchao Xu Yining Qi Junxiao Wang Song Guo 32 62 0 14 Nov 2022
Clinical Contrastive Learning for Biomarker Detection Kiran Kokilepersaud Mohit Prabhushankar Ghassan AlRegib 38 4 0 09 Nov 2022
Embed and Emulate: Learning to estimate parameters of dynamical systems with uncertainty quantification Ruoxi Jiang Rebecca Willett 25 6 0 03 Nov 2022
Beyond Instance Discrimination: Relation-aware Contrastive Self-supervised Learning Yifei Zhang Chang-rui Liu Yu Zhou Weiping Wang QiXiang Ye Xiangyang Ji SSL ISeg BDL 26 6 0 02 Nov 2022
Augmentation Invariant Manifold Learning Shulei Wang 45 1 0 01 Nov 2022
Adaptive Speech Quality Aware Complex Neural Network for Acoustic Echo Cancellation with Supervised Contrastive Learning Bozhong Liu Xiaoxi Yu Hantao Huang 28 0 0 30 Oct 2022
Spectral Representation Learning for Conditional Moment Models Ziyu Wang Yucen Luo Yueru Li Jun Zhu Bernhard Schölkopf CML 41 7 0 29 Oct 2022
Same Pre-training Loss, Better Downstream: Implicit Bias Matters for Language Models Hong Liu Sang Michael Xie Zhiyuan Li Tengyu Ma AI4CE 40 49 0 25 Oct 2022
The Curious Case of Benign Memorization Sotiris Anagnostidis Gregor Bachmann Lorenzo Noci Thomas Hofmann AAML 54 8 0 25 Oct 2022
Global Contrastive Batch Sampling via Optimization on Sample Permutations Vin Sachidananda Ziyi Yang Chenguang Zhu 24 5 0 23 Oct 2022
Neural Eigenfunctions Are Structured Representation Learners Zhijie Deng Jiaxin Shi Hao Zhang Peng Cui Cewu Lu Jun Zhu 58 14 0 23 Oct 2022
Does Learning from Decentralized Non-IID Unlabeled Data Benefit from Self Supervision? Lirui Wang Kaipeng Zhang Yunzhu Li Yonglong Tian Russ Tedrake 34 16 0 20 Oct 2022
MedCLIP: Contrastive Learning from Unpaired Medical Images and Text Zifeng Wang Zhenbang Wu Dinesh Agarwal Jimeng Sun CLIP VLM MedIm 49 402 0 18 Oct 2022
Multiple Instance Learning via Iterative Self-Paced Supervised Contrastive Learning Kangning Liu Weicheng Zhu Yiqiu Shen Sheng Liu N. Razavian Krzysztof J. Geras C. Fernandez‐Granda SSL 28 25 0 17 Oct 2022
Correlation between Alignment-Uniformity and Performance of Dense Contrastive Representations Jong Hak Moon Wonjae Kim Edward Choi 26 3 0 17 Oct 2022
Learning Self-Regularized Adversarial Views for Self-Supervised Vision Transformers Tao Tang Changlin Li Guangrun Wang Kaicheng Yu Xiaojun Chang Xiaodan Liang ViT 33 1 0 16 Oct 2022
How Mask Matters: Towards Theoretical Understandings of Masked Autoencoders Qi Zhang Yifei Wang Yisen Wang 28 73 0 15 Oct 2022
Linear Video Transformer with Feature Fixation Kaiyue Lu Zexia Liu Jianyuan Wang Weixuan Sun Zhen Qin ... Xuyang Shen Huizhong Deng Xiaodong Han Yuchao Dai Yiran Zhong 35 4 0 15 Oct 2022
The Hidden Uniform Cluster Prior in Self-Supervised Learning Mahmoud Assran Randall Balestriero Quentin Duval Florian Bordes Ishan Misra Piotr Bojanowski Pascal Vincent Michael G. Rabbat Nicolas Ballas SSL 52 47 0 13 Oct 2022
A Kernel-Based View of Language Model Fine-Tuning Sadhika Malladi Alexander Wettig Dingli Yu Danqi Chen Sanjeev Arora VLM 78 62 0 11 Oct 2022
Contrastive Learning Can Find An Optimal Basis For Approximately View-Invariant Functions Daniel D. Johnson Ayoub El Hanchi Chris J. Maddison SSL 24 22 0 04 Oct 2022
What shapes the loss landscape of self-supervised learning? Liu Ziyin Ekdeep Singh Lubana Masakuni Ueda Hidenori Tanaka 52 20 0 02 Oct 2022
Contrastive Corpus Attribution for Explaining Representations Christy Lin Hugh Chen Chanwoo Kim Su-In Lee SSL 27 8 0 30 Sep 2022
Minimalistic Unsupervised Learning with the Sparse Manifold Transform Yubei Chen Zeyu Yun Yi Ma Bruno A. Olshausen Yann LeCun 54 8 0 30 Sep 2022
Few-shot Text Classification with Dual Contrastive Consistency Liwen Sun Jiawei Han 27 0 0 29 Sep 2022
Joint Embedding Self-Supervised Learning in the Kernel Regime B. Kiani Randall Balestriero Yubei Chen S. Lloyd Yann LeCun SSL 49 13 0 29 Sep 2022
Efficient block contrastive learning via parameter-free meta-node approximation Gayan K. Kulatilleke Marius Portmann Shekhar S. Chandra 29 3 0 28 Sep 2022
Mine yOur owN Anatomy: Revisiting Medical Image Segmentation with Extremely Limited Labels Chenyu You Weicheng Dai Fenglin Liu Yifei Min Haoran Su Xiaoran Zhang Xiaoxiao Li David Clifton Lawrence H. Staib James S. Duncan 53 50 0 27 Sep 2022
Dive into Self-Supervised Learning for Medical Image Analysis: Data, Models and Tasks Chuyan Zhang Yun Gu 35 0 0 25 Sep 2022
Improving Self-Supervised Learning by Characterizing Idealized Representations Yann Dubois Tatsunori Hashimoto Stefano Ermon Percy Liang SSL 83 41 0 13 Sep 2022
Blessing of Class Diversity in Pre-training Yulai Zhao Jianshu Chen S. Du AI4CE 26 3 0 07 Sep 2022
Measuring the Interpretability of Unsupervised Representations via Quantized Reverse Probing Iro Laina Yuki M. Asano Andrea Vedaldi SSL 21 8 0 07 Sep 2022
Robust and Efficient Imbalanced Positive-Unlabeled Learning with Self-supervision Emilio Dorigatti Jonas Schweisthal Bernd Bischl Mina Rezaei OOD 24 2 0 06 Sep 2022
Supervised Contrastive Learning with Hard Negative Samples Ruijie Jiang Thuan Q. Nguyen Prakash Ishwar Shuchin Aeron 29 16 0 31 Aug 2022
Contrastive Audio-Language Learning for Music Ilaria Manco Emmanouil Benetos Elio Quinton Gyorgy Fazekas 27 44 0 25 Aug 2022
Siamese Prototypical Contrastive Learning Shentong Mo Zhun Sun Chao Li SSL 27 12 0 18 Aug 2022
Enhancing Graph Contrastive Learning with Node Similarity Hongliang Chi Yao Ma SSL 39 3 0 13 Aug 2022
Analyzing Data-Centric Properties for Graph Contrastive Learning Puja Trivedi Ekdeep Singh Lubana Mark Heimann Danai Koutra Jayaraman J. Thiagarajan 30 11 0 04 Aug 2022
MemSAC: Memory Augmented Sample Consistency for Large Scale Unsupervised Domain Adaptation Tarun Kalluri Astuti Sharma Manmohan Chandraker 28 18 0 25 Jul 2022
Adaptive Soft Contrastive Learning Chen Feng Ioannis Patras SSL 25 19 0 22 Jul 2022
What Do We Maximize in Self-Supervised Learning? Ravid Shwartz-Ziv Randall Balestriero Yann LeCun SSL 34 17 0 20 Jul 2022
Domain Confused Contrastive Learning for Unsupervised Domain Adaptation Quanyu Long Tianze Luo Wenya Wang Sinno Jialin Pan 59 8 0 10 Jul 2022
Interventional Contrastive Learning with Meta Semantic Regularizer Jingyao Wang Jiangmeng Li Changwen Zheng Fuchun Sun Hui Xiong 26 23 0 29 Jun 2022
Improving self-supervised pretraining models for epileptic seizure detection from EEG data Sudip Das Pankaja Pandey Krishna P. Miyapuram MedIm 21 4 0 28 Jun 2022
Similarity-aware Positive Instance Sampling for Graph Contrastive Pre-training Xueyi Liu Yu Rong Tingyang Xu Gang Hua Wen-bing Huang Junzhou Huang 21 0 0 23 Jun 2022
On Finite-Sample Identifiability of Contrastive Learning-Based Nonlinear Independent Component Analysis Qi Lyu Xiao Fu CML 31 4 0 14 Jun 2022