A Theoretical Analysis of Contrastive Unsupervised Representation Learning

25 February 2019

Papers citing "A Theoretical Analysis of Contrastive Unsupervised Representation Learning"

50 / 504 papers shown

Title
Medical Image Segmentation with Limited Supervision: A Review of Deep Network Models Jialin Peng Ye Wang VLM 14 58 0 28 Feb 2021
A Primer on Contrastive Pretraining in Language Processing: Methods, Lessons Learned and Perspectives Nils Rethmeier Isabelle Augenstein SSL VLM 96 91 0 25 Feb 2021
Provably Improved Context-Based Offline Meta-RL with Attention and Contrastive Learning Lanqing Li Yuanhao Huang Mingzhe Chen Siteng Luo Dijun Luo Junzhou Huang OffRL 13 3 0 22 Feb 2021
Contrastive Learning Inverts the Data Generating Process Roland S. Zimmermann Yash Sharma Steffen Schneider Matthias Bethge Wieland Brendel SSL 238 209 0 17 Feb 2021
Dissecting Supervised Contrastive Learning Florian Graf Christoph Hofer Marc Niethammer Roland Kwitt SSL 117 70 0 17 Feb 2021
Learning Invariant Representations using Inverse Contrastive Loss A. K. Akash Vishnu Suresh Lokhande Sathya Ravi Vikas Singh SSL 21 8 0 16 Feb 2021
Understanding Negative Samples in Instance Discriminative Self-supervised Representation Learning Kento Nozawa Issei Sato SSL 22 43 0 13 Feb 2021
Understanding self-supervised Learning Dynamics without Contrastive Pairs Yuandong Tian Xinlei Chen Surya Ganguli SSL 138 281 0 12 Feb 2021
Generalization Bounds for Meta-Learning via PAC-Bayes and Uniform Stability Alec Farid Anirudha Majumdar 27 34 0 12 Feb 2021
MirrorAlign: A Super Lightweight Unsupervised Word Alignment Model via Cross-Lingual Contrastive Learning Di Wu Liang Ding Shuo Yang Mingyang Li 32 7 0 08 Feb 2021
Exploring Deep Neural Networks via Layer-Peeled Model: Minority Collapse in Imbalanced Training Cong Fang Hangfeng He Qi Long Weijie J. Su FAtt 132 168 0 29 Jan 2021
BENDR: using transformers and a contrastive self-supervised learning task to learn from massive amounts of EEG data Demetres Kostas Stephane Aroca-Ouellette Frank Rudzicz SSL 54 203 0 28 Jan 2021
Calibrating and Improving Graph Contrastive Learning Kaili Ma Haochen Yang Han Yang Yongqiang Chen James Cheng 49 6 0 27 Jan 2021
Training Deep Architectures Without End-to-End Backpropagation: A Survey on the Provably Optimal Methods Shiyu Duan José C. Príncipe MQ 38 3 0 09 Jan 2021
Evolution Is All You Need: Phylogenetic Augmentation for Contrastive Learning Amy X. Lu Alex X. Lu Alan M. Moses SSL 36 13 0 25 Dec 2020
Social NCE: Contrastive Learning of Socially-aware Motion Representations Yuejiang Liu Qi Yan Alexandre Alahi 31 101 0 21 Dec 2020
Trex: Learning Execution Semantics from Micro-Traces for Binary Similarity Kexin Pei Zhou Xuan Junfeng Yang Suman Jana Baishakhi Ray 27 88 0 16 Dec 2020
Wasserstein Contrastive Representation Distillation Liqun Chen Dong Wang Zhe Gan Jingjing Liu Ricardo Henao Lawrence Carin 23 93 0 15 Dec 2020
Understanding the Behaviour of Contrastive Loss Feng Wang Huaping Liu SSL 61 668 0 15 Dec 2020
Self-supervised Text-independent Speaker Verification using Prototypical Momentum Contrastive Learning Wei Xia Chunlei Zhang Chao Weng Meng Yu Dong Yu SSL 20 78 0 13 Dec 2020
About contrastive unsupervised representation learning for classification and its convergence Ibrahim Merad Yiyang Yu Emmanuel Bacry Stéphane Gaïffas SSL 34 1 0 02 Dec 2020
Revisiting Unsupervised Meta-Learning via the Characteristics of Few-Shot Tasks Han-Jia Ye Lu Han De-Chuan Zhan OffRL SSL VLM 27 27 0 30 Nov 2020
Intriguing Properties of Contrastive Losses Ting Chen Calvin Luo Lala Li 36 174 0 05 Nov 2020
Learning and Evaluating Representations for Deep One-class Classification Kihyuk Sohn Chun-Liang Li Jinsung Yoon Minho Jin Tomas Pfister SSL 14 199 0 04 Nov 2020
Supervised Contrastive Learning for Pre-trained Language Model Fine-tuning Beliz Gunel Jingfei Du Alexis Conneau Ves Stoyanov 18 499 0 03 Nov 2020
A Survey on Contrastive Self-supervised Learning Ashish Jaiswal Ashwin Ramesh Babu Mohammad Zaki Zadeh Debapriya Banerjee F. Makedon SSL 54 1,360 0 31 Oct 2020
Reinforcement Learning for Sparse-Reward Object-Interaction Tasks in a First-person Simulated 3D Environment Wilka Carvalho Anthony Liang Kimin Lee Sungryull Sohn Honglak Lee Richard L. Lewis Satinder Singh OffRL 18 9 0 28 Oct 2020
An Investigation of how Label Smoothing Affects Generalization Blair Chen Liu Ziyin Zihao Wang Paul Pu Liang UQCV 21 17 0 23 Oct 2020
Contrastive Learning with Adversarial Examples Chih-Hui Ho Nuno Vasconcelos SSL 27 140 0 22 Oct 2020
i-Mix: A Domain-Agnostic Strategy for Contrastive Representation Learning Kibok Lee Yian Zhu Kihyuk Sohn Chun-Liang Li Jinwoo Shin Honglak Lee SSL 33 26 0 17 Oct 2020
For self-supervised learning, Rationality implies generalization, provably Yamini Bansal Gal Kaplun Boaz Barak OOD SSL 60 22 0 16 Oct 2020
Auxiliary Task Reweighting for Minimum-data Learning Baifeng Shi Judy Hoffman Kate Saenko Trevor Darrell Huijuan Xu MoMe 27 32 0 16 Oct 2020
Representation Learning via Invariant Causal Mechanisms Jovana Mitrović Brian McWilliams Jacob Walker Lars Buesing Charles Blundell CML OOD SSL 31 247 0 15 Oct 2020
Theoretical bounds on estimation error for meta-learning James Lucas Mengye Ren Irene Kameni T. Pitassi R. Zemel 25 12 0 14 Oct 2020
Function Contrastive Learning of Transferable Meta-Representations Muhammad Waleed Gondal S. Joshi Nasim Rahaman Stefan Bauer Manuel Wüthrich Bernhard Schölkopf SSL 18 19 0 14 Oct 2020
Are all negatives created equal in contrastive instance discrimination? Tiffany Cai Jonathan Frankle D. Schwab Ari S. Morcos SSL 8 81 0 13 Oct 2020
Impact of Representation Learning in Linear Bandits Jiaqi Yang Wei Hu Jason D. Lee S. Du 27 53 0 13 Oct 2020
Contrastive Representation Learning: A Framework and Review Phúc H. Lê Khắc Graham Healy Alan F. Smeaton SSL AI4TS 184 687 0 10 Oct 2020
Contrastive Learning with Hard Negative Samples Joshua Robinson Ching-Yao Chuang S. Sra Stefanie Jegelka SSL 75 759 0 09 Oct 2020
A Mathematical Exploration of Why Language Models Help Solve Downstream Tasks Nikunj Saunshi Sadhika Malladi Sanjeev Arora 25 87 0 07 Oct 2020
Theoretical Analysis of Self-Training with Deep Networks on Unlabeled Data Colin Wei Kendrick Shen Yining Chen Tengyu Ma SSL 23 225 0 07 Oct 2020
InfoBERT: Improving Robustness of Language Models from An Information Theoretic Perspective Wei Ping Shuohang Wang Yu Cheng Zhe Gan R. Jia Bo-wen Li Jingjing Liu AAML 46 113 0 05 Oct 2020
CO2: Consistent Contrast for Unsupervised Visual Representation Learning Chen Wei Huiyu Wang Wei Shen Alan Yuille SSL 36 62 0 05 Oct 2020
EqCo: Equivalent Rules for Self-supervised Contrastive Learning Benjin Zhu Junqiang Huang Zeming Li Xiangyu Zhang Jian Sun SSL 22 13 0 05 Oct 2020
Data-Efficient Pretraining via Contrastive Self-Supervision Nils Rethmeier Isabelle Augenstein 28 20 0 02 Oct 2020
Hard Negative Mixing for Contrastive Learning Yannis Kalantidis Mert Bulent Sariyildiz Noé Pion Philippe Weinzaepfel Diane Larlus SSL 53 628 0 02 Oct 2020
XDA: Accurate, Robust Disassembly with Transfer Learning Kexin Pei Jonas Guan David Williams-King Junfeng Yang Suman Jana 9 58 0 02 Oct 2020
Understanding Self-supervised Learning with Dual Deep Networks Yuandong Tian Lantao Yu Xinlei Chen Surya Ganguli SSL 13 78 0 01 Oct 2020
Open-Set Hypothesis Transfer with Semantic Consistency Zeyu Feng Chang Xu Dacheng Tao 16 12 0 01 Oct 2020
Contrastive Distillation on Intermediate Representations for Language Model Compression S. Sun Zhe Gan Yu Cheng Yuwei Fang Shuohang Wang Jingjing Liu VLM 28 69 0 29 Sep 2020