A Theoretical Analysis of Contrastive Unsupervised Representation Learning

25 February 2019

Papers citing "A Theoretical Analysis of Contrastive Unsupervised Representation Learning"

50 / 504 papers shown

Title
Don't miss the Mismatch: Investigating the Objective Function Mismatch for Unsupervised Representation Learning Bonifaz Stuhr Jürgen Brauer 32 1 0 04 Sep 2020
Active Contrastive Learning of Audio-Visual Video Representations Shuang Ma Zhaoyang Zeng Daniel J. McDuff Yale Song VLM SSL 24 8 0 31 Aug 2020
Self-supervised Video Representation Learning by Uncovering Spatio-temporal Statistics Jiangliu Wang Jianbo Jiao Linchao Bao Shengfeng He Wei Liu Yunhui Liu SSL AI4TS 21 55 0 31 Aug 2020
Delving into Inter-Image Invariance for Unsupervised Visual Representations Jiahao Xie Xiaohang Zhan Ziwei Liu Yew-Soon Ong Chen Change Loy SSL VLM 21 58 0 26 Aug 2020
Contrastive learning, multi-view redundancy, and linear models Christopher Tosh A. Krishnamurthy Daniel J. Hsu SSL 35 163 0 24 Aug 2020
Functional Regularization for Representation Learning: A Unified Theoretical Perspective Siddhant Garg Yingyu Liang SSL 8 19 0 06 Aug 2020
Predicting What You Already Know Helps: Provable Self-Supervised Learning J. Lee Qi Lei Nikunj Saunshi Jiacheng Zhuo SSL 19 186 0 03 Aug 2020
On Learning Universal Representations Across Languages Xiangpeng Wei Rongxiang Weng Yue Hu Luxi Xing Heng Yu Weihua Luo SSL VLM 33 85 0 31 Jul 2020
Few-shot Visual Reasoning with Meta-analogical Contrastive Learning Youngsung Kim Jinwoo Shin Eunho Yang Sung Ju Hwang NAI 6 25 0 23 Jul 2020
Slot Contrastive Networks: A Contrastive Approach for Representing Objects Evan Racah Sarath Chandar OCL DRL 21 14 0 18 Jul 2020
Representation Learning via Adversarially-Contrastive Optimal Transport A. Cherian Shuchin Aeron OT 4 7 0 11 Jul 2020
Contrastive Code Representation Learning Paras Jain Ajay Jain Tianjun Zhang Pieter Abbeel Joseph E. Gonzalez Ion Stoica SSL DRL 34 149 0 09 Jul 2020
Debiased Contrastive Learning Ching-Yao Chuang Joshua Robinson Yen-Chen Lin Antonio Torralba Stefanie Jegelka SSL 19 553 0 01 Jul 2020
A No-Free-Lunch Theorem for MultiTask Learning Steve Hanneke Samory Kpotufe 20 39 0 29 Jun 2020
FLAMBE: Structural Complexity and Representation Learning of Low Rank MDPs Alekh Agarwal Sham Kakade A. Krishnamurthy Wen Sun OffRL 41 223 0 18 Jun 2020
Supervision Accelerates Pre-training in Contrastive Semi-Supervised Learning of Visual Representations Mahmoud Assran Nicolas Ballas Lluis Castrejon Michael G. Rabbat SSL 8 3 0 18 Jun 2020
Self-supervised Learning: Generative or Contrastive Xiao Liu Fanjin Zhang Zhenyu Hou Zhaoyu Wang Li Mian Jing Zhang Jie Tang SSL 52 1,587 0 15 Jun 2020
Bootstrap your own latent: A new approach to self-supervised Learning Jean-Bastien Grill Florian Strub Florent Altché Corentin Tallec Pierre Harvey Richemond ... M. G. Azar Bilal Piot Koray Kavukcuoglu Rémi Munos Michal Valko SSL 137 6,665 0 13 Jun 2020
Attention improves concentration when learning node embeddings Matthew Dippel Adam Kiezun Tanay Mehta Ravi Sundaram S. Thirumalai Akshar Varma GNN 22 0 0 11 Jun 2020
Rethinking the Truly Unsupervised Image-to-Image Translation Kyungjune Baek Yunjey Choi Youngjung Uh Jaejun Yoo Hyunjung Shim VLM LRM 24 102 0 11 Jun 2020
Pairwise Supervision Can Provably Elicit a Decision Boundary Han Bao Takuya Shimada Liyuan Xu Issei Sato Masashi Sugiyama 48 10 0 11 Jun 2020
DisCont: Self-Supervised Visual Attribute Disentanglement using Context Vectors Sarthak Bhagat Vishaal Udandarao Shagun Uppal CoGe SSL DRL 16 6 0 10 Jun 2020
Self-supervised Learning from a Multi-view Perspective Yao-Hung Hubert Tsai Yue Wu Ruslan Salakhutdinov Louis-Philippe Morency SSL 25 30 0 10 Jun 2020
Neural Methods for Point-wise Dependency Estimation Yao-Hung Hubert Tsai Han Zhao M. Yamada Louis-Philippe Morency Ruslan Salakhutdinov 33 31 0 09 Jun 2020
DeCLUTR: Deep Contrastive Learning for Unsupervised Textual Representations John Giorgi Osvald Nitski Bo Wang Gary D. Bader SSL 39 490 0 05 Jun 2020
Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hypersphere Tongzhou Wang Phillip Isola SSL 45 1,787 0 20 May 2020
Modularizing Deep Learning via Pairwise Learning With Kernels Shiyu Duan Shujian Yu José C. Príncipe MoMe 27 20 0 12 May 2020
Prototypical Contrastive Learning of Unsupervised Representations Junnan Li Pan Zhou Caiming Xiong Guosheng Lin SSL DRL 87 956 0 11 May 2020
COBRA: Contrastive Bi-Modal Representation Algorithm Vishaal Udandarao A. Maiti Deepak Srivatsav Suryatej Reddy Vyalla Yifang Yin R. Shah 19 21 0 07 May 2020
Information Leakage in Embedding Models Congzheng Song A. Raghunathan MIACV 21 262 0 31 Mar 2020
Machine learning as a model for cultural learning: Teaching an algorithm what it means to be fat Alina Arseniev-Koehler J. Foster 43 46 0 24 Mar 2020
Temporally Coherent Embeddings for Self-Supervised Video Representation Learning Joshua Knights Ben Harwood Daniel Ward Anthony Vanderkop Olivia Mackenzie-Ross Peyman Moghadam AI4TS 20 38 0 21 Mar 2020
Self-Supervised Contextual Bandits in Computer Vision A. Deshmukh Abhimanu Kumar Levi Boyles Denis Xavier Charles Eren Manavoglu Ürün Dogan SSL 31 3 0 18 Mar 2020
Pre-trained Models for Natural Language Processing: A Survey Xipeng Qiu Tianxiang Sun Yige Xu Yunfan Shao Ning Dai Xuanjing Huang LM&MA VLM 243 1,452 0 18 Mar 2020
Contrastive estimation reveals topic posterior information to linear models Christopher Tosh A. Krishnamurthy Daniel J. Hsu 14 64 0 04 Mar 2020
Provable Representation Learning for Imitation Learning via Bi-level Optimization Sanjeev Arora S. Du Sham Kakade Yuping Luo Nikunj Saunshi 23 60 0 24 Feb 2020
Few-Shot Learning via Learning the Representation, Provably S. Du Wei Hu Sham Kakade J. Lee Qi Lei SSL 10 257 0 21 Feb 2020
Strength from Weakness: Fast Learning Using Weak Supervision Joshua Robinson Stefanie Jegelka S. Sra 43 32 0 19 Feb 2020
CoLES: Contrastive Learning for Event Sequences with Self-Supervision Dmitrii Babaev Ivan Kireev Nikita Ovsov Maria Ivanova Gleb Gusev Ivan Nazarov Alexander Tuzhilin SSL AI4TS 25 26 0 19 Feb 2020
Data Transformation Insights in Self-supervision with Clustering Tasks Abhimanu Kumar A. Deshmukh Ürün Dogan Denis Xavier Charles Eren Manavoglu 9 2 0 18 Feb 2020
Convergence of End-to-End Training in Deep Unsupervised Contrastive Learning Zixin Wen SSL 21 2 0 17 Feb 2020
NODIS: Neural Ordinary Differential Scene Understanding Cong Yuren H. Ackermann Wentong Liao M. Yang Bodo Rosenhahn 26 16 0 14 Jan 2020
Contrastive Representation Distillation Yonglong Tian Dilip Krishnan Phillip Isola 47 1,034 0 23 Oct 2019
A Mutual Information Maximization Perspective of Language Representation Learning Lingpeng Kong Cyprien de Masson dÁutume Wang Ling Lei Yu Zihang Dai Dani Yogatama SSL 226 166 0 18 Oct 2019
PAC-Bayesian Contrastive Unsupervised Representation Learning Kento Nozawa Pascal Germain Benjamin Guedj SSL BDL 13 26 0 10 Oct 2019
Differentially Private Meta-Learning Jeffrey Li M. Khodak S. Caldas Ameet Talwalkar FedML 35 106 0 12 Sep 2019
On Mutual Information Maximization for Representation Learning Michael Tschannen Josip Djolonga Paul Kishan Rubenstein Sylvain Gelly Mario Lucic SSL 43 486 0 31 Jul 2019
Supervise Thyself: Examining Self-Supervised Representations in Interactive Environments Evan Racah C. Pal SSL 27 2 0 27 Jun 2019
Contrastive Multiview Coding Yonglong Tian Dilip Krishnan Phillip Isola SSL 100 2,369 0 13 Jun 2019
Noise Contrastive Meta-Learning for Conditional Density Estimation using Kernel Mean Embeddings Jean-François Ton Lucian Chan Yee Whye Teh Dino Sejdinovic 27 12 0 05 Jun 2019