Investigating the Role of Negatives in Contrastive Representation Learning

18 June 2021

Papers citing "Investigating the Role of Negatives in Contrastive Representation Learning"

32 / 32 papers shown

Title
Understanding Negative Samples in Instance Discriminative Self-supervised Representation Learning Kento Nozawa Issei Sato SSL 102 45 0 13 Feb 2021
Understanding self-supervised Learning Dynamics without Contrastive Pairs Yuandong Tian Xinlei Chen Surya Ganguli SSL 196 281 0 12 Feb 2021
LRC-BERT: Latent-representation Contrastive Knowledge Distillation for Natural Language Understanding Hao Fu Shaojun Zhou Qihong Yang Junjie Tang Guiquan Liu Kaikui Liu Xiaolong Li 81 59 0 14 Dec 2020
Boosting Contrastive Self-Supervised Learning with False Negative Cancellation T. Huynh Simon Kornblith Matthew R. Walter Michael Maire M. Khademi SSL 65 167 0 23 Nov 2020
Exploring Simple Siamese Representation Learning Xinlei Chen Kaiming He SSL 247 4,036 0 20 Nov 2020
Heterogeneous Contrastive Learning: Encoding Spatial Information for Compact Visual Representations Xinyue Huo Lingxi Xie Longhui Wei Xiaopeng Zhang Hao Li Zijie Yang Wen-gang Zhou Houqiang Li Qi Tian SSL 53 13 0 19 Nov 2020
Dense Contrastive Learning for Self-Supervised Visual Pre-Training Xinlong Wang Rufeng Zhang Chunhua Shen Tao Kong Lei Li SSL 72 683 0 18 Nov 2020
Masked Contrastive Representation Learning for Reinforcement Learning Jinhua Zhu Yingce Xia Lijun Wu Jiajun Deng Wen-gang Zhou Tao Qin Houqiang Li SSL OffRL 85 59 0 15 Oct 2020
Contrastive Representation Learning: A Framework and Review Phúc H. Lê Khắc Graham Healy Alan F. Smeaton SSL AI4TS 290 705 0 10 Oct 2020
Hard Negative Mixing for Contrastive Learning Yannis Kalantidis Mert Bulent Sariyildiz Noé Pion Philippe Weinzaepfel Diane Larlus SSL 120 643 0 02 Oct 2020
Contrastive learning, multi-view redundancy, and linear models Christopher Tosh A. Krishnamurthy Daniel J. Hsu SSL 63 166 0 24 Aug 2020
Predicting What You Already Know Helps: Provable Self-Supervised Learning Jason D. Lee Qi Lei Nikunj Saunshi Jiacheng Zhuo SSL 65 188 0 03 Aug 2020
Debiased Contrastive Learning Ching-Yao Chuang Joshua Robinson Yen-Chen Lin Antonio Torralba Stefanie Jegelka SSL 61 560 0 01 Jul 2020
Bootstrap your own latent: A new approach to self-supervised Learning Jean-Bastien Grill Florian Strub Florent Altché Corentin Tallec Pierre Harvey Richemond ... M. G. Azar Bilal Piot Koray Kavukcuoglu Rémi Munos Michal Valko SSL 341 6,773 0 13 Jun 2020
DeCLUTR: Deep Contrastive Learning for Unsupervised Textual Representations John Giorgi Osvald Nitski Bo Wang Gary D. Bader SSL 88 495 0 05 Jun 2020
Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hypersphere Tongzhou Wang Phillip Isola SSL 140 1,826 0 20 May 2020
CERT: Contrastive Self-supervised Learning for Language Understanding Hongchao Fang Sicheng Wang Meng Zhou Jiayuan Ding P. Xie ELM SSL 72 338 0 16 May 2020
Supervised Contrastive Learning Prannay Khosla Piotr Teterwak Chen Wang Aaron Sarna Yonglong Tian Phillip Isola Aaron Maschinot Ce Liu Dilip Krishnan SSL 141 4,532 0 23 Apr 2020
CURL: Contrastive Unsupervised Representations for Reinforcement Learning A. Srinivas Michael Laskin Pieter Abbeel SSL DRL OffRL 81 1,084 0 08 Apr 2020
Contrastive estimation reveals topic posterior information to linear models Christopher Tosh A. Krishnamurthy Daniel J. Hsu 49 64 0 04 Mar 2020
A Simple Framework for Contrastive Learning of Visual Representations Ting-Li Chen Simon Kornblith Mohammad Norouzi Geoffrey E. Hinton SSL 333 18,721 0 13 Feb 2020
Contrastive Learning of Structured World Models Thomas Kipf Elise van der Pol Max Welling OCL DRL 67 283 0 27 Nov 2019
Momentum Contrast for Unsupervised Visual Representation Learning Kaiming He Haoqi Fan Yuxin Wu Saining Xie Ross B. Girshick SSL 173 12,065 0 13 Nov 2019
A Unified Stochastic Gradient Approach to Designing Bayesian-Optimal Experiments Adam Foster M. Jankowiak M. O'Meara Yee Whye Teh Tom Rainforth BDL 64 61 0 01 Nov 2019
On Mutual Information Maximization for Representation Learning Michael Tschannen Josip Djolonga Paul Kishan Rubenstein Sylvain Gelly Mario Lucic SSL 156 493 0 31 Jul 2019
Learning Representations by Maximizing Mutual Information Across Views Philip Bachman R. Devon Hjelm William Buchwalter SSL 187 1,467 0 03 Jun 2019
A Theoretical Analysis of Contrastive Unsupervised Representation Learning Sanjeev Arora H. Khandeparkar M. Khodak Orestis Plevrakis Nikunj Saunshi SSL 98 776 0 25 Feb 2019
Near-Optimal Representation Learning for Hierarchical Reinforcement Learning Ofir Nachum S. Gu Honglak Lee Sergey Levine 57 210 0 02 Oct 2018
Representation Learning with Contrastive Predictive Coding Aaron van den Oord Yazhe Li Oriol Vinyals DRL SSL 292 10,253 0 10 Jul 2018
Loss is its own Reward: Self-Supervision for Reinforcement Learning Evan Shelhamer Parsa Mahmoudieh Max Argus Trevor Darrell SSL 77 186 0 21 Dec 2016
FaceNet: A Unified Embedding for Face Recognition and Clustering Florian Schroff Dmitry Kalenichenko James Philbin 3DH 342 13,123 0 12 Mar 2015
Efficient Estimation of Word Representations in Vector Space Tomas Mikolov Kai Chen G. Corrado J. Dean 3DV 633 31,469 0 16 Jan 2013