Understanding Negative Samples in Instance Discriminative Self-supervised Representation Learning

13 February 2021

Papers citing "Understanding Negative Samples in Instance Discriminative Self-supervised Representation Learning"

50 / 62 papers shown

Title
Investigating the Role of Negatives in Contrastive Representation Learning Jordan T. Ash Surbhi Goel A. Krishnamurthy Dipendra Kumar Misra SSL 54 52 0 18 Jun 2021
Self-Supervised Learning with Kernel Dependence Maximization Yazhe Li Roman Pogodin Danica J. Sutherland Arthur Gretton SSL 56 82 0 15 Jun 2021
SimCSE: Simple Contrastive Learning of Sentence Embeddings Tianyu Gao Xingcheng Yao Danqi Chen AILaw SSL 231 3,371 0 18 Apr 2021
Understanding self-supervised Learning Dynamics without Contrastive Pairs Yuandong Tian Xinlei Chen Surya Ganguli SSL 196 281 0 12 Feb 2021
Exploring Simple Siamese Representation Learning Xinlei Chen Kaiming He SSL 245 4,036 0 20 Nov 2020
For self-supervised learning, Rationality implies generalization, provably Yamini Bansal Gal Kaplun Boaz Barak OOD SSL 93 22 0 16 Oct 2020
Representation Learning via Invariant Causal Mechanisms Jovana Mitrović Brian McWilliams Jacob Walker Lars Buesing Charles Blundell CML OOD SSL 58 249 0 15 Oct 2020
Contrastive Representation Learning: A Framework and Review Phúc H. Lê Khắc Graham Healy Alan F. Smeaton SSL AI4TS 276 705 0 10 Oct 2020
Theoretical Analysis of Self-Training with Deep Networks on Unlabeled Data Colin Wei Kendrick Shen Yining Chen Tengyu Ma SSL 75 230 0 07 Oct 2020
Hard Negative Mixing for Contrastive Learning Yannis Kalantidis Mert Bulent Sariyildiz Noé Pion Philippe Weinzaepfel Diane Larlus SSL 114 640 0 02 Oct 2020
Contrastive learning, multi-view redundancy, and linear models Christopher Tosh A. Krishnamurthy Daniel J. Hsu SSL 63 166 0 24 Aug 2020
Functional Regularization for Representation Learning: A Unified Theoretical Perspective Siddhant Garg Yingyu Liang SSL 37 20 0 06 Aug 2020
Predicting What You Already Know Helps: Provable Self-Supervised Learning Jason D. Lee Qi Lei Nikunj Saunshi Jiacheng Zhuo SSL 65 187 0 03 Aug 2020
Unsupervised Learning of Visual Features by Contrasting Cluster Assignments Mathilde Caron Ishan Misra Julien Mairal Priya Goyal Piotr Bojanowski Armand Joulin OCL SSL 213 4,065 0 17 Jun 2020
Bootstrap your own latent: A new approach to self-supervised Learning Jean-Bastien Grill Florian Strub Florent Altché Corentin Tallec Pierre Harvey Richemond ... M. G. Azar Bilal Piot Koray Kavukcuoglu Rémi Munos Michal Valko SSL 325 6,773 0 13 Jun 2020
Language Models are Few-Shot Learners Tom B. Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared Kaplan ... Christopher Berner Sam McCandlish Alec Radford Ilya Sutskever Dario Amodei BDL 594 41,736 0 28 May 2020
Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hypersphere Tongzhou Wang Phillip Isola SSL 126 1,826 0 20 May 2020
Prototypical Contrastive Learning of Unsupervised Representations Junnan Li Pan Zhou Caiming Xiong Guosheng Lin SSL DRL 132 971 0 11 May 2020
How Useful is Self-Supervised Pretraining for Visual Tasks? Alejandro Newell Jia Deng SSL 43 137 0 31 Mar 2020
Improved Baselines with Momentum Contrastive Learning Xinlei Chen Haoqi Fan Ross B. Girshick Kaiming He SSL 446 3,422 0 09 Mar 2020
A survey on Semi-, Self- and Unsupervised Learning for Image Classification Lars Schmarje M. Santarossa Simon-Martin Schroder Reinhard Koch SSL VLM 49 164 0 20 Feb 2020
A Simple Framework for Contrastive Learning of Visual Representations Ting-Li Chen Simon Kornblith Mohammad Norouzi Geoffrey E. Hinton SSL 319 18,686 0 13 Feb 2020
PyTorch: An Imperative Style, High-Performance Deep Learning Library Adam Paszke Sam Gross Francisco Massa Adam Lerer James Bradbury ... Sasank Chilamkurthy Benoit Steiner Lu Fang Junjie Bai Soumith Chintala ODL 349 42,299 0 03 Dec 2019
Momentum Contrast for Unsupervised Visual Representation Learning Kaiming He Haoqi Fan Yuxin Wu Saining Xie Ross B. Girshick SSL 159 12,050 0 13 Nov 2019
Self-labelling via simultaneous clustering and representation learning Yuki M. Asano Christian Rupprecht Andrea Vedaldi SSL 98 770 0 13 Nov 2019
PAC-Bayesian Contrastive Unsupervised Representation Learning Kento Nozawa Pascal Germain Benjamin Guedj SSL BDL 39 27 0 10 Oct 2019
Learning Deep Representations by Mutual Information for Person Re-identification Peng Chen Tong Jia Pengfei Wu Jianjun Wu Dongyue Chen SSL 59 5 0 16 Aug 2019
On Mutual Information Maximization for Representation Learning Michael Tschannen Josip Djolonga Paul Kishan Rubenstein Sylvain Gelly Mario Lucic SSL 154 493 0 31 Jul 2019
Large Scale Adversarial Representation Learning Jeff Donahue Karen Simonyan SSL 122 543 0 04 Jul 2019
Learning Representations by Maximizing Mutual Information Across Views Philip Bachman R. Devon Hjelm William Buchwalter SSL 187 1,467 0 03 Jun 2019
Data-Efficient Image Recognition with Contrastive Predictive Coding Olivier J. Hénaff A. Srinivas J. Fauw Ali Razavi Carl Doersch S. M. Ali Eslami Aaron van den Oord SSL 106 1,427 0 22 May 2019
On Variational Bounds of Mutual Information Ben Poole Sherjil Ozair Aaron van den Oord Alexander A. Alemi George Tucker SSL 90 806 0 16 May 2019
Unsupervised Embedding Learning via Invariant and Spreading Instance Feature Mang Ye Xu-Yao Zhang PongChi Yuen Shih-Fu Chang SSL 78 581 0 06 Apr 2019
A Theoretical Analysis of Contrastive Unsupervised Representation Learning Sanjeev Arora H. Khandeparkar M. Khodak Orestis Plevrakis Nikunj Saunshi SSL 96 776 0 25 Feb 2019
Revisiting Self-Supervised Visual Representation Learning Alexander Kolesnikov Xiaohua Zhai Lucas Beyer SSL 129 716 0 25 Jan 2019
Formal Limitations on the Measurement of Mutual Information David A. McAllester K. Stratos SSL 63 275 0 10 Nov 2018
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.4K 94,511 0 11 Oct 2018
Deep Clustering for Unsupervised Learning of Visual Features Mathilde Caron Piotr Bojanowski Armand Joulin Matthijs Douze SSL 88 1,890 0 15 Jul 2018
Representation Learning with Contrastive Predictive Coding Aaron van den Oord Yazhe Li Oriol Vinyals DRL SSL 278 10,253 0 10 Jul 2018
Do Better ImageNet Models Transfer Better? Simon Kornblith Jonathon Shlens Quoc V. Le OOD MLT 153 1,324 0 23 May 2018
Unsupervised Feature Learning via Non-Parametric Instance-level Discrimination Zhirong Wu Yuanjun Xiong Stella X. Yu Dahua Lin SSL 170 3,450 0 05 May 2018
Unsupervised Representation Learning by Predicting Image Rotations Spyros Gidaris Praveer Singh N. Komodakis OOD SSL DRL 225 3,283 0 21 Mar 2018
An efficient framework for learning sentence representations Lajanugen Logeswaran Honglak Lee 77 543 0 07 Mar 2018
Classification from Pairwise Similarity and Unlabeled Data Han Bao Gang Niu Masashi Sugiyama 200 88 0 12 Feb 2018
Advances in Pre-Training Distributed Word Representations Tomas Mikolov Edouard Grave Piotr Bojanowski Christian Puhrsch Armand Joulin AI4TS VLM 117 1,242 0 26 Dec 2017
Large Batch Training of Convolutional Networks Yang You Igor Gitman Boris Ginsburg ODL 125 848 0 13 Aug 2017
Prototypical Networks for Few-shot Learning Jake C. Snell Kevin Swersky R. Zemel 265 8,114 0 15 Mar 2017
Split-Brain Autoencoders: Unsupervised Learning by Cross-Channel Prediction Richard Y. Zhang Phillip Isola Alexei A. Efros SSL DRL 61 668 0 29 Nov 2016
One-vs-Each Approximation to Softmax for Scalable Estimation of Probabilities Michalis K. Titsias UQCV 28 54 0 23 Sep 2016
SGDR: Stochastic Gradient Descent with Warm Restarts I. Loshchilov Frank Hutter ODL 288 8,091 0 13 Aug 2016