InfoNCE: Identifying the Gap Between Theory and Practice

v1v2 (latest)

InfoNCE: Identifying the Gap Between Theory and Practice

28 June 2024

Patrik Reizinger

Oliver Bringmann

Roland S. Zimmermann

Wieland Brendel

ArXiv (abs)PDF HTML

Papers citing "InfoNCE: Identifying the Gap Between Theory and Practice"

15 / 65 papers shown

Title
Bootstrap your own latent: A new approach to self-supervised Learning Jean-Bastien Grill Florian Strub Florent Altché Corentin Tallec Pierre Harvey Richemond ... M. G. Azar Bilal Piot Koray Kavukcuoglu Rémi Munos Michal Valko SSL 536 6,881 0 13 Jun 2020
On Mutual Information in Contrastive Learning for Visual Representations Mike Wu Chengxu Zhuang Milan Mossé Daniel L. K. Yamins Noah D. Goodman SSL 75 85 0 27 May 2020
Supervised Contrastive Learning Prannay Khosla Piotr Teterwak Chen Wang Aaron Sarna Yonglong Tian Phillip Isola Aaron Maschinot Ce Liu Dilip Krishnan SSL 241 4,617 0 23 Apr 2020
Improved Baselines with Momentum Contrastive Learning Xinlei Chen Haoqi Fan Ross B. Girshick Kaiming He SSL 687 3,451 0 09 Mar 2020
Decision-Making with Auto-Encoding Variational Bayes Romain Lopez Pierre Boyeau Nir Yosef Michael I. Jordan Jeffrey Regier BDL 854 10,591 0 17 Feb 2020
A Simple Framework for Contrastive Learning of Visual Representations Ting-Li Chen Simon Kornblith Mohammad Norouzi Geoffrey E. Hinton SSL 479 19,004 0 13 Feb 2020
Optimal experimental design via Bayesian optimization: active causal structure learning for Gaussian process networks Julius von Kügelgen Paul Kishan Rubenstein Bernhard Schölkopf Adrian Weller CML 86 20 0 09 Oct 2019
The Incomplete Rosetta Stone Problem: Identifiability Results for Multi-View Nonlinear ICA Luigi Gresele Paul Kishan Rubenstein Arash Mehrjou Francesco Locatello Bernhard Schölkopf 72 100 0 16 May 2019
A Theoretical Analysis of Contrastive Unsupervised Representation Learning Sanjeev Arora H. Khandeparkar M. Khodak Orestis Plevrakis Nikunj Saunshi SSL 135 785 0 25 Feb 2019
Noise Contrastive Estimation and Negative Sampling for Conditional Models: Consistency and Statistical Efficiency Zhuang Ma Michael Collins 92 149 0 06 Sep 2018
Representation Learning with Contrastive Predictive Coding Aaron van den Oord Yazhe Li Oriol Vinyals DRL SSL 607 10,402 0 10 Jul 2018
Unsupervised Feature Extraction by Time-Contrastive Learning and Nonlinear ICA Aapo Hyvarinen H. Morioka CML OOD AI4TS 96 410 0 20 May 2016
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 2.8K 195,310 0 10 Dec 2015
ImageNet Large Scale Visual Recognition Challenge Olga Russakovsky Jia Deng Hao Su J. Krause S. Satheesh ... A. Karpathy A. Khosla Michael S. Bernstein Alexander C. Berg Li Fei-Fei VLM ObjD 1.8K 39,737 0 01 Sep 2014
Exact solutions to the nonlinear dynamics of learning in deep linear neural networks Andrew M. Saxe James L. McClelland Surya Ganguli ODL 326 1,854 0 20 Dec 2013