The Optimal Noise in Noise-Contrastive Learning Is Not What You Think

The Optimal Noise in Noise-Contrastive Learning Is Not What You Think

2 March 2022

Alexandre Gramfort

Papers citing "The Optimal Noise in Noise-Contrastive Learning Is Not What You Think"

16 / 16 papers shown

Title
SoftCVI: Contrastive variational inference with self-generated soft labels Daniel Ward Mark Beaumont Matteo Fasiolo BDL 181 0 0 22 Jul 2024
Generative Adversarial Networks Gilad Cohen Raja Giryes GAN 262 30,123 0 01 Mar 2022
Complex Momentum for Optimization in Games Jonathan Lorraine David Acuna Paul Vicol David Duvenaud 55 9 0 16 Feb 2021
Array Programming with NumPy Charles R. Harris K. Millman S. Walt R. Gommers Pauli Virtanen ... Tyler Reddy Warren Weckesser Hameer Abbasi C. Gohlke T. Oliphant 147 14,915 0 18 Jun 2020
A Simple Framework for Contrastive Learning of Visual Representations Ting-Li Chen Simon Kornblith Mohammad Norouzi Geoffrey E. Hinton SSL 353 18,739 0 13 Feb 2020
PyTorch: An Imperative Style, High-Performance Deep Learning Library Adam Paszke Sam Gross Francisco Massa Adam Lerer James Bradbury ... Sasank Chilamkurthy Benoit Steiner Lu Fang Junjie Bai Soumith Chintala ODL 449 42,393 0 03 Dec 2019
Flow Contrastive Estimation of Energy-Based Models Ruiqi Gao Erik Nijkamp Diederik P. Kingma Zhen Xu Andrew M. Dai Ying Nian Wu GAN 62 114 0 02 Dec 2019
Prescribed Generative Adversarial Networks Adji Bousso Dieng Francisco J. R. Ruiz David M. Blei Michalis K. Titsias GAN DRL 46 62 0 09 Oct 2019
Noise Contrastive Estimation and Negative Sampling for Conditional Models: Consistency and Statistical Efficiency Zhuang Ma Michael Collins 61 147 0 06 Sep 2018
Analysis of Noise Contrastive Estimation from the Perspective of Asymptotic Variance Masatoshi Uehara Takeru Matsuda F. Komaki 48 13 0 24 Aug 2018
Representation Learning with Contrastive Predictive Coding Aaron van den Oord Yazhe Li Oriol Vinyals DRL SSL 302 10,282 0 10 Jul 2018
Learning in Implicit Generative Models S. Mohamed Balaji Lakshminarayanan GAN 186 416 0 11 Oct 2016
Distributed Representations of Words and Phrases and their Compositionality Tomas Mikolov Ilya Sutskever Kai Chen G. Corrado J. Dean NAI OCL 387 33,521 0 16 Oct 2013
A Fast and Simple Algorithm for Training Neural Probabilistic Language Models A. Mnih Yee Whye Teh 161 578 0 27 Jun 2012
A Family of Computationally Efficient and Simple Estimators for Unnormalized Statistical Models Miika Pihlaja Michael U. Gutmann Aapo Hyvarinen 67 44 0 15 Mar 2012
Bregman divergence as general framework to estimate unnormalized statistical models Michael U. Gutmann J. Hirayama 64 79 0 14 Feb 2012