The Optimal Noise in Noise-Contrastive Learning Is Not What You Think

The Optimal Noise in Noise-Contrastive Learning Is Not What You Think

2 March 2022

Alexandre Gramfort

Papers citing "The Optimal Noise in Noise-Contrastive Learning Is Not What You Think"

16 / 16 papers shown

Title
SoftCVI: Contrastive variational inference with self-generated soft labels Daniel Ward Mark Beaumont Matteo Fasiolo BDL 178 0 0 22 Jul 2024
Generative Adversarial Networks Gilad Cohen Raja Giryes GAN 253 30,108 0 01 Mar 2022
Complex Momentum for Optimization in Games Jonathan Lorraine David Acuna Paul Vicol David Duvenaud 55 9 0 16 Feb 2021
Array Programming with NumPy Charles R. Harris K. Millman S. Walt R. Gommers Pauli Virtanen ... Tyler Reddy Warren Weckesser Hameer Abbasi C. Gohlke T. Oliphant 147 14,915 0 18 Jun 2020
A Simple Framework for Contrastive Learning of Visual Representations Ting-Li Chen Simon Kornblith Mohammad Norouzi Geoffrey E. Hinton SSL 350 18,739 0 13 Feb 2020
PyTorch: An Imperative Style, High-Performance Deep Learning Library Adam Paszke Sam Gross Francisco Massa Adam Lerer James Bradbury ... Sasank Chilamkurthy Benoit Steiner Lu Fang Junjie Bai Soumith Chintala ODL 439 42,393 0 03 Dec 2019
Flow Contrastive Estimation of Energy-Based Models Ruiqi Gao Erik Nijkamp Diederik P. Kingma Zhen Xu Andrew M. Dai Ying Nian Wu GAN 62 114 0 02 Dec 2019
Prescribed Generative Adversarial Networks Adji Bousso Dieng Francisco J. R. Ruiz David M. Blei Michalis K. Titsias GAN DRL 46 62 0 09 Oct 2019
Noise Contrastive Estimation and Negative Sampling for Conditional Models: Consistency and Statistical Efficiency Zhuang Ma Michael Collins 61 147 0 06 Sep 2018
Analysis of Noise Contrastive Estimation from the Perspective of Asymptotic Variance Masatoshi Uehara Takeru Matsuda F. Komaki 46 13 0 24 Aug 2018
Representation Learning with Contrastive Predictive Coding Aaron van den Oord Yazhe Li Oriol Vinyals DRL SSL 302 10,282 0 10 Jul 2018
Learning in Implicit Generative Models S. Mohamed Balaji Lakshminarayanan GAN 186 416 0 11 Oct 2016
Distributed Representations of Words and Phrases and their Compositionality Tomas Mikolov Ilya Sutskever Kai Chen G. Corrado J. Dean NAI OCL 377 33,520 0 16 Oct 2013
A Fast and Simple Algorithm for Training Neural Probabilistic Language Models A. Mnih Yee Whye Teh 161 578 0 27 Jun 2012
A Family of Computationally Efficient and Simple Estimators for Unnormalized Statistical Models Miika Pihlaja Michael U. Gutmann Aapo Hyvarinen 65 44 0 15 Mar 2012
Bregman divergence as general framework to estimate unnormalized statistical models Michael U. Gutmann J. Hirayama 64 79 0 14 Feb 2012

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.