Analyzing and Improving the Optimization Landscape of Noise-Contrastive Estimation

21 October 2021

Andrej Risteski

Papers citing "Analyzing and Improving the Optimization Landscape of Noise-Contrastive Estimation"

24 / 24 papers shown

Title
Density Ratio Estimation with Conditional Probability Paths Hanlin Yu Arto Klami Aapo Hyvarinen Anna Korba Omar Chehab 76 0 0 04 Feb 2025
InfoNCE: Identifying the Gap Between Theory and Practice E. Rusak Patrik Reizinger Attila Juhos Oliver Bringmann Roland S. Zimmermann Wieland Brendel 68 7 0 28 Jun 2024
Generative Adversarial Networks Gilad Cohen Raja Giryes GAN 78 30,021 0 01 Mar 2022
Heavy-tailed Streaming Statistical Estimation Che-Ping Tsai Adarsh Prasad Sivaraman Balakrishnan Pradeep Ravikumar 39 10 0 25 Aug 2021
Telescoping Density-Ratio Estimation Benjamin Rhodes Kai Xu Michael U. Gutmann 111 95 0 22 Jun 2020
Training Deep Energy-Based Models with f-Divergence Minimization Lantao Yu Yang Song Jiaming Song Stefano Ermon 202 42 0 06 Mar 2020
Your Classifier is Secretly an Energy Based Model and You Should Treat it Like One Will Grathwohl Kuan-Chieh Wang J. Jacobsen David Duvenaud Mohammad Norouzi Kevin Swersky VLM 50 536 0 06 Dec 2019
Flow Contrastive Estimation of Energy-Based Models Ruiqi Gao Erik Nijkamp Diederik P. Kingma Zhen Xu Andrew M. Dai Ying Nian Wu GAN 31 113 0 02 Dec 2019
A Mutual Information Maximization Perspective of Language Representation Learning Lingpeng Kong Cyprien de Masson dÁutume Wang Ling Lei Yu Zihang Dai Dani Yogatama SSL 246 167 0 18 Oct 2019
Simple and optimal high-probability bounds for strongly-convex stochastic gradient descent Nicholas J. A. Harvey Christopher Liaw Sikander Randhawa 17 37 0 02 Sep 2019
Contrastive Multiview Coding Yonglong Tian Dilip Krishnan Phillip Isola SSL 112 2,385 0 13 Jun 2019
Data-Efficient Image Recognition with Contrastive Predictive Coding Olivier J. Hénaff A. Srinivas J. Fauw Ali Razavi Carl Doersch S. M. Ali Eslami Aaron van den Oord SSL 77 1,422 0 22 May 2019
Learning deep representations by mutual information estimation and maximization R. Devon Hjelm A. Fedorov Samuel Lavoie-Marchildon Karan Grewal Phil Bachman Adam Trischler Yoshua Bengio SSL DRL 197 2,649 0 20 Aug 2018
Representation Learning with Contrastive Predictive Coding Aaron van den Oord Yazhe Li Oriol Vinyals DRL SSL 184 10,152 0 10 Jul 2018
Generative Ratio Matching Networks Akash Srivastava Kai Xu Michael U. Gutmann Charles Sutton GAN 21 12 0 31 May 2018
f-GAN: Training Generative Neural Samplers using Variational Divergence Minimization Sebastian Nowozin Botond Cseke Ryota Tomioka GAN 49 1,648 0 02 Jun 2016
Unsupervised Feature Extraction by Time-Contrastive Learning and Nonlinear ICA Aapo Hyvarinen H. Morioka CML OOD AI4TS 24 404 0 20 May 2016
Beyond Convexity: Stochastic Quasi-Convex Optimization Elad Hazan Kfir Y. Levy Shai Shalev-Shwartz 29 175 0 08 Jul 2015
On the accuracy of self-normalized log-linear models Jacob Andreas Maxim Rabinovich Dan Klein Michael I. Jordan 31 15 0 12 Jun 2015
Accurate and Conservative Estimates of MRF Log-likelihood using Reverse Annealing Yuri Burda Roger C. Grosse Ruslan Salakhutdinov TPM 104 66 0 30 Dec 2014
Notes on Noise Contrastive Estimation and Negative Sampling Chris Dyer 44 101 0 30 Oct 2014
Logistic Regression: Tight Bounds for Stochastic and Online Optimization Elad Hazan Tomer Koren Kfir Y. Levy 34 60 0 15 May 2014
A Fast and Simple Algorithm for Training Neural Probabilistic Language Models A. Mnih Yee Whye Teh 56 578 0 27 Jun 2012
Bregman divergence as general framework to estimate unnormalized statistical models Michael U. Gutmann J. Hirayama 39 79 0 14 Feb 2012