Optimizing the Noise in Self-Supervised Learning: from Importance
Sampling to Noise-Contrastive Estimation

Optimizing the Noise in Self-Supervised Learning: from Importance Sampling to Noise-Contrastive Estimation

23 January 2023

Alexandre Gramfort

ArXiv (abs)PDF HTML

Papers citing "Optimizing the Noise in Self-Supervised Learning: from Importance Sampling to Noise-Contrastive Estimation"

17 / 17 papers shown

Title
Density Ratio Estimation with Conditional Probability Paths Hanlin Yu Arto Klami Aapo Hyvarinen Anna Korba Omar Chehab 128 0 0 04 Feb 2025
Pitfalls of Gaussians as a noise distribution in NCE Holden Lee Chirag Pabbaraju A. Sevekari Andrej Risteski 58 4 0 01 Oct 2022
Statistical applications of contrastive learning Michael U. Gutmann Steven Kleinegesse Benjamin Rhodes 53 7 0 29 Apr 2022
The Optimal Noise in Noise-Contrastive Learning Is Not What You Think O. Chehab Alexandre Gramfort Aapo Hyvarinen OOD 62 10 0 02 Mar 2022
Generative Adversarial Networks Gilad Cohen Raja Giryes GAN 280 30,103 0 01 Mar 2022
Improving Bridge estimators via $f$ -GAN Hanwen Xing OT 92 3 0 14 Jun 2021
Hard Negative Mixing for Contrastive Learning Yannis Kalantidis Mert Bulent Sariyildiz Noé Pion Philippe Weinzaepfel Diane Larlus SSL 134 643 0 02 Oct 2020
Uncovering the structure of clinical EEG signals with self-supervised learning Hubert J. Banville O. Chehab Aapo Hyvarinen Denis A. Engemann Alexandre Gramfort 71 197 0 31 Jul 2020
Array Programming with NumPy Charles R. Harris K. Millman S. Walt R. Gommers Pauli Virtanen ... Tyler Reddy Warren Weckesser Hameer Abbasi C. Gohlke T. Oliphant 156 14,986 0 18 Jun 2020
On Contrastive Learning for Likelihood-free Inference Conor Durkan Iain Murray George Papamakarios BDL 209 123 0 10 Feb 2020
Information criteria for non-normalized models Takeru Matsuda Masatoshi Uehara Aapo Hyvarinen 25 10 0 15 May 2019
Nonlinear ICA Using Auxiliary Variables and Generalized Contrastive Learning Aapo Hyvarinen Hiroaki Sasaki Richard Turner OOD CML 95 331 0 22 May 2018
f-GAN: Training Generative Neural Samplers using Variational Divergence Minimization Sebastian Nowozin Botond Cseke Ryota Tomioka GAN 154 1,658 0 02 Jun 2016
Faster Eigenvector Computation via Shift-and-Invert Preconditioning Dan Garber Laurent Dinh Chi Jin Jascha Narain Sohl-Dickstein Samy Bengio Praneeth Netrapalli Aaron Sidford 275 78 0 26 May 2016
Distributed Representations of Words and Phrases and their Compositionality Tomas Mikolov Ilya Sutskever Kai Chen G. Corrado J. Dean NAI OCL 397 33,550 0 16 Oct 2013
A Fast and Simple Algorithm for Training Neural Probabilistic Language Models A. Mnih Yee Whye Teh 177 578 0 27 Jun 2012
Bregman divergence as general framework to estimate unnormalized statistical models Michael U. Gutmann J. Hirayama 77 80 0 14 Feb 2012