Optimizing the Noise in Self-Supervised Learning: from Importance
Sampling to Noise-Contrastive Estimation

Optimizing the Noise in Self-Supervised Learning: from Importance Sampling to Noise-Contrastive Estimation

23 January 2023

Alexandre Gramfort

ArXiv (abs)PDF HTML

Papers citing "Optimizing the Noise in Self-Supervised Learning: from Importance Sampling to Noise-Contrastive Estimation"

17 / 17 papers shown

Title
Density Ratio Estimation with Conditional Probability Paths Hanlin Yu Arto Klami Aapo Hyvarinen Anna Korba Omar Chehab 126 0 0 04 Feb 2025
Pitfalls of Gaussians as a noise distribution in NCE Holden Lee Chirag Pabbaraju A. Sevekari Andrej Risteski 58 4 0 01 Oct 2022
Statistical applications of contrastive learning Michael U. Gutmann Steven Kleinegesse Benjamin Rhodes 53 7 0 29 Apr 2022
The Optimal Noise in Noise-Contrastive Learning Is Not What You Think O. Chehab Alexandre Gramfort Aapo Hyvarinen OOD 62 10 0 02 Mar 2022
Generative Adversarial Networks Gilad Cohen Raja Giryes GAN 280 30,103 0 01 Mar 2022
Improving Bridge estimators via $f$ -GAN Hanwen Xing OT 92 3 0 14 Jun 2021
Hard Negative Mixing for Contrastive Learning Yannis Kalantidis Mert Bulent Sariyildiz Noé Pion Philippe Weinzaepfel Diane Larlus SSL 134 643 0 02 Oct 2020
Uncovering the structure of clinical EEG signals with self-supervised learning Hubert J. Banville O. Chehab Aapo Hyvarinen Denis A. Engemann Alexandre Gramfort 71 197 0 31 Jul 2020
Array Programming with NumPy Charles R. Harris K. Millman S. Walt R. Gommers Pauli Virtanen ... Tyler Reddy Warren Weckesser Hameer Abbasi C. Gohlke T. Oliphant 156 14,986 0 18 Jun 2020
On Contrastive Learning for Likelihood-free Inference Conor Durkan Iain Murray George Papamakarios BDL 209 123 0 10 Feb 2020
Information criteria for non-normalized models Takeru Matsuda Masatoshi Uehara Aapo Hyvarinen 25 10 0 15 May 2019
Nonlinear ICA Using Auxiliary Variables and Generalized Contrastive Learning Aapo Hyvarinen Hiroaki Sasaki Richard Turner OOD CML 95 331 0 22 May 2018
f-GAN: Training Generative Neural Samplers using Variational Divergence Minimization Sebastian Nowozin Botond Cseke Ryota Tomioka GAN 154 1,658 0 02 Jun 2016
Faster Eigenvector Computation via Shift-and-Invert Preconditioning Dan Garber Laurent Dinh Chi Jin Jascha Narain Sohl-Dickstein Samy Bengio Praneeth Netrapalli Aaron Sidford 275 3,702 0 26 May 2016
Distributed Representations of Words and Phrases and their Compositionality Tomas Mikolov Ilya Sutskever Kai Chen G. Corrado J. Dean NAI OCL 397 33,550 0 16 Oct 2013
A Fast and Simple Algorithm for Training Neural Probabilistic Language Models A. Mnih Yee Whye Teh 177 578 0 27 Jun 2012
Bregman divergence as general framework to estimate unnormalized statistical models Michael U. Gutmann J. Hirayama 77 80 0 14 Feb 2012

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.