Self-Supervised Learning with an Information Maximization Criterion

16 September 2022

Papers citing "Self-Supervised Learning with an Information Maximization Criterion"

39 / 39 papers shown

Title
Uncovering RL Integration in SSL Loss: Objective-Specific Implications for Data-Efficient RL Ömer Veysel Çağatan Barış Akgün OffRL 80 0 0 22 Oct 2024
Self-Contrastive Forward-Forward Algorithm Xing Chen Dongshu Liu Jérémie Laydevant Julie Grollier 98 2 0 17 Sep 2024
ScaleNet: An Unsupervised Representation Learning Method for Limited Information Huili Huang M. M. Roozbahani SSL 93 805 0 03 Oct 2023
Polytopic Matrix Factorization: Determinant Maximization Based Criterion and Identifiability Gokcan Tatli A. Erdogan 82 16 0 19 Feb 2022
Improving Transferability of Representations via Augmentation-Aware Self-Supervision Hankook Lee Kibok Lee Kimin Lee Honglak Lee Jinwoo Shin SSL 54 55 0 18 Nov 2021
Robust Contrastive Learning Using Negative Samples with Diminished Semantics Songwei Ge Shlok Kumar Mishra Haohan Wang Chun-Liang Li David Jacobs SSL 57 71 0 27 Oct 2021
Self-Supervised Learning with Kernel Dependence Maximization Yazhe Li Roman Pogodin Danica J. Sutherland Arthur Gretton SSL 68 84 0 15 Jun 2021
Provable Guarantees for Self-Supervised Deep Learning with Spectral Contrastive Loss Jeff Z. HaoChen Colin Wei Adrien Gaidon Tengyu Ma SSL 69 315 0 08 Jun 2021
VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learning Adrien Bardes Jean Ponce Yann LeCun SSL DML 151 933 0 11 May 2021
Understanding Neural Networks with Logarithm Determinant Entropy Estimator Zhanghao Zhouyin Ding Liu FAtt 44 8 0 08 May 2021
On Feature Decorrelation in Self-Supervised Learning Tianyu Hua Wenxiao Wang Zihui Xue Sucheng Ren Yue Wang Hang Zhao SSL OOD 174 191 0 02 May 2021
Barlow Twins: Self-Supervised Learning via Redundancy Reduction Jure Zbontar Li Jing Ishan Misra Yann LeCun Stéphane Deny SSL 300 2,344 0 04 Mar 2021
Understanding self-supervised Learning Dynamics without Contrastive Pairs Yuandong Tian Xinlei Chen Surya Ganguli SSL 204 283 0 12 Feb 2021
How Well Do Self-Supervised Models Transfer? Linus Ericsson Henry Gouk Timothy M. Hospedales SSL 102 278 0 26 Nov 2020
Exploring Simple Siamese Representation Learning Xinlei Chen Kaiming He SSL 253 4,052 0 20 Nov 2020
Hard Negative Mixing for Contrastive Learning Yannis Kalantidis Mert Bulent Sariyildiz Noé Pion Philippe Weinzaepfel Diane Larlus SSL 130 643 0 02 Oct 2020
Whitening for Self-Supervised Representation Learning Aleksandr Ermolov Aliaksandr Siarohin E. Sangineto N. Sebe SSL 89 313 0 13 Jul 2020
Unsupervised Learning of Visual Features by Contrasting Cluster Assignments Mathilde Caron Ishan Misra Julien Mairal Priya Goyal Piotr Bojanowski Armand Joulin OCL SSL 230 4,074 0 17 Jun 2020
Bootstrap your own latent: A new approach to self-supervised Learning Jean-Bastien Grill Florian Strub Florent Altché Corentin Tallec Pierre Harvey Richemond ... M. G. Azar Bilal Piot Koray Kavukcuoglu Rémi Munos Michal Valko SSL 363 6,797 0 13 Jun 2020
Improved Baselines with Momentum Contrastive Learning Xinlei Chen Haoqi Fan Ross B. Girshick Kaiming He SSL 475 3,427 0 09 Mar 2020
A Simple Framework for Contrastive Learning of Visual Representations Ting-Li Chen Simon Kornblith Mohammad Norouzi Geoffrey E. Hinton SSL 361 18,752 0 13 Feb 2020
Momentum Contrast for Unsupervised Visual Representation Learning Kaiming He Haoqi Fan Yuxin Wu Saining Xie Ross B. Girshick SSL 199 12,074 0 13 Nov 2019
Self-labelling via simultaneous clustering and representation learning Yuki M. Asano Christian Rupprecht Andrea Vedaldi SSL 121 772 0 13 Nov 2019
On Mutual Information Maximization for Representation Learning Michael Tschannen Josip Djolonga Paul Kishan Rubenstein Sylvain Gelly Mario Lucic SSL 162 494 0 31 Jul 2019
Contrastive Multiview Coding Yonglong Tian Dilip Krishnan Phillip Isola SSL 158 2,399 0 13 Jun 2019
On Variational Bounds of Mutual Information Ben Poole Sherjil Ozair Aaron van den Oord Alexander A. Alemi George Tucker SSL 96 807 0 16 May 2019
Revisiting Self-Supervised Visual Representation Learning Alexander Kolesnikov Xiaohua Zhai Lucas Beyer SSL 138 716 0 25 Jan 2019
An Empirical Model of Large-Batch Training Sam McCandlish Jared Kaplan Dario Amodei OpenAI Dota Team 65 277 0 14 Dec 2018
Formal Limitations on the Measurement of Mutual Information David A. McAllester K. Stratos SSL 63 275 0 10 Nov 2018
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.7K 94,770 0 11 Oct 2018
Learning deep representations by mutual information estimation and maximization R. Devon Hjelm A. Fedorov Samuel Lavoie-Marchildon Karan Grewal Phil Bachman Adam Trischler Yoshua Bengio SSL DRL 315 2,661 0 20 Aug 2018
Decorrelated Batch Normalization Lei Huang Dawei Yang B. Lang Jia Deng 44 192 0 23 Apr 2018
Revisiting Small Batch Training for Deep Neural Networks Dominic Masters Carlo Luschi ODL 69 665 0 20 Apr 2018
Nonnegative Matrix Factorization for Signal and Data Analytics: Identifiability, Algorithms, and Applications Xiao Fu Kejun Huang N. Sidiropoulos Wing-Kin Ma 53 203 0 03 Mar 2018
Mask R-CNN Kaiming He Georgia Gkioxari Piotr Dollár Ross B. Girshick ObjD 350 27,181 0 20 Mar 2017
Robust Volume Minimization-Based Matrix Factorization for Remote Sensing and Document Clustering Xiao Fu Kejun Huang Bo Yang Wing-Kin Ma N. Sidiropoulos 28 103 0 15 Aug 2016
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 2.2K 193,878 0 10 Dec 2015
Unsupervised Visual Representation Learning by Context Prediction Carl Doersch Abhinav Gupta Alexei A. Efros DRL SSL 164 2,781 0 19 May 2015
Microsoft COCO: Common Objects in Context Nayeon Lee Michael Maire Serge J. Belongie Lubomir Bourdev Ross B. Girshick James Hays Pietro Perona Deva Ramanan C. L. Zitnick Piotr Dollár ObjD 413 43,638 0 01 May 2014