Self-Supervised Learning with Kernel Dependence Maximization

15 June 2021

Papers citing "Self-Supervised Learning with Kernel Dependence Maximization"

48 / 48 papers shown

Title
PASS: An ImageNet replacement for self-supervised pretraining without humans Yuki M. Asano Christian Rupprecht Andrew Zisserman Andrea Vedaldi VLM SSL 75 58 0 27 Sep 2021
A Note on Connecting Barlow Twins with Negative-Sample-Free Contrastive Learning Yao-Hung Hubert Tsai Shaojie Bai Louis-Philippe Morency Ruslan Salakhutdinov SSL 43 38 0 28 Apr 2021
Efficient Visual Pretraining with Contrastive Detection Olivier J. Hénaff Skanda Koppula Jean-Baptiste Alayrac Aaron van den Oord Oriol Vinyals João Carreira VLM SSL 63 164 0 19 Mar 2021
Barlow Twins: Self-Supervised Learning via Redundancy Reduction Jure Zbontar Li Jing Ishan Misra Yann LeCun Stéphane Deny SSL 272 2,338 0 04 Mar 2021
Contrastive Learning Inverts the Data Generating Process Roland S. Zimmermann Yash Sharma Steffen Schneider Matthias Bethge Wieland Brendel SSL 264 218 0 17 Feb 2021
Exploring Simple Siamese Representation Learning Xinlei Chen Kaiming He SSL 245 4,036 0 20 Nov 2020
Intriguing Properties of Contrastive Losses Ting Chen Calvin Luo Lala Li 60 174 0 05 Nov 2020
Unsupervised Learning of Visual Features by Contrasting Cluster Assignments Mathilde Caron Ishan Misra Julien Mairal Priya Goyal Piotr Bojanowski Armand Joulin OCL SSL 213 4,065 0 17 Jun 2020
Bootstrap your own latent: A new approach to self-supervised Learning Jean-Bastien Grill Florian Strub Florent Altché Corentin Tallec Pierre Harvey Richemond ... M. G. Azar Bilal Piot Koray Kavukcuoglu Rémi Munos Michal Valko SSL 327 6,773 0 13 Jun 2020
Kernelized information bottleneck leads to biologically plausible 3-factor Hebbian learning in deep networks Roman Pogodin P. Latham 111 35 0 12 Jun 2020
Language Models are Few-Shot Learners Tom B. Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared Kaplan ... Christopher Berner Sam McCandlish Alec Radford Ilya Sutskever Dario Amodei BDL 602 41,736 0 28 May 2020
Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hypersphere Tongzhou Wang Phillip Isola SSL 128 1,826 0 20 May 2020
Improved Baselines with Momentum Contrastive Learning Xinlei Chen Haoqi Fan Ross B. Girshick Kaiming He SSL 446 3,422 0 09 Mar 2020
Information Condensing Active Learning Siddhartha Jain Ge Liu David K Gifford VLM 26 2 0 18 Feb 2020
A Simple Framework for Contrastive Learning of Visual Representations Ting-Li Chen Simon Kornblith Mohammad Norouzi Geoffrey E. Hinton SSL 321 18,686 0 13 Feb 2020
Towards Fairer Datasets: Filtering and Balancing the Distribution of the People Subtree in the ImageNet Hierarchy Kaiyu Yang Klint Qinami Li Fei-Fei Jia Deng Olga Russakovsky 108 320 0 16 Dec 2019
Momentum Contrast for Unsupervised Visual Representation Learning Kaiming He Haoqi Fan Yuxin Wu Saining Xie Ross B. Girshick SSL 161 12,050 0 13 Nov 2019
White-box vs Black-box: Bayes Optimal Strategies for Membership Inference Alexandre Sablayrolles Matthijs Douze Yann Ollivier Cordelia Schmid Hervé Jégou MIACV 62 364 0 29 Aug 2019
The HSIC Bottleneck: Deep Learning without Back-Propagation Kurt Wan-Duo Ma J. P. Lewis W. Kleijn BDL 65 130 0 05 Aug 2019
On Mutual Information Maximization for Representation Learning Michael Tschannen Josip Djolonga Paul Kishan Rubenstein Sylvain Gelly Mario Lucic SSL 154 493 0 31 Jul 2019
Using Self-Supervised Learning Can Improve Model Robustness and Uncertainty Dan Hendrycks Mantas Mazeika Saurav Kadavath D. Song OOD SSL 53 944 0 28 Jun 2019
Learning Representations by Maximizing Mutual Information Across Views Philip Bachman R. Devon Hjelm William Buchwalter SSL 187 1,467 0 03 Jun 2019
Data-Efficient Image Recognition with Contrastive Predictive Coding Olivier J. Hénaff A. Srinivas J. Fauw Ali Razavi Carl Doersch S. M. Ali Eslami Aaron van den Oord SSL 106 1,427 0 22 May 2019
On Variational Bounds of Mutual Information Ben Poole Sherjil Ozair Aaron van den Oord Alexander A. Alemi George Tucker SSL 90 806 0 16 May 2019
S4L: Self-Supervised Semi-Supervised Learning Xiaohua Zhai Avital Oliver Alexander Kolesnikov Lucas Beyer SSL VLM 103 790 0 09 May 2019
Training Neural Networks with Local Error Signals Arild Nøkland L. Eidnes 73 227 0 20 Jan 2019
Representation Learning with Contrastive Predictive Coding Aaron van den Oord Yazhe Li Oriol Vinyals DRL SSL 280 10,253 0 10 Jul 2018
Unsupervised Representation Learning by Predicting Image Rotations Spyros Gidaris Praveer Singh N. Komodakis OOD SSL DRL 227 3,283 0 21 Mar 2018
"Dependency Bottleneck" in Auto-encoding Architectures: an Empirical Study Denny Wu Yixiu Zhao Yao-Hung Hubert Tsai M. Yamada Ruslan Salakhutdinov 38 10 0 15 Feb 2018
Neural Discrete Representation Learning Aaron van den Oord Oriol Vinyals Koray Kavukcuoglu BDL SSL OCL 208 4,989 0 02 Nov 2017
Characteristic and Universal Tensor Product Kernels Z. Szabó Bharath K. Sriperumbudur 136 72 0 28 Aug 2017
Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour Priya Goyal Piotr Dollár Ross B. Girshick P. Noordhuis Lukasz Wesolowski Aapo Kyrola Andrew Tulloch Yangqing Jia Kaiming He 3DH 120 3,675 0 08 Jun 2017
Mask R-CNN Kaiming He Georgia Gkioxari Piotr Dollár Ross B. Girshick ObjD 344 27,129 0 20 Mar 2017
Feature Pyramid Networks for Object Detection Nayeon Lee Piotr Dollár Ross B. Girshick Kaiming He Bharath Hariharan Serge J. Belongie ObjD 437 22,040 0 09 Dec 2016
Fully Convolutional Networks for Semantic Segmentation Evan Shelhamer Jonathan Long Trevor Darrell VOS SSeg 525 37,806 0 20 May 2016
Context Encoders: Feature Learning by Inpainting Deepak Pathak Philipp Krahenbuhl Jeff Donahue Trevor Darrell Alexei A. Efros SSL 67 5,287 0 25 Apr 2016
Unsupervised Learning of Visual Representations by Solving Jigsaw Puzzles M. Noroozi Paolo Favaro SSL 154 2,978 0 30 Mar 2016
Colorful Image Colorization Richard Y. Zhang Phillip Isola Alexei A. Efros 124 3,530 0 28 Mar 2016
Learning Representations for Automatic Colorization Gustav Larsson Michael Maire Gregory Shakhnarovich VLM SSL 81 1,012 0 22 Mar 2016
Unsupervised Visual Representation Learning by Context Prediction Carl Doersch Abhinav Gupta Alexei A. Efros DRL SSL 164 2,782 0 19 May 2015
Deep Learning and the Information Bottleneck Principle Naftali Tishby Noga Zaslavsky DRL 161 1,580 0 09 Mar 2015
ImageNet Large Scale Visual Recognition Challenge Olga Russakovsky Jia Deng Hao Su J. Krause S. Satheesh ... A. Karpathy A. Khosla Michael S. Bernstein Alexander C. Berg Li Fei-Fei VLM ObjD 1.4K 39,472 0 01 Sep 2014
Microsoft COCO: Common Objects in Context Nayeon Lee Michael Maire Serge J. Belongie Lubomir Bourdev Ross B. Girshick James Hays Pietro Perona Deva Ramanan C. L. Zitnick Piotr Dollár ObjD 367 43,524 0 01 May 2014
Describing Textures in the Wild Mircea Cimpoi Subhransu Maji Iasonas Kokkinos S. Mohamed Andrea Vedaldi 3DV 92 2,661 0 14 Nov 2013
Fine-Grained Visual Classification of Aircraft Subhransu Maji Esa Rahtu Arno Solin Matthew Blaschko Andrea Vedaldi 107 2,252 0 21 Jun 2013
Equivalence of distance-based and RKHS-based statistics in hypothesis testing Dino Sejdinovic Bharath K. Sriperumbudur Arthur Gretton Kenji Fukumizu 191 683 0 25 Jul 2012
Algorithms for Learning Kernels Based on Centered Alignment Corinna Cortes M. Mohri Afshin Rostamizadeh 65 544 0 02 Mar 2012
Measuring and testing dependence by correlation of distances G. Székely Maria L. Rizzo N. K. Bakirov 230 2,592 0 28 Mar 2008