Whitening for Self-Supervised Representation Learning

13 July 2020

Papers citing "Whitening for Self-Supervised Representation Learning"

48 / 48 papers shown

Title
seq-JEPA: Autoregressive Predictive Learning of Invariant-Equivariant World Models Hafez Ghaemi Eilif Muller Shahab Bakhtiari 138 0 0 06 May 2025
SSL Framework for Causal Inconsistency between Structures and Representations Hang Chen Xinyu Yang Keqing Du Wenya Wang 90 2 0 03 Jan 2025
Perception Stitching: Zero-Shot Perception Encoder Transfer for Visuomotor Robot Policies Pingcheng Jian Easop Lee Zachary I. Bell Michael M. Zavlanos Boyuan Chen 155 1 0 03 Jan 2025
A Survey of the Self Supervised Learning Mechanisms for Vision Transformers Asifullah Khan A. Sohail Mustansar Fiaz Mehdi Hassan Tariq Habib Afridi ... Muhammad Zaigham Zaheer Kamran Ali Tangina Sultana Ziaurrehman Tanoli Naeem Akhter 220 5 0 30 Aug 2024
Exploring Simple Siamese Representation Learning Xinlei Chen Kaiming He SSL 253 4,054 0 20 Nov 2020
BYOL works even without batch statistics Pierre Harvey Richemond Jean-Bastien Grill Florent Altché Corentin Tallec Florian Strub ... Samuel L. Smith Soham De Razvan Pascanu Bilal Piot Michal Valko SSL 295 115 0 20 Oct 2020
Understanding Self-supervised Learning with Dual Deep Networks Yuandong Tian Lantao Yu Xinlei Chen Surya Ganguli SSL 62 80 0 01 Oct 2020
3D Human Shape and Pose from a Single Low-Resolution Image with Self-Supervised Learning Xiangyu Xu Hao Chen Francesc Moreno-Noguer László A. Jeni Fernando de la Torre 3DH 60 51 0 27 Jul 2020
Unsupervised Learning of Visual Features by Contrasting Cluster Assignments Mathilde Caron Ishan Misra Julien Mairal Priya Goyal Piotr Bojanowski Armand Joulin OCL SSL 230 4,083 0 17 Jun 2020
Bootstrap your own latent: A new approach to self-supervised Learning Jean-Bastien Grill Florian Strub Florent Altché Corentin Tallec Pierre Harvey Richemond ... M. G. Azar Bilal Piot Koray Kavukcuoglu Rémi Munos Michal Valko SSL 368 6,806 0 13 Jun 2020
Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hypersphere Tongzhou Wang Phillip Isola SSL 157 1,840 0 20 May 2020
Improved Baselines with Momentum Contrastive Learning Xinlei Chen Haoqi Fan Ross B. Girshick Kaiming He SSL 481 3,433 0 09 Mar 2020
A Simple Framework for Contrastive Learning of Visual Representations Ting-Li Chen Simon Kornblith Mohammad Norouzi Geoffrey E. Hinton SSL 369 18,778 0 13 Feb 2020
Self-Supervised Learning of Pretext-Invariant Representations Ishan Misra Laurens van der Maaten SSL VLM 103 1,453 0 04 Dec 2019
Momentum Contrast for Unsupervised Visual Representation Learning Kaiming He Haoqi Fan Yuxin Wu Saining Xie Ross B. Girshick SSL 199 12,085 0 13 Nov 2019
On Mutual Information Maximization for Representation Learning Michael Tschannen Josip Djolonga Paul Kishan Rubenstein Sylvain Gelly Mario Lucic SSL 177 495 0 31 Jul 2019
Large Scale Adversarial Representation Learning Jeff Donahue Karen Simonyan SSL 130 543 0 04 Jul 2019
Contrastive Multiview Coding Yonglong Tian Dilip Krishnan Phillip Isola SSL 169 2,403 0 13 Jun 2019
Learning Representations by Maximizing Mutual Information Across Views Philip Bachman R. Devon Hjelm William Buchwalter SSL 189 1,475 0 03 Jun 2019
Data-Efficient Image Recognition with Contrastive Predictive Coding Olivier J. Hénaff A. Srinivas J. Fauw Ali Razavi Carl Doersch S. M. Ali Eslami Aaron van den Oord SSL 128 1,429 0 22 May 2019
Temporal Cycle-Consistency Learning Debidatta Dwibedi Y. Aytar Jonathan Tompson P. Sermanet Andrew Zisserman SSL AI4TS 88 275 0 16 Apr 2019
Unsupervised Embedding Learning via Invariant and Spreading Instance Feature Mang Ye Xu-Yao Zhang PongChi Yuen Shih-Fu Chang SSL 83 581 0 06 Apr 2019
Local Aggregation for Unsupervised Learning of Visual Embeddings Chengxu Zhuang Alex Zhai Daniel L. K. Yamins SSL 89 447 0 29 Mar 2019
Learning Speaker Representations with Mutual Information Mirco Ravanelli Yoshua Bengio SSL DRL 69 91 0 01 Dec 2018
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.8K 94,891 0 11 Oct 2018
Learning deep representations by mutual information estimation and maximization R. Devon Hjelm A. Fedorov Samuel Lavoie-Marchildon Karan Grewal Phil Bachman Adam Trischler Yoshua Bengio SSL DRL 320 2,662 0 20 Aug 2018
Invariant Information Clustering for Unsupervised Image Classification and Segmentation Xu Ji João F. Henriques Andrea Vedaldi SSL VLM 87 851 0 17 Jul 2018
Deep Clustering for Unsupervised Learning of Visual Features Mathilde Caron Piotr Bojanowski Armand Joulin Matthijs Douze SSL 88 1,898 0 15 Jul 2018
Representation Learning with Contrastive Predictive Coding Aaron van den Oord Yazhe Li Oriol Vinyals DRL SSL 320 10,302 0 10 Jul 2018
Whitening and Coloring batch transform for GANs Aliaksandr Siarohin E. Sangineto N. Sebe 80 50 0 01 Jun 2018
Decorrelated Batch Normalization Lei Huang Dawei Yang B. Lang Jia Deng 44 192 0 23 Apr 2018
Improved Regularization of Convolutional Neural Networks with Cutout Terrance Devries Graham W. Taylor 112 3,765 0 15 Aug 2017
Large Batch Training of Convolutional Networks Yang You Igor Gitman Boris Ginsburg ODL 128 848 0 13 Aug 2017
Scaling the Scattering Transform: Deep Hybrid Networks Edouard Oyallon Eugene Belilovsky Sergey Zagoruyko 56 160 0 27 Mar 2017
In Defense of the Triplet Loss for Person Re-Identification Alexander Hermans Lucas Beyer Bastian Leibe DML 78 3,206 0 22 Mar 2017
CliqueCNN: Deep Unsupervised Exemplar Learning Miguel Angel Bautista A. Sanakoyeu Ekaterina Tikhoncheva Bjorn Ommer SSL 74 114 0 31 Aug 2016
Asynchrony begets Momentum, with an Application to Deep Learning Jeff Donahue Philipp Krahenbuhl Stefan Hadjis Christopher Ré 92 142 0 31 May 2016
Context Encoders: Feature Learning by Inpainting Deepak Pathak Philipp Krahenbuhl Jeff Donahue Trevor Darrell Alexei A. Efros SSL 67 5,297 0 25 Apr 2016
Unsupervised Learning of Visual Representations by Solving Jigsaw Puzzles M. Noroozi Paolo Favaro SSL 171 2,980 0 30 Mar 2016
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 2.2K 194,020 0 10 Dec 2015
Convolutional Clustering for Unsupervised Learning Aysegül Dündar Jonghoon Jin Eugenio Culurciello SSL 41 84 0 19 Nov 2015
Stacked What-Where Auto-encoders Jiaqi Zhao Michaël Mathieu Ross Goroshin Yann LeCun DiffM BDL 57 258 0 08 Jun 2015
FaceNet: A Unified Embedding for Face Recognition and Clustering Florian Schroff Dmitry Kalenichenko James Philbin 3DH 370 13,145 0 12 Mar 2015
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift Sergey Ioffe Christian Szegedy OOD 463 43,305 0 11 Feb 2015
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 1.8K 150,115 0 22 Dec 2014
Discriminative Unsupervised Feature Learning with Exemplar Convolutional Neural Networks Alexey Dosovitskiy Philipp Fischer Jost Tobias Springenberg Martin Riedmiller Thomas Brox OOD SSL 84 1,021 0 26 Jun 2014
Distributed Representations of Words and Phrases and their Compositionality Tomas Mikolov Ilya Sutskever Kai Chen G. Corrado J. Dean NAI OCL 394 33,529 0 16 Oct 2013
Efficient Estimation of Word Representations in Vector Space Tomas Mikolov Kai Chen G. Corrado J. Dean 3DV 677 31,512 0 16 Jan 2013