v1v2 (latest)

Improving Self-Supervised Learning by Characterizing Idealized Representations

13 September 2022

Tatsunori Hashimoto

Papers citing "Improving Self-Supervised Learning by Characterizing Idealized Representations"

35 / 85 papers shown

Title
What Makes for Good Views for Contrastive Learning? Yonglong Tian Chen Sun Ben Poole Dilip Krishnan Cordelia Schmid Phillip Isola SSL 114 1,335 0 20 May 2020
Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hypersphere Tongzhou Wang Phillip Isola SSL 160 1,854 0 20 May 2020
On the Benefits of Invariance in Neural Networks Clare Lyle Mark van der Wilk Marta Z. Kwiatkowska Y. Gal Benjamin Bloem-Reddy OOD BDL 76 96 0 01 May 2020
Contrastive estimation reveals topic posterior information to linear models Christopher Tosh A. Krishnamurthy Daniel J. Hsu 53 64 0 04 Mar 2020
A Theory of Usable Information Under Computational Constraints Yilun Xu Shengjia Zhao Jiaming Song Russell Stewart Stefano Ermon 77 175 0 25 Feb 2020
Revealing the Structure of Deep Neural Networks via Convex Duality Tolga Ergen Mert Pilanci MLT 50 72 0 22 Feb 2020
Learning Robust Representations via Multi-View Information Bottleneck Marco Federici Anjan Dutta Patrick Forré Nate Kushman Zeynep Akata SLR 58 258 0 17 Feb 2020
A Simple Framework for Contrastive Learning of Visual Representations Ting-Li Chen Simon Kornblith Mohammad Norouzi Geoffrey E. Hinton SSL 375 18,859 0 13 Feb 2020
ClusterFit: Improving Generalization of Visual Representations Xueting Yan Ishan Misra Abhinav Gupta Deepti Ghadiyaram D. Mahajan SSL VLM 126 133 0 06 Dec 2019
Self-Supervised Learning of Pretext-Invariant Representations Ishan Misra Laurens van der Maaten SSL VLM 108 1,458 0 04 Dec 2019
Momentum Contrast for Unsupervised Visual Representation Learning Kaiming He Haoqi Fan Yuxin Wu Saining Xie Ross B. Girshick SSL 210 12,121 0 13 Nov 2019
Self-labelling via simultaneous clustering and representation learning Yuki M. Asano Christian Rupprecht Andrea Vedaldi SSL 123 777 0 13 Nov 2019
PAC-Bayesian Contrastive Unsupervised Representation Learning Kento Nozawa Pascal Germain Benjamin Guedj SSL BDL 63 28 0 10 Oct 2019
On Mutual Information Maximization for Representation Learning Michael Tschannen Josip Djolonga Paul Kishan Rubenstein Sylvain Gelly Mario Lucic SSL 179 501 0 31 Jul 2019
Contrastive Multiview Coding Yonglong Tian Dilip Krishnan Phillip Isola SSL 174 2,409 0 13 Jun 2019
Learning Representations by Maximizing Mutual Information Across Views Philip Bachman R. Devon Hjelm William Buchwalter SSL 195 1,477 0 03 Jun 2019
A Theoretical Analysis of Contrastive Unsupervised Representation Learning Sanjeev Arora H. Khandeparkar M. Khodak Orestis Plevrakis Nikunj Saunshi SSL 103 784 0 25 Feb 2019
The capacity of feedforward neural networks Pierre Baldi Roman Vershynin 51 68 0 02 Jan 2019
Small ReLU networks are powerful memorizers: a tight analysis of memorization capacity Chulhee Yun S. Sra Ali Jadbabaie 123 118 0 17 Oct 2018
Noise Contrastive Estimation and Negative Sampling for Conditional Models: Consistency and Statistical Efficiency Zhuang Ma Michael Collins 71 149 0 06 Sep 2018
Learning deep representations by mutual information estimation and maximization R. Devon Hjelm A. Fedorov Samuel Lavoie-Marchildon Karan Grewal Phil Bachman Adam Trischler Yoshua Bengio SSL DRL 335 2,672 0 20 Aug 2018
Deep Clustering for Unsupervised Learning of Visual Features Mathilde Caron Piotr Bojanowski Armand Joulin Matthijs Douze SSL 88 1,901 0 15 Jul 2018
Representation Learning with Contrastive Predictive Coding Aaron van den Oord Yazhe Li Oriol Vinyals DRL SSL 351 10,356 0 10 Jul 2018
Unsupervised Feature Learning via Non-Parametric Instance-level Discrimination Zhirong Wu Yuanjun Xiong Stella X. Yu Dahua Lin SSL 179 3,466 0 05 May 2018
Nearly-tight VC-dimension and pseudodimension bounds for piecewise linear neural networks Peter L. Bartlett Nick Harvey Christopher Liaw Abbas Mehrabian 211 434 0 08 Mar 2017
Joint Unsupervised Learning of Deep Representations and Image Clusters Jianwei Yang Devi Parikh Dhruv Batra SSL 57 818 0 13 Apr 2016
Colorful Image Colorization Richard Y. Zhang Phillip Isola Alexei A. Efros 149 3,532 0 28 Mar 2016
Exploring the Limits of Language Modeling Rafal Jozefowicz Oriol Vinyals M. Schuster Noam M. Shazeer Yonghui Wu 199 1,145 0 07 Feb 2016
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 2.2K 194,426 0 10 Dec 2015
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift Sergey Ioffe Christian Szegedy OOD 465 43,341 0 11 Feb 2015
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 2.0K 150,312 0 22 Dec 2014
Describing Textures in the Wild Mircea Cimpoi Subhransu Maji Iasonas Kokkinos S. Mohamed Andrea Vedaldi 3DV 141 2,689 0 14 Nov 2013
Accelerated Proximal Stochastic Dual Coordinate Ascent for Regularized Loss Minimization Shai Shalev-Shwartz Tong Zhang ODL 105 463 0 10 Sep 2013
Fine-Grained Visual Classification of Aircraft Subhransu Maji Esa Rahtu Arno Solin Matthew Blaschko Andrea Vedaldi 126 2,269 0 21 Jun 2013
Representation Learning: A Review and New Perspectives Yoshua Bengio Aaron Courville Pascal Vincent OOD SSL 274 12,458 0 24 Jun 2012