VNE: An Effective Method for Improving Deep Representation by Manipulating Eigenvalue Distribution

4 April 2023

ArXiv (abs)PDF HTML Github (25★)

Papers citing "VNE: An Effective Method for Improving Deep Representation by Manipulating Eigenvalue Distribution"

46 / 46 papers shown

Title
Exploring Information-Theoretic Metrics Associated with Neural Collapse in Supervised Training Kun Song Zhiquan Tan Bochao Zou Jiansheng Chen Huimin Ma Weiran Huang 130 1 0 25 Sep 2024
Improving Forward Compatibility in Class Incremental Learning by Increasing Representation Rank and Feature Richness Jaeill Kim Wonseok Lee Moonjung Eo Wonjong Rhee CLL 97 0 0 22 Mar 2024
Understanding Dimensional Collapse in Contrastive Self-supervised Learning Li Jing Pascal Vincent Yann LeCun Yuandong Tian SSL 120 358 0 18 Oct 2021
Invariance Principle Meets Information Bottleneck for Out-of-Distribution Generalization Kartik Ahuja Ethan Caballero Dinghuai Zhang Jean-Christophe Gagnon-Audet Yoshua Bengio Ioannis Mitliagkas Irina Rish OOD 62 269 0 11 Jun 2021
VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learning Adrien Bardes Jean Ponce Yann LeCun SSL DML 153 944 0 11 May 2021
Contrastive Attraction and Contrastive Repulsion for Representation Learning Huangjie Zheng Xu Chen Jiangchao Yao Hongxia Yang Chunyuan Li Ya Zhang Hao Zhang Ivor Tsang Jingren Zhou Mingyuan Zhou SSL 80 12 0 08 May 2021
On Feature Decorrelation in Self-Supervised Learning Tianyu Hua Wenxiao Wang Zihui Xue Sucheng Ren Yue Wang Hang Zhao SSL OOD 183 195 0 02 May 2021
Whitening Sentence Representations for Better Semantics and Faster Retrieval Jianlin Su Jiarun Cao Weijie Liu Yangyiwen Ou 53 303 0 29 Mar 2021
Barlow Twins: Self-Supervised Learning via Redundancy Reduction Jure Zbontar Li Jing Ishan Misra Yann LeCun Stéphane Deny SSL 347 2,362 0 04 Mar 2021
SWAD: Domain Generalization by Seeking Flat Minima Junbum Cha Sanghyuk Chun Kyungjae Lee Han-Cheol Cho Seunghyun Park Yunsung Lee Sungrae Park MoMe 301 458 0 17 Feb 2021
Exploring Simple Siamese Representation Learning Xinlei Chen Kaiming He SSL 258 4,072 0 20 Nov 2020
Intriguing Properties of Contrastive Losses Ting Chen Calvin Luo Lala Li 72 177 0 05 Nov 2020
Hard Negative Mixing for Contrastive Learning Yannis Kalantidis Mert Bulent Sariyildiz Noé Pion Philippe Weinzaepfel Diane Larlus SSL 134 645 0 02 Oct 2020
Learning Optimal Representations with the Decodable Information Bottleneck Yann Dubois Douwe Kiela D. Schwab Ramakrishna Vedantam 85 43 0 27 Sep 2020
What Should Not Be Contrastive in Contrastive Learning Tete Xiao Xiaolong Wang Alexei A. Efros Trevor Darrell SSL DRL 82 303 0 13 Aug 2020
In Search of Lost Domain Generalization Ishaan Gulrajani David Lopez-Paz OOD 91 1,156 0 02 Jul 2020
Unsupervised Learning of Visual Features by Contrasting Cluster Assignments Mathilde Caron Ishan Misra Julien Mairal Priya Goyal Piotr Bojanowski Armand Joulin OCL SSL 261 4,098 0 17 Jun 2020
Bootstrap your own latent: A new approach to self-supervised Learning Jean-Bastien Grill Florian Strub Florent Altché Corentin Tallec Pierre Harvey Richemond ... M. G. Azar Bilal Piot Koray Kavukcuoglu Rémi Munos Michal Valko SSL 395 6,837 0 13 Jun 2020
What Makes for Good Views for Contrastive Learning? Yonglong Tian Chen Sun Ben Poole Dilip Krishnan Cordelia Schmid Phillip Isola SSL 114 1,335 0 20 May 2020
Improved Baselines with Momentum Contrastive Learning Xinlei Chen Haoqi Fan Ross B. Girshick Kaiming He SSL 492 3,443 0 09 Mar 2020
A Theory of Usable Information Under Computational Constraints Yilun Xu Shengjia Zhao Jiaming Song Russell Stewart Stefano Ermon 79 175 0 25 Feb 2020
A Simple Framework for Contrastive Learning of Visual Representations Ting-Li Chen Simon Kornblith Mohammad Norouzi Geoffrey E. Hinton SSL 378 18,866 0 13 Feb 2020
Self-Supervised Learning of Pretext-Invariant Representations Ishan Misra Laurens van der Maaten SSL VLM 108 1,458 0 04 Dec 2019
Rapid Learning or Feature Reuse? Towards Understanding the Effectiveness of MAML Aniruddh Raghu M. Raghu Samy Bengio Oriol Vinyals 305 647 0 19 Sep 2019
Torchmeta: A Meta-Learning library for PyTorch T. Deleu Tobias Würfl Mandana Samiei Joseph Paul Cohen Yoshua Bengio OffRL 74 85 0 14 Sep 2019
On Mutual Information Maximization for Representation Learning Michael Tschannen Josip Djolonga Paul Kishan Rubenstein Sylvain Gelly Mario Lucic SSL 179 501 0 31 Jul 2019
Contrastive Multiview Coding Yonglong Tian Dilip Krishnan Phillip Isola SSL 174 2,409 0 13 Jun 2019
Scaling and Benchmarking Self-Supervised Visual Representation Learning Priya Goyal D. Mahajan Abhinav Gupta Ishan Misra SSL 75 397 0 03 May 2019
Unsupervised Domain Adaptation using Feature-Whitening and Consensus Loss Subhankar Roy Aliaksandr Siarohin E. Sangineto Samuel Rota Buló N. Sebe Elisa Ricci 118 163 0 07 Mar 2019
A Style-Based Generator Architecture for Generative Adversarial Networks Tero Karras S. Laine Timo Aila 606 10,590 0 12 Dec 2018
Learning deep representations by mutual information estimation and maximization R. Devon Hjelm A. Fedorov Samuel Lavoie-Marchildon Karan Grewal Phil Bachman Adam Trischler Yoshua Bengio SSL DRL 335 2,672 0 20 Aug 2018
Recognition in Terra Incognita Sara Beery Grant Van Horn Pietro Perona 97 852 0 13 Jul 2018
Disentangling by Factorising Hyunjik Kim A. Mnih CoGe OOD 64 1,356 0 16 Feb 2018
Deep Neural Networks as Gaussian Processes Jaehoon Lee Yasaman Bahri Roman Novak S. Schoenholz Jeffrey Pennington Jascha Narain Sohl-Dickstein UQCV BDL 135 1,099 0 01 Nov 2017
Deeper, Broader and Artier Domain Generalization Da Li Yongxin Yang Yi-Zhe Song Timothy M. Hospedales OOD 124 1,451 0 09 Oct 2017
Deep Hashing Network for Unsupervised Domain Adaptation Hemanth Venkateswara José Eusébio Shayok Chakraborty S. Panchanathan OOD 147 2,057 0 22 Jun 2017
NormFace: L2 Hypersphere Embedding for Face Verification Feng Wang Xiang Xiang Jian Cheng Alan Yuille 3DH CVBM 71 745 0 21 Apr 2017
Mask R-CNN Kaiming He Georgia Gkioxari Piotr Dollár Ross B. Girshick ObjD 360 27,244 0 20 Mar 2017
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks Chelsea Finn Pieter Abbeel Sergey Levine OOD 829 11,943 0 09 Mar 2017
NIPS 2016 Tutorial: Generative Adversarial Networks Ian Goodfellow GAN 175 1,725 0 31 Dec 2016
SGDR: Stochastic Gradient Descent with Warm Restarts I. Loshchilov Frank Hutter ODL 350 8,174 0 13 Aug 2016
Matching Networks for One Shot Learning Oriol Vinyals Charles Blundell Timothy Lillicrap Koray Kavukcuoglu Daan Wierstra VLM 375 7,333 0 13 Jun 2016
Improved Techniques for Training GANs Tim Salimans Ian Goodfellow Wojciech Zaremba Vicki Cheung Alec Radford Xi Chen GAN 486 9,067 0 10 Jun 2016
Reducing Overfitting in Deep Networks by Decorrelating Representations Michael Cogswell Faruk Ahmed Ross B. Girshick C. L. Zitnick Dhruv Batra 84 415 0 19 Nov 2015
FaceNet: A Unified Embedding for Face Recognition and Clustering Florian Schroff Dmitry Kalenichenko James Philbin 3DH 388 13,145 0 12 Mar 2015
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift Sergey Ioffe Christian Szegedy OOD 465 43,341 0 11 Feb 2015