Prevalence of Neural Collapse during the terminal phase of deep learning training

18 August 2020

Papers citing "Prevalence of Neural Collapse during the terminal phase of deep learning training"

30 / 130 papers shown

Title
Maximum Class Separation as Inductive Bias in One Matrix Tejaswi Kasarla Gertjan J. Burghouts Max van Spengler Elise van der Pol Rita Cucchiara Pascal Mettes 26 22 0 17 Jun 2022
Neural Collapse: A Review on Modelling Principles and Generalization Vignesh Kothapalli 25 74 0 08 Jun 2022
Subject Membership Inference Attacks in Federated Learning Anshuman Suri Pallika H. Kanani Virendra J. Marathe Daniel W. Peterson 30 25 0 07 Jun 2022
Do More Negative Samples Necessarily Hurt in Contrastive Learning? Pranjal Awasthi Nishanth Dikkala Pritish Kamath 38 40 0 03 May 2022
Unsupervised Learning of Unbiased Visual Representations C. Barbano Enzo Tartaglione Marco Grangetto SSL CML OOD 30 1 0 26 Apr 2022
Perfectly Balanced: Improving Transfer and Robustness of Supervised Contrastive Learning Mayee F. Chen Daniel Y. Fu A. Narayan Michael Zhang Zhao Song Kayvon Fatahalian Christopher Ré SSL 32 47 0 15 Apr 2022
Efficient Maximal Coding Rate Reduction by Variational Forms Christina Baek Ziyang Wu Kwan Ho Ryan Chan Tianjiao Ding Yi Ma B. Haeffele 44 9 0 31 Mar 2022
On the Optimization Landscape of Neural Collapse under MSE Loss: Global Optimality with Unconstrained Features Jinxin Zhou Xiao Li Tian Ding Chong You Qing Qu Zhihui Zhu 30 99 0 02 Mar 2022
Robust Training under Label Noise by Over-parameterization Sheng Liu Zhihui Zhu Qing Qu Chong You NoLa OOD 27 106 0 28 Feb 2022
NeuroMixGDP: A Neural Collapse-Inspired Random Mixup for Private Data Release Donghao Li Yang Cao Yuan Yao 35 2 0 14 Feb 2022
Federated Optimization of Smooth Loss Functions Ali Jadbabaie A. Makur Devavrat Shah FedML 24 7 0 06 Jan 2022
Understanding Square Loss in Training Overparametrized Neural Network Classifiers Tianyang Hu Jun Wang Wei Cao Zhenguo Li UQCV AAML 41 19 0 07 Dec 2021
Impact of classification difficulty on the weight matrices spectra in Deep Learning and application to early-stopping Xuran Meng Jianfeng Yao 27 7 0 26 Nov 2021
A Survey on Hyperdimensional Computing aka Vector Symbolic Architectures, Part II: Applications, Cognitive Models, and Challenges Denis Kleyko D. Rachkovskij Evgeny Osipov A. Rahim 24 126 0 12 Nov 2021
Closed-Loop Data Transcription to an LDR via Minimaxing Rate Reduction Xili Dai Shengbang Tong Mingyang Li Ziyang Wu Michael Psenka ... Pengyuan Zhai Yaodong Yu Xiaojun Yuan Harry Shum Yi Ma 25 30 0 12 Nov 2021
Learning to Assimilate in Chaotic Dynamical Systems Michael McCabe Jed Brown AI4TS 36 10 0 01 Nov 2021
Imitating Deep Learning Dynamics via Locally Elastic Stochastic Differential Equations Jiayao Zhang Hua Wang Weijie J. Su 35 7 0 11 Oct 2021
Formalizing and Estimating Distribution Inference Risks Anshuman Suri David E. Evans MIACV 45 51 0 13 Sep 2021
The mathematics of adversarial attacks in AI -- Why deep learning is unstable despite the existence of stable neural networks Alexander Bastounis A. Hansen Verner Vlacic AAML OOD 32 28 0 13 Sep 2021
Learning to Give Checkable Answers with Prover-Verifier Games Cem Anil Guodong Zhang Yuhuai Wu Roger C. Grosse 19 15 0 27 Aug 2021
A Geometric Analysis of Neural Collapse with Unconstrained Features Zhihui Zhu Tianyu Ding Jinxin Zhou Xiao Li Chong You Jeremias Sulam Qing Qu 27 194 0 06 May 2021
Label-Imbalanced and Group-Sensitive Classification under Overparameterization Ganesh Ramachandra Kini Orestis Paraskevas Samet Oymak Christos Thrampoulidis 27 93 0 02 Mar 2021
Exploring Deep Neural Networks via Layer-Peeled Model: Minority Collapse in Imbalanced Training Cong Fang Hangfeng He Qi Long Weijie J. Su FAtt 130 167 0 29 Jan 2021
Neural Collapse with Cross-Entropy Loss Jianfeng Lu Stefan Steinerberger MLT 19 65 0 15 Dec 2020
On the emergence of simplex symmetry in the final and penultimate layers of neural network classifiers E. Weinan Stephan Wojtowytsch 33 43 0 10 Dec 2020
Neural collapse with unconstrained features D. Mixon Hans Parshall Jianzong Pi 28 114 0 23 Nov 2020
Gradient-Based Empirical Risk Minimization using Local Polynomial Regression Ali Jadbabaie A. Makur Devavrat Shah 28 6 0 04 Nov 2020
Deep regularization and direct training of the inner layers of Neural Networks with Kernel Flows G. Yoo H. Owhadi 24 21 0 19 Feb 2020
An Information Theoretic Interpretation to Deep Neural Networks Shao-Lun Huang Xiangxiang Xu Lizhong Zheng G. Wornell FAtt 22 41 0 16 May 2019
Convolutional Neural Networks Analyzed via Convolutional Sparse Coding Vardan Papyan Yaniv Romano Michael Elad 59 284 0 27 Jul 2016