On the Implicit Geometry of Cross-Entropy Parameterizations for Label-Imbalanced Data

14 March 2023

Tina Behnia

Ganesh Ramachandra Kini

V. Vakilian

Christos Thrampoulidis

ArXiv PDF HTML

Papers citing "On the Implicit Geometry of Cross-Entropy Parameterizations for Label-Imbalanced Data"

21 / 21 papers shown

Title
Enhancing Pre-Trained Model-Based Class-Incremental Learning through Neural Collapse Kun He Zijian Song Shuoxi Zhang J. Hopcroft CLL 56 0 0 25 Apr 2025
Implicit Geometry of Next-token Prediction: From Language Sparsity Patterns to Model Representations Yize Zhao Tina Behnia V. Vakilian Christos Thrampoulidis 55 8 0 20 Feb 2025
Class Imbalance in Anomaly Detection: Learning from an Exactly Solvable Model F.S. Pezzicoli V. Ros F.P. Landes M. Baity-Jesi 42 1 0 20 Jan 2025
Guiding Neural Collapse: Optimising Towards the Nearest Simplex Equiangular Tight Frame Evan Markou Thalaiyasingam Ajanthan Stephen Gould 26 0 0 02 Nov 2024
Training Over a Distribution of Hyperparameters for Enhanced Performance and Adaptability on Imbalanced Classification Kelsey Lieberman Swarna Kamlam Ravindran Shuai Yuan Carlo Tomasi OOD 35 0 0 04 Oct 2024
Beyond Unconstrained Features: Neural Collapse for Shallow Neural Networks with General Data Wanli Hong Shuyang Ling 34 3 0 03 Sep 2024
Supervised Contrastive Representation Learning: Landscape Analysis with Unconstrained Features Tina Behnia Christos Thrampoulidis SSL 33 0 0 29 Feb 2024
Optimizing for ROC Curves on Class-Imbalanced Data by Training over a Family of Loss Functions Kelsey Lieberman Shuai Yuan Swarna Kamlam Ravindran Carlo Tomasi 23 0 0 08 Feb 2024
Neural Collapse for Cross-entropy Class-Imbalanced Learning with Unconstrained ReLU Feature Model Hien Dang Tho Tran Tan Minh Nguyen Nhat Ho 15 11 0 04 Jan 2024
Neural Collapse in Multi-label Learning with Pick-all-label Loss Pengyu Li Xiao Li Yutong Wang Qing Qu 22 8 0 24 Oct 2023
Engineering the Neural Collapse Geometry of Supervised-Contrastive Loss Jaidev Gill V. Vakilian Christos Thrampoulidis 13 1 0 02 Oct 2023
Investigating the Catastrophic Forgetting in Multimodal Large Language Models Yuexiang Zhai Shengbang Tong Xiao Li Mu Cai Qing Qu Yong Jae Lee Y. Ma VLM MLLM CLL 77 78 0 19 Sep 2023
Neural Collapse for Unconstrained Feature Model under Cross-entropy Loss with Imbalanced Data Wanli Hong Shuyang Ling 28 14 0 18 Sep 2023
Neural Collapse Terminus: A Unified Solution for Class Incremental Learning and Its Variants Yibo Yang Haobo Yuan Xiangtai Li Jianlong Wu Lefei Zhang Zhouchen Lin Philip H. S. Torr Dacheng Tao Bernard Ghanem CLL 31 8 0 03 Aug 2023
Symmetric Neural-Collapse Representations with Supervised Contrastive Loss: The Impact of ReLU and Batching Ganesh Ramachandra Kini V. Vakilian Tina Behnia Jaidev Gill Christos Thrampoulidis 17 1 0 13 Jun 2023
Principled and Efficient Transfer Learning of Deep Models via Neural Collapse Xiao Li Sheng Liu Jin-li Zhou Xin Lu C. Fernandez‐Granda Zhihui Zhu Q. Qu AAML 28 18 0 23 Dec 2022
Implicit Bias of Large Depth Networks: a Notion of Rank for Nonlinear Functions Arthur Jacot 36 24 0 29 Sep 2022
Importance Tempering: Group Robustness for Overparameterized Models Yiping Lu Wenlong Ji Zachary Izzo Lexing Ying 39 7 0 19 Sep 2022
An Unconstrained Layer-Peeled Perspective on Neural Collapse Wenlong Ji Yiping Lu Yiliang Zhang Zhun Deng Weijie J. Su 127 83 0 06 Oct 2021
Exploring Deep Neural Networks via Layer-Peeled Model: Minority Collapse in Imbalanced Training Cong Fang Hangfeng He Qi Long Weijie J. Su FAtt 124 165 0 29 Jan 2021
An Investigation of Why Overparameterization Exacerbates Spurious Correlations Shiori Sagawa Aditi Raghunathan Pang Wei Koh Percy Liang 149 370 0 09 May 2020