Heavy-Tailed Regularization of Weight Matrices in Deep Neural Networks

6 April 2023

Papers citing "Heavy-Tailed Regularization of Weight Matrices in Deep Neural Networks"

3 / 3 papers shown

Title
AlphaPruning: Using Heavy-Tailed Self Regularization Theory for Improved Layer-wise Pruning of Large Language Models Haiquan Lu Yefan Zhou Shiwei Liu Zhangyang Wang Michael W. Mahoney Yaoqing Yang 39 2 0 14 Oct 2024
OwLore: Outlier-weighed Layerwise Sampled Low-Rank Projection for Memory-Efficient LLM Fine-tuning Pengxiang Li Lu Yin Xiaowei Gao Shiwei Liu 41 0 0 28 May 2024
Temperature Balancing, Layer-wise Weight Analysis, and Neural Network Training Yefan Zhou Tianyu Pang Keqin Liu Charles H. Martin Michael W. Mahoney Yaoqing Yang 78 7 0 01 Dec 2023