On the Neural Tangent Kernel Analysis of Randomly Pruned Neural Networks

27 March 2022

Papers citing "On the Neural Tangent Kernel Analysis of Randomly Pruned Neural Networks"

10 / 10 papers shown

Title
When is Task Vector Provably Effective for Model Editing? A Generalization Analysis of Nonlinear Transformers Hongkang Li Yihua Zhang Shuai Zhang Hao Wu Sijia Liu Pin-Yu Chen MoMe 69 4 0 15 Apr 2025
Learning on Transformers is Provable Low-Rank and Sparse: A One-layer Analysis Hongkang Li Meng Wang Shuai Zhang Sijia Liu Pin-Yu Chen 35 6 0 24 Jun 2024
Equivariant Neural Tangent Kernels Philipp Misof Pan Kessel Jan E. Gerken 64 0 0 10 Jun 2024
Emergent Equivariance in Deep Ensembles Jan E. Gerken Pan Kessel UQCV MDE 38 6 0 05 Mar 2024
"Lossless" Compression of Deep Neural Networks: A High-dimensional Neural Tangent Kernel Approach Lingyu Gu Yongqiang Du Yuan Zhang Di Xie Shiliang Pu Robert C. Qiu Zhenyu Liao 38 6 0 01 Mar 2024
How Do Nonlinear Transformers Learn and Generalize in In-Context Learning? Hongkang Li Meng Wang Songtao Lu Xiaodong Cui Pin-Yu Chen MLT 42 14 0 23 Feb 2024
Iterative Magnitude Pruning as a Renormalisation Group: A Study in The Context of The Lottery Ticket Hypothesis Abu-Al Hassan 33 0 0 06 Aug 2023
Fast Neural Kernel Embeddings for General Activations Insu Han A. Zandieh Jaehoon Lee Roman Novak Lechao Xiao Amin Karbasi 56 18 0 09 Sep 2022
Sparsity Winning Twice: Better Robust Generalization from More Efficient Training Tianlong Chen Zhenyu (Allen) Zhang Pengju Wang Santosh Balachandra Haoyu Ma Zehao Wang Zhangyang Wang OOD AAML 90 47 0 20 Feb 2022
The Lottery Ticket Hypothesis for Pre-trained BERT Networks Tianlong Chen Jonathan Frankle Shiyu Chang Sijia Liu Yang Zhang Zhangyang Wang Michael Carbin 156 377 0 23 Jul 2020