v1v2v3v4 (latest)

Neural Tangent Kernel: Convergence and Generalization in Neural Networks

20 June 2018

Papers citing "Neural Tangent Kernel: Convergence and Generalization in Neural Networks"

50 / 1,193 papers shown

Title
Learning Multi-Index Models with Neural Networks via Mean-Field Langevin Dynamics Alireza Mousavi-Hosseini Denny Wu Murat A. Erdogdu MLT AI4CE 99 8 0 14 Aug 2024
Risk and cross validation in ridge regression with correlated samples Alexander B. Atanasov Jacob A. Zavatone-Veth Cengiz Pehlevan 103 5 0 08 Aug 2024
Gradient flow in parameter space is equivalent to linear interpolation in output space Thomas Chen Patrícia Muñoz Ewald 72 1 0 02 Aug 2024
Spring-block theory of feature learning in deep neural networks Chengzhi Shi Liming Pan Ivan Dokmanić AI4CE 134 1 0 28 Jul 2024
$u-$\mu$P: The Unit-Scaled Maximal Update Parametrization$ u- $\mu$ P: The Unit-Scaled Maximal Update Parametrization Charlie Blake C. Eichenberg Josef Dean Lukas Balles Luke Y. Prince Bjorn Deiseroth Andres Felipe Cruz Salinas Carlo Luschi Samuel Weinbach Douglas Orr 123 10 0 24 Jul 2024
Neural Dueling Bandits: Preference-Based Optimization with Human Feedback Arun Verma Zhongxiang Dai Xiaoqiang Lin Patrick Jaillet K. H. Low 187 6 0 24 Jul 2024
Parameter-Efficient Fine-Tuning for Continual Learning: A Neural Tangent Kernel Perspective Jingren Liu Zhong Ji YunLong Yu Jiale Cao Yanwei Pang Jungong Han Xuelong Li CLL 142 5 0 24 Jul 2024
Deep Learning without Global Optimization by Random Fourier Neural Networks Owen Davis Gianluca Geraci Mohammad Motamed BDL 133 0 0 16 Jul 2024
A Generalization Bound for Nearly-Linear Networks Eugene Golikov 78 0 0 09 Jul 2024
Frequency and Generalisation of Periodic Activation Functions in Reinforcement Learning Augustine N. Mavor-Parker Matthew J. Sargent Caswell Barry Lewis D. Griffin Clare Lyle 118 2 0 09 Jul 2024
How DNNs break the Curse of Dimensionality: Compositionality and Symmetry Learning Arthur Jacot Seok Hoan Choi Yuxiao Wen AI4CE 143 2 0 08 Jul 2024
MALT Powers Up Adversarial Attacks Odelia Melamed Gilad Yehudai Adi Shamir AAML 51 0 0 02 Jul 2024
Infinite Width Models That Work: Why Feature Learning Doesn't Matter as Much as You Think Luke Sernau 53 0 0 27 Jun 2024
WARP: On the Benefits of Weight Averaged Rewarded Policies Alexandre Ramé Johan Ferret Nino Vieillard Robert Dadashi Léonard Hussenot Pierre-Louis Cedoz Pier Giuseppe Sessa Sertan Girgin Arthur Douillard Olivier Bachem 134 23 0 24 Jun 2024
Neural Lineage Runpeng Yu Xinchao Wang 102 4 0 17 Jun 2024
Loss Gradient Gaussian Width based Generalization and Optimization Guarantees A. Banerjee Qiaobo Li Yingxue Zhou 162 0 0 11 Jun 2024
Equivariant Neural Tangent Kernels Philipp Misof Pan Kessel Jan E. Gerken 214 0 0 10 Jun 2024
Nonlinear Transformations Against Unlearnable Datasets T. Hapuarachchi Jing Lin Kaiqi Xiong Mohamed Rahouti Gitte Ost 89 1 0 05 Jun 2024
Reparameterization invariance in approximate Bayesian inference Hrittik Roy M. Miani Carl Henrik Ek Philipp Hennig Marvin Pfortner Lukas Tatzel Søren Hauberg BDL 119 9 0 05 Jun 2024
Learning Analysis of Kernel Ridgeless Regression with Asymmetric Kernel Learning Fan He Mingzhe He Lei Shi Xiaolin Huang Johan A. K. Suykens 68 1 0 03 Jun 2024
Exploring the Practicality of Federated Learning: A Survey Towards the Communication Perspective Khiem H. Le Nhan Luong-Ha Manh Nguyen-Duc Danh Le-Phuoc Cuong D. Do Kok-Seng Wong FedML 71 1 0 30 May 2024
Growing Tiny Networks: Spotting Expressivity Bottlenecks and Fixing Them Optimally Manon Verbockhaven Sylvain Chevallier Guillaume Charpiat 69 4 0 30 May 2024
Survival of the Fittest Representation: A Case Study with Modular Addition Xiaoman Delores Ding Zifan Carl Guo Eric J. Michaud Ziming Liu Max Tegmark 121 4 0 27 May 2024
When does compositional structure yield compositional generalization? A kernel theory Samuel Lippl Kim Stachenfeld NAI CoGe 253 10 0 26 May 2024
Infinite Limits of Multi-head Transformer Dynamics Blake Bordelon Hamza Tahir Chaudhry Cengiz Pehlevan AI4CE 117 14 0 24 May 2024
Learning Beyond Pattern Matching? Assaying Mathematical Understanding in LLMs Siyuan Guo Aniket Didolkar Nan Rosemary Ke Anirudh Goyal Ferenc Huszár Bernhard Schölkopf 91 5 0 24 May 2024
A rationale from frequency perspective for grokking in training neural network Zhangchen Zhou Yaoyu Zhang Z. Xu 88 2 0 24 May 2024
Repetita Iuvant: Data Repetition Allows SGD to Learn High-Dimensional Multi-Index Functions Luca Arnaboldi Yatin Dandi Florent Krzakala Luca Pesce Ludovic Stephan 139 18 0 24 May 2024
RoPINN: Region Optimized Physics-Informed Neural Networks Haixu Wu Huakun Luo Yuezhou Ma Jianmin Wang Mingsheng Long AI4CE 73 9 0 23 May 2024
Connectivity Shapes Implicit Regularization in Matrix Factorization Models for Matrix Completion Zhiwei Bai Jiajie Zhao Yaoyu Zhang AI4CE 102 0 0 22 May 2024
Restoring balance: principled under/oversampling of data for optimal classification Emanuele Loffredo Mauro Pastore Simona Cocco R. Monasson 112 9 0 15 May 2024
Spectral complexity of deep neural networks Simmaco Di Lillo Domenico Marinucci Michele Salvi Stefano Vigogna BDL 171 2 0 15 May 2024
Analysis of the rate of convergence of an over-parametrized convolutional neural network image classifier learned by gradient descent Michael Kohler A. Krzyżak Benjamin Walter 89 1 0 13 May 2024
Thermodynamic limit in learning period three Yuichiro Terasaki Kohei Nakajima 148 1 0 12 May 2024
High dimensional analysis reveals conservative sharpening and a stochastic edge of stability Atish Agarwala Jeffrey Pennington 112 4 0 30 Apr 2024
Efficient and accurate neural field reconstruction using resistive memory Yifei Yu Shaocong Wang Woyu Zhang Xinyuan Zhang Xiuzhe Wu ... Zhongrui Wang Dashan Shang Qi Liu Kwang-Ting Cheng Ming-Yuan Liu 71 0 0 15 Apr 2024
Regularized Gradient Clipping Provably Trains Wide and Deep Neural Networks Matteo Tucat Anirbit Mukherjee Procheta Sen Mingfei Sun Omar Rivasplata MLT 89 1 0 12 Apr 2024
PINNACLE: PINN Adaptive ColLocation and Experimental points selection Gregory Kang Ruey Lau Apivich Hemachandra See-Kiong Ng K. H. Low 3DPC 121 20 0 11 Apr 2024
Log-PDE Methods for Rough Signature Kernels M. Lemercier Terry Lyons C. Salvi 193 3 0 01 Apr 2024
Learning in PINNs: Phase transition, total diffusion, and generalization Sokratis J. Anagnostopoulos Juan Diego Toscano Nikolaos Stergiopulos George Karniadakis 75 11 0 27 Mar 2024
Approximation with Random Shallow ReLU Networks with Applications to Model Reference Adaptive Control Andrew G. Lamperski Tyler Lekang 53 3 0 25 Mar 2024
Data-centric Prediction Explanation via Kernelized Stein Discrepancy Mahtab Sarvmaili Hassan Sajjad Ga Wu 212 1 0 22 Mar 2024
Neural Parameter Regression for Explicit Representations of PDE Solution Operators Konrad Mundinger Max Zimmer Sebastian Pokutta 98 1 0 19 Mar 2024
$How does promoting the minority fraction affect generalization? A theoretical study of the one-hidden-layer neural network on group imbalance$ How does promoting the minority fraction affect generalization? A theoretical study of the one-hidden-layer neural network on group imbalance Hongkang Li Shuai Zhang Yihua Zhang Meng Wang Sijia Liu Pin-Yu Chen 103 4 0 12 Mar 2024
Early Directional Convergence in Deep Homogeneous Neural Networks for Small Initializations Akshay Kumar Jarvis Haupt ODL 105 4 0 12 Mar 2024
Disentangling the Causes of Plasticity Loss in Neural Networks Clare Lyle Zeyu Zheng Khimya Khetarpal H. V. Hasselt Razvan Pascanu James Martens Will Dabney AI4CE 130 38 0 29 Feb 2024
Principled Architecture-aware Scaling of Hyperparameters Wuyang Chen Junru Wu Zhangyang Wang Boris Hanin AI4CE 104 0 0 27 Feb 2024
Watch Your Head: Assembling Projection Heads to Save the Reliability of Federated Models Jinqian Chen Jihua Zhu Qinghai Zheng Zhongyu Li Zhiqiang Tian FedML 95 3 0 26 Feb 2024
Energy-efficiency Limits on Training AI Systems using Learning-in-Memory Zihao Chen Johannes Leugering Gert Cauwenberghs S. Chakrabartty 42 0 0 21 Feb 2024
Depth Separation in Norm-Bounded Infinite-Width Neural Networks Suzanna Parkinson Greg Ongie Rebecca Willett Ohad Shamir Nathan Srebro MDE 82 3 0 13 Feb 2024