Neural Tangent Kernel: Convergence and Generalization in Neural Networks

20 June 2018

Papers citing "Neural Tangent Kernel: Convergence and Generalization in Neural Networks"

50 / 2,163 papers shown

Title
Stochastic Kernel Regularisation Improves Generalisation in Deep Kernel Machines Edward Milsom Ben Anson Laurence Aitchison 28 0 0 08 Oct 2024
On the Impacts of the Random Initialization in the Neural Tangent Kernel Theory Guhan Chen Yicheng Li Qian Lin AAML 40 1 0 08 Oct 2024
SHAP values via sparse Fourier representation Ali Gorji Andisheh Amrollahi A. Krause FAtt 38 0 0 08 Oct 2024
Extended convexity and smoothness and their applications in deep learning Binchuan Qi Wei Gong Li Li 63 0 0 08 Oct 2024
FLOPS: Forward Learning with OPtimal Sampling Tao Ren Zishi Zhang Jinyang Jiang Guanghao Li Zeliang Zhang Mingqian Feng Yijie Peng 42 1 0 08 Oct 2024
Active Fine-Tuning of Generalist Policies Marco Bagatella Jonas Hübotter Georg Martius Andreas Krause 37 0 0 07 Oct 2024
Wide Neural Networks Trained with Weight Decay Provably Exhibit Neural Collapse Arthur Jacot Peter Súkeník Zihan Wang Marco Mondelli 31 2 0 07 Oct 2024
Strong Model Collapse Elvis Dohmatob Yunzhen Feng Arjun Subramonian Julia Kempe 30 10 0 07 Oct 2024
Fast Training of Sinusoidal Neural Fields via Scaling Initialization Taesun Yeom Sangyoon Lee Jaeho Lee 61 2 0 07 Oct 2024
The Optimization Landscape of SGD Across the Feature Learning Strength Alexander B. Atanasov Alexandru Meterez James B. Simon Cengiz Pehlevan 55 2 0 06 Oct 2024
Fundamental Limitations on Subquadratic Alternatives to Transformers Josh Alman Hantao Yu 23 2 0 05 Oct 2024
SGD with memory: fundamental properties and stochastic acceleration Dmitry Yarotsky Maksim Velikanov 40 1 0 05 Oct 2024
Simplicity bias and optimization threshold in two-layer ReLU networks Etienne Boursier Nicolas Flammarion 33 2 0 03 Oct 2024
Towards Better Generalization: Weight Decay Induces Low-rank Bias for Neural Networks Ke Chen Chugang Yi Haizhao Yang MLT 33 0 0 03 Oct 2024
EAB-FL: Exacerbating Algorithmic Bias through Model Poisoning Attacks in Federated Learning Syed Irfan Ali Meerza Jian-Dong Liu 48 2 0 02 Oct 2024
Tuning Frequency Bias of State Space Models Annan Yu Dongwei Lyu S. H. Lim Michael W. Mahoney N. Benjamin Erichson 47 3 0 02 Oct 2024
NTK-DFL: Enhancing Decentralized Federated Learning in Heterogeneous Settings via Neural Tangent Kernel Gabriel Thompson Kai Yue Chau-Wai Wong H. Dai FedML 23 0 0 02 Oct 2024
Ensembles provably learn equivariance through data augmentation Oskar Nordenfors Axel Flinth MLT 36 3 0 02 Oct 2024
Deep Kernel Posterior Learning under Infinite Variance Prior Weights Jorge Loría A. Bhadra BDL UQCV 66 0 0 02 Oct 2024
Investigating the Impact of Model Complexity in Large Language Models Jing Luo Huiyuan Wang Weiran Huang 41 0 0 01 Oct 2024
LaDTalk: Latent Denoising for Synthesizing Talking Head Videos with High Frequency Details Jian Yang Xukun Wang Wentao Wang Guoming Li Qihang Fang Ruihong Yuan Tianyang Wang Jason Zhaoxin Fan Yeying Jin Zhaoxin Fan VGen 47 1 0 01 Oct 2024
Frequency-adaptive Multi-scale Deep Neural Networks Jizu Huang Rukang You Tao Zhou AI4CE 33 1 0 28 Sep 2024
Sequencing the Neurome: Towards Scalable Exact Parameter Reconstruction of Black-Box Neural Networks Judah Goldfeder Quinten Roets Gabe Guo John Wright Hod Lipson 38 1 0 27 Sep 2024
On The Specialization of Neural Modules Devon Jarvis Richard Klein Benjamin Rosman Andrew M. Saxe 61 12 0 23 Sep 2024
Peer-to-Peer Learning Dynamics of Wide Neural Networks Shreyas Chaudhari Srinivasa Pranav Emile Anand José M. F. Moura 42 3 0 23 Sep 2024
From Lazy to Rich: Exact Learning Dynamics in Deep Linear Networks Clémentine Dominé Nicolas Anguita A. Proca Lukas Braun D. Kunin P. Mediano Andrew M. Saxe 40 3 0 22 Sep 2024
Unraveling the Hessian: A Key to Smooth Convergence in Loss Function Landscapes Nikita Kiselev Andrey Grabovoy 54 1 0 18 Sep 2024
Monomial Matrix Group Equivariant Neural Functional Networks Hoang V. Tran Thieu N. Vo Tho H. Tran An T. Nguyen Tan M. Nguyen 54 5 0 18 Sep 2024
Propulsion: Steering LLM with Tiny Fine-Tuning Md. Kowsher Nusrat Jahan Prottasha Prakash Bhat 51 4 0 17 Sep 2024
Realistic Extreme Behavior Generation for Improved AV Testing Robert Dyro Matthew Foutter Ruolin Li L. D. Lillo Edward Schmerling Xilin Zhou Marco Pavone AAML 38 1 0 16 Sep 2024
The Optimality of (Accelerated) SGD for High-Dimensional Quadratic Optimization Haihan Zhang Yuanshi Liu Qianwen Chen Cong Fang 38 0 0 15 Sep 2024
Learning Transferable Features for Implicit Neural Representations Kushal Vyas Ahmed Imtiaz Humayun Aniket Dashpute Richard G. Baraniuk Ashok Veeraraghavan Guha Balakrishnan OOD 101 2 0 15 Sep 2024
Transformed Physics-Informed Neural Networks for The Convection-Diffusion Equation Jiajing Guan Howard Elman 29 0 0 12 Sep 2024
AC-IND: Sparse CT reconstruction based on attenuation coefficient estimation and implicit neural distribution Wangduo Xie Richard Schoonhoven Tristan van Leeuwen Matthew B. Blaschko OOD 50 0 0 11 Sep 2024
Variational Search Distributions Daniel M. Steinberg Rafael Oliveira Cheng Soon Ong Edwin V. Bonilla 38 0 0 10 Sep 2024
Input Space Mode Connectivity in Deep Neural Networks Jakub Vrabel Ori Shem-Ur Yaron Oz David Krueger 60 1 0 09 Sep 2024
Unified Neural Network Scaling Laws and Scale-time Equivalence Akhilan Boopathy Ila Fiete 48 1 0 09 Sep 2024
On the Convergence Analysis of Over-Parameterized Variational Autoencoders: A Neural Tangent Kernel Perspective Li Wang Wei Huang DRL 26 0 0 09 Sep 2024
Breaking Neural Network Scaling Laws with Modularity Akhilan Boopathy Sunshine Jiang William Yue Jaedong Hwang Abhiram Iyer Ila Fiete OOD 57 2 0 09 Sep 2024
Efficient Training of Large Vision Models via Advanced Automated Progressive Learning Changlin Li Jiawei Zhang Sihao Lin Zongxin Yang Junwei Liang Xiaodan Liang Xiaojun Chang VLM 36 0 0 06 Sep 2024
Epistemic Uncertainty and Observation Noise with the Neural Tangent Kernel Sergio Calvo-Ordoñez Konstantina Palla Kamil Ciosek 42 1 0 06 Sep 2024
MDNF: Multi-Diffusion-Nets for Neural Fields on Meshes Avigail Cohen Rimon Tal Shnitzer Mirela Ben Chen 34 0 0 04 Sep 2024
Robust Fourier Neural Networks Halyun Jeong Jihun Han OOD 24 0 0 03 Sep 2024
Dataset Distillation from First Principles: Integrating Core Information Extraction and Purposeful Learning Vyacheslav Kungurtsev Yuanfang Peng Jianyang Gu Saeed Vahidian Anthony Quinn Fadwa Idlahcen Yiran Chen FedML DD 56 2 0 02 Sep 2024
On the Pinsker bound of inner product kernel regression in large dimensions Weihao Lu Jialin Ding Haobo Zhang Qian Lin 60 0 0 02 Sep 2024
Improving Adaptivity via Over-Parameterization in Sequence Models Yicheng Li Qian Lin 33 1 0 02 Sep 2024
Multi-Task Combinatorial Bandits for Budget Allocation Lin Ge Yang Xu Jianing Chu David Cramer Fuhong Li Kelly Paulson Rui Song 43 0 0 31 Aug 2024
Continual learning with the neural tangent ensemble Ari S. Benjamin Christian Pehle Kyle Daruwalla UQCV 70 0 0 30 Aug 2024
Theoretical Insights into Overparameterized Models in Multi-Task and Replay-Based Continual Learning Mohammadamin Banayeeanzade Mahdi Soltanolkotabi Mohammad Rostami CLL LRM 103 1 0 29 Aug 2024
Implicit Regularization Paths of Weighted Neural Representations Jin-Hong Du Pratik Patil 37 0 0 28 Aug 2024