Neural Tangent Kernel: Convergence and Generalization in Neural Networks

20 June 2018

Papers citing "Neural Tangent Kernel: Convergence and Generalization in Neural Networks"

50 / 2,163 papers shown

Title
Explainable Neural Networks with Guarantees: A Sparse Estimation Approach Antoine Ledent Peng Liu FAtt 111 0 0 20 Feb 2025
Escaping from the Barren Plateau via Gaussian Initializations in Deep Variational Quantum Circuits Kaining Zhang Liu Liu Min-hsiu Hsieh Dacheng Tao 66 60 0 20 Feb 2025
Generalized Kernel Inducing Points by Duality Gap for Dataset Distillation Tatsuya Aoyama Hanting Yang Hiroyuki Hanada Satoshi Akahane Tomonari Tanaka ... Noriaki Hashimoto Taro Murayama Hanju Lee Shinya Kojima Ichiro Takeuchi 72 0 0 18 Feb 2025
Feature Learning Beyond the Edge of Stability Dávid Terjék MLT 48 0 0 18 Feb 2025
Linear Mode Connectivity in Differentiable Tree Ensembles Ryuichi Kanoh M. Sugiyama 75 1 0 17 Feb 2025
Fishing For Cheap And Efficient Pruners At Initialization Ivo Gollini Navarrete Nicolas Mauricio Cuadrado Jose Renato Restom Martin Takáč Samuel Horvath 51 0 0 17 Feb 2025
EquiTabPFN: A Target-Permutation Equivariant Prior Fitted Networks Michael Arbel David Salinas Frank Hutter 75 2 0 10 Feb 2025
Parameter Symmetry Breaking and Restoration Determines the Hierarchical Learning in AI Systems Liu Ziyin Yizhou Xu T. Poggio Isaac Chuang 52 4 0 07 Feb 2025
Online Clustering of Dueling Bandits Zhiyong Wang Jiahang Sun Mingze Kong Jize Xie Qinghua Hu J. C. Lui Zhongxiang Dai 83 0 0 04 Feb 2025
Deep Linear Network Training Dynamics from Random Initialization: Data, Width, Depth, and Hyperparameter Transfer Blake Bordelon Cengiz Pehlevan AI4CE 68 1 0 04 Feb 2025
Observation Noise and Initialization in Wide Neural Networks Sergio Calvo-Ordoñez Jonathan Plenk Richard Bergna Alvaro Cartea Jose Miguel Hernandez-Lobato Konstantina Palla Kamil Ciosek 64 1 0 03 Feb 2025
STAF: Sinusoidal Trainable Activation Functions for Implicit Neural Representation Alireza Morsali MohammadJavad Vaez Hossein Soltani A. Kazerouni Babak Taati Morteza Mohammad-Noori 195 1 0 02 Feb 2025
GraphMinNet: Learning Dependencies in Graphs with Light Complexity Minimal Architecture Md Atik Ahamed Andrew Cheng Qiang Ye Q. Cheng GNN 60 0 0 01 Feb 2025
On the study of frequency control and spectral bias in Wavelet-Based Kolmogorov Arnold networks: A path to physics-informed KANs Juan Daniel Meshir Abel Palafox Edgar Alejandro Guerrero 73 3 0 01 Feb 2025
Position: Curvature Matrices Should Be Democratized via Linear Operators Felix Dangel Runa Eschenhagen Weronika Ormaniec Andres Fernandez Lukas Tatzel Agustinus Kristiadi 61 3 0 31 Jan 2025
An Invitation to Neuroalgebraic Geometry Giovanni Luca Marchetti Vahid Shahverdi Stefano Mereta Matthew Trager Kathlén Kohn 119 2 0 31 Jan 2025
Scanning Trojaned Models Using Out-of-Distribution Samples Hossein Mirzaei Ali Ansari Bahar Dibaei Nia Mojtaba Nafez Moein Madadi ... Kian Shamsaie Mahdi Hajialilue Jafar Habibi Mohammad Sabokrou M. Rohban OODD 68 2 0 28 Jan 2025
Task Arithmetic in Trust Region: A Training-Free Model Merging Approach to Navigate Knowledge Conflicts Wenju Sun Qingyong Li Wen Wang Yangli-ao Geng Boyang Li 51 3 0 28 Jan 2025
MILP initialization for solving parabolic PDEs with PINNs Sirui Li Federica Bragone Matthieu Barreau Kateryna Morozovska 35 0 0 28 Jan 2025
On Learning Representations for Tabular Data Distillation Inwon Kang Parikshit Ram Yi Zhou Horst Samulowitz Oshani Seneviratne DD 73 0 0 23 Jan 2025
Physics of Skill Learning Ziming Liu Yizhou Liu Eric J. Michaud Jeff Gore Max Tegmark 54 2 0 21 Jan 2025
Generating visual explanations from deep networks using implicit neural representations Michal Byra Henrik Skibbe GAN FAtt 34 0 0 20 Jan 2025
Issues with Neural Tangent Kernel Approach to Neural Networks Haoran Liu Anthony S. Tai David J. Crandall Chunfeng Huang 42 0 0 19 Jan 2025
Flexible task abstractions emerge in linear networks with fast and bounded units Kai Sandbrink Jan P. Bauer A. Proca Andrew M. Saxe Christopher Summerfield Ali Hummos 63 2 0 17 Jan 2025
Globally Convergent Variational Inference Declan McNamara J. Loper Jeffrey Regier 55 0 0 14 Jan 2025
Derivation of effective gradient flow equations and dynamical truncation of training data in Deep Learning Thomas Chen 44 0 0 13 Jan 2025
Geometry and Optimization of Shallow Polynomial Networks Yossi Arjevani Joan Bruna Joe Kileel Elzbieta Polak Matthew Trager 36 1 0 10 Jan 2025
Time Transfer: On Optimal Learning Rate and Batch Size In The Infinite Data Limit Oleg Filatov Jan Ebert Jiangtao Wang Stefan Kesselheim 44 4 0 10 Jan 2025
Mean-Field Analysis for Learning Subspace-Sparse Polynomials with Gaussian Input Ziang Chen Rong Ge MLT 63 1 0 10 Jan 2025
Understanding How Nonlinear Layers Create Linearly Separable Features for Low-Dimensional Data Alec S. Xu Can Yaras Peng Wang Q. Qu 32 0 0 04 Jan 2025
Functional Risk Minimization Ferran Alet Clement Gehring Tomás Lozano-Pérez Kenji Kawaguchi Joshua B. Tenenbaum Leslie Pack Kaelbling OffRL 60 0 0 31 Dec 2024
Gauss-Newton Dynamics for Neural Networks: A Riemannian Optimization Perspective Semih Cayci 76 0 0 18 Dec 2024
On the Ability of Deep Networks to Learn Symmetries from Data: A Neural Kernel Theory Andrea Perin Stéphane Deny 97 2 0 16 Dec 2024
ANaGRAM: A Natural Gradient Relative to Adapted Model for efficient PINNs learning Nilo Schwencke Cyril Furtlehner 74 1 0 14 Dec 2024
Enhancing Implicit Neural Representations via Symmetric Power Transformation Weixiang Zhang Shuzhao Xie Chengwei Ren Shijia Ge Mingzi Wang Zhi Wang 87 2 0 12 Dec 2024
Is the neural tangent kernel of PINNs deep learning general partial differential equations always convergent ? Zijian Zhou Zhenya Yan 108 10 0 09 Dec 2024
GradAlign for Training-free Model Performance Inference Yuxuan Li Yunhui Guo 67 0 0 29 Nov 2024
FairDD: Fair Dataset Distillation via Synchronized Matching Qihang Zhou Shenhao Fang Shibo He Wenchao Meng Jiming Chen FedML DD 88 1 0 29 Nov 2024
Random Feature Models with Learnable Activation Functions Zailin Ma Jiansheng Yang Yaodong Yang 80 0 0 29 Nov 2024
Supervised Learning-enhanced Multi-Group Actor Critic for Live Stream Allocation in Feed Jingxin Liu Xiang Gao Yisha Li Xin Li Haiyang Lu Ben Wang OffRL 77 0 0 28 Nov 2024
What do physics-informed DeepONets learn? Understanding and improving training for scientific computing applications Emily Williams Amanda A. Howard B. Meuris P. Stinis AI4CE 76 0 0 27 Nov 2024
ExpTest: Automating Learning Rate Searching and Tuning with Insights from Linearized Neural Networks Zan Chaudhry Naoko Mizuno 84 0 0 25 Nov 2024
Fast training of large kernel models with delayed projections Amirhesam Abedsoltan Siyuan Ma Parthe Pandit Mikhail Belkin 69 0 0 25 Nov 2024
Proportional infinite-width infinite-depth limit for deep linear neural networks Federico Bassetti Lucia Ladelli P. Rotondo 80 1 0 22 Nov 2024
Accelerated zero-order SGD under high-order smoothness and overparameterized regime Georgii Bychkov D. Dvinskikh Anastasia Antsiferova Alexander Gasnikov Aleksandr Lobanov 68 0 0 21 Nov 2024
Superpixel-informed Implicit Neural Representation for Multi-Dimensional Data Jiayi Li Xile Zhao Jianli Wang Chao Wang Min Wang 80 1 0 18 Nov 2024
Infinite Width Limits of Self Supervised Neural Networks Maximilian Fleissner Gautham Govind Anil D. Ghoshdastidar SSL 220 0 0 17 Nov 2024
Continual Memorization of Factoids in Language Models Howard Chen Jiayi Geng Adithya Bhaskar Dan Friedman Danqi Chen KELM 59 0 0 11 Nov 2024
Variance-Aware Linear UCB with Deep Representation for Neural Contextual Bandits H. Bui Enrique Mallada Anqi Liu 189 0 0 08 Nov 2024
Boosting Latent Diffusion with Perceptual Objectives Tariq Berrada Pietro Astolfi Jakob Verbeek Melissa Hall Marton Havasi M. Drozdzal Yohann Benchetrit Adriana Romero Soriano Karteek Alahari 48 0 0 06 Nov 2024