Neural Tangent Kernel: Convergence and Generalization in Neural Networks

20 June 2018

Papers citing "Neural Tangent Kernel: Convergence and Generalization in Neural Networks"

50 / 2,160 papers shown

Title
Hybrid Adaptive Modeling in Process Monitoring: Leveraging Sequence Encoders and Physics-Informed Neural Networks Mouad Elaarabi Domenico Borzacchiello Philippe Le Bot Nathan Lauzeral Sebastien Comas-Cardona PINN AI4CE 19 0 0 20 May 2025
Just One Layer Norm Guarantees Stable Extrapolation Juliusz Ziomek George Whittle Michael A. Osborne 7 0 0 20 May 2025
New Evidence of the Two-Phase Learning Dynamics of Neural Networks Zhanpeng Zhou Yongyi Yang Mahito Sugiyama Junchi Yan 2 0 0 20 May 2025
Rethink the Role of Deep Learning towards Large-scale Quantum Systems Yusheng Zhao Chi Zhang Yuxuan Du AI4CE 7 0 0 20 May 2025
Nonparametric Teaching for Graph Property Learners Chen Zhang Weixin Bu Z. Ren Zhengwu Liu Yik-Chung Wu Ngai Wong 12 0 0 20 May 2025
A Physics-Inspired Optimizer: Velocity Regularized Adam Pranav Vaidhyanathan Lucas Schorling Natalia Ares Michael A. Osborne ODL 2 0 0 19 May 2025
Enhancing Transformers Through Conditioned Embedded Tokens Hemanth Saratchandran Simon Lucey 9 0 0 19 May 2025
A Local Polyak-Lojasiewicz and Descent Lemma of Gradient Descent For Overparametrized Linear Models Ziqing Xu Hancheng Min Salma Tarmoun Enrique Mallada Rene Vidal 2 0 0 16 May 2025
Supervised Models Can Generalize Also When Trained on Random Labels Oskar Allerbo Thomas B. Schön OOD SSL 24 0 0 16 May 2025
The Power of Random Features and the Limits of Distribution-Free Gradient Descent Ari Karchmer Eran Malach 26 0 0 15 May 2025
SAD Neural Networks: Divergent Gradient Flows and Asymptotic Optimality via o-minimal Structures Julian Kranz Davide Gallon Steffen Dereich Arnulf Jentzen 29 0 0 14 May 2025
Neural Multivariate Regression: Qualitative Insights from the Unconstrained Feature Model George Andriopoulos Soyuj Jung Basnet Juan Guevara Li Guo Keith Ross 40 0 0 14 May 2025
Slow Transition to Low-Dimensional Chaos in Heavy-Tailed Recurrent Neural Networks Yi Xie Stefan Mihalas Łukasz Kuśmierz 26 0 0 14 May 2025
Super-fast rates of convergence for Neural Networks Classifiers under the Hard Margin Condition Nathanael Tepakbong Ding-Xuan Zhou Xiang Zhou 46 0 0 13 May 2025
An Analytical Characterization of Sloppiness in Neural Networks: Insights from Linear Models Jialin Mao Itay Griniasty Yan Sun Mark K. Transtrum James P. Sethna Pratik Chaudhari 29 0 0 13 May 2025
Block-Biased Mamba for Long-Range Sequence Processing Annan Yu N. Benjamin Erichson Mamba 47 0 0 13 May 2025
Learning cardiac activation and repolarization times with operator learning Edoardo Centofanti Giovanni Ziarelli N. Parolini Simone Scacchi M. Verani Luca Franco Pavarino AI4CE 31 0 0 13 May 2025
L-SWAG: Layer-Sample Wise Activation with Gradients information for Zero-Shot NAS on Vision Transformers S. Casarin Sergio Escalera Oswald Lanz 34 0 0 12 May 2025
Scaling Laws and Representation Learning in Simple Hierarchical Languages: Transformers vs. Convolutional Architectures Francesco Cagnetta Alessandro Favero Antonio Sclocchi M. Wyart 30 0 0 11 May 2025
A New Perspective To Understanding Multi-resolution Hash Encoding For Neural Fields Steven Tin Sui Luo 29 0 0 05 May 2025
Neural Logistic Bandits Seoungbin Bae Dabeen Lee 201 0 0 04 May 2025
Don't be lazy: CompleteP enables compute-efficient deep transformers Nolan Dey Bin Claire Zhang Lorenzo Noci Mufan Li Blake Bordelon Shane Bergsma Cengiz Pehlevan Boris Hanin Joel Hestness 44 1 0 02 May 2025
On the Importance of Gaussianizing Representations Daniel Eftekhari Vardan Papyan 31 0 0 01 May 2025
LENSLLM: Unveiling Fine-Tuning Dynamics for LLM Selection Xinyue Zeng Haohui Wang Junhong Lin Jun Wu Tyler Cody Dawei Zhou 160 0 0 01 May 2025
Multi-level datasets training method in Physics-Informed Neural Networks Yao-Hsuan Tsai Hsiao-Tung Juan Pao-Hsiung Chiu Chao-An Lin AI4CE 39 0 0 30 Apr 2025
Online Federation For Mixtures of Proprietary Agents with Black-Box Encoders Xuwei Yang Fatemeh Tavakoli D. B. Emerson Anastasis Kratsios FedML 62 0 0 30 Apr 2025
SFIBA: Spatial-based Full-target Invisible Backdoor Attacks Yangxu Yin H. Chen Yudong Gao Peng Sun Zehan Li Wei Liu AAML 45 0 0 29 Apr 2025
Sobolev norm inconsistency of kernel interpolation Yunfei Yang 34 0 0 29 Apr 2025
FFCBA: Feature-based Full-target Clean-label Backdoor Attacks Yangxu Yin H. Chen Yudong Gao Peng Sun Liantao Wu Zehan Li Wei Liu AAML 51 0 0 29 Apr 2025
Neuronal correlations shape the scaling behavior of memory capacity and nonlinear computational capability of recurrent neural networks Shotaro Takasu Toshio Aoyagi 34 0 0 28 Apr 2025
Ultra-fast feature learning for the training of two-layer neural networks in the two-timescale regime Raphael Barboni Gabriel Peyré François-Xavier Vialard MLT 39 0 0 25 Apr 2025
Gradient Descent as a Shrinkage Operator for Spectral Bias Simon Lucey 38 0 0 25 Apr 2025
Reliable and Efficient Inverse Analysis using Physics-Informed Neural Networks with Distance Functions and Adaptive Weight Tuning Shota Deguchi Mitsuteru Asai PINN AI4CE 81 0 0 25 Apr 2025
Deep learning with missing data Tianyi Ma Tengyao Wang R. Samworth 69 0 0 21 Apr 2025
How Learnable Grids Recover Fine Detail in Low Dimensions: A Neural Tangent Kernel Analysis of Multigrid Parametric Encodings Samuel Audia S. Feizi Matthias Zwicker Dinesh Manocha 28 0 0 18 Apr 2025
Hadamard product in deep learning: Introduction, Advances and Challenges Grigorios G. Chrysos Yongtao Wu Razvan Pascanu Philip Torr V. Cevher AAML 98 1 0 17 Apr 2025
Exact Learning Dynamics of In-Context Learning in Linear Transformers and Its Application to Non-Linear Transformers Nischal Mainali Lucas Teixeira 29 0 0 17 Apr 2025
Generalization through variance: how noise shapes inductive biases in diffusion models John J. Vastola DiffM 224 2 0 16 Apr 2025
Active Human Feedback Collection via Neural Contextual Dueling Bandits Arun Verma Xiaoqiang Lin Zhongxiang Dai Daniela Rus Bryan Kian Hsiang Low 37 0 0 16 Apr 2025
Neural Contextual Bandits Under Delayed Feedback Constraints Mohammadali Moghimi Sharu Theresa Jose Shana Moothedath 44 0 0 16 Apr 2025
Corner Gradient Descent Dmitry Yarotsky 41 0 0 16 Apr 2025
Leveraging Submodule Linearity Enhances Task Arithmetic Performance in LLMs Rui Dai Sile Hu Xu Shen Yonggang Zhang Xinmei Tian Jieping Ye MoMe 56 2 0 15 Apr 2025
When is Task Vector Provably Effective for Model Editing? A Generalization Analysis of Nonlinear Transformers Hongkang Li Yihua Zhang Shuai Zhang Ming Wang Sijia Liu Pin-Yu Chen MoMe 71 4 0 15 Apr 2025
Divergence of Empirical Neural Tangent Kernel in Classification Problems Zixiong Yu Songtao Tian Guhan Chen 28 0 0 15 Apr 2025
Cross-Frequency Implicit Neural Representation with Self-Evolving Parameters C. Yu Yisi Luo Kai Ye Xile Zhao Deyu Meng 26 0 0 15 Apr 2025
An overview of condensation phenomenon in deep learning Zhi-Qin John Xu Yaoyu Zhang Zhangchen Zhou AI4CE 29 0 0 13 Apr 2025
Statistically guided deep learning Michael Kohler A. Krzyżak ODL BDL 79 0 0 11 Apr 2025
Channel Estimation by Infinite Width Convolutional Networks Mohammed Mallik Guillaume Villemaud 24 0 0 11 Apr 2025
Free Random Projection for In-Context Reinforcement Learning Tomohiro Hayase B. Collins Nakamasa Inoue 26 0 0 09 Apr 2025
Comparative analysis of Realistic EMF Exposure Estimation from Low Density Sensor Network by Finite & Infinite Neural Networks Mohammed Mallik Laurent Clavier D. Gaillot 26 0 0 07 Apr 2025