Neural Tangent Kernel: Convergence and Generalization in Neural Networks

20 June 2018

Papers citing "Neural Tangent Kernel: Convergence and Generalization in Neural Networks"

50 / 2,163 papers shown

Title
Do Mice Grok? Glimpses of Hidden Progress During Overtraining in Sensory Cortex Tanishq Kumar Blake Bordelon Cengiz Pehlevan Venkatesh N. Murthy Samuel Gershman OOD CLL SSL 53 0 0 05 Nov 2024
Gradient Descent Finds Over-Parameterized Neural Networks with Sharp Generalization for Nonparametric Regression Yingzhen Yang Ping Li MLT 37 0 0 05 Nov 2024
TokenSelect: Efficient Long-Context Inference and Length Extrapolation for LLMs via Dynamic Token-Level KV Cache Selection Wei Wu Zhuoshi Pan Chao Wang L. Chen Y. Bai Kun Fu Zehua Wang Hui Xiong Hui Xiong LLMAG 44 5 0 05 Nov 2024
Pseudo-Probability Unlearning: Towards Efficient and Privacy-Preserving Machine Unlearning Zihao Zhao Yijiang Li Yuqing Yang Wenqing Zhang Nuno Vasconcelos Yinzhi Cao MU 30 1 0 04 Nov 2024
Local Loss Optimization in the Infinite Width: Stable Parameterization of Predictive Coding Networks and Target Propagation Satoki Ishikawa Rio Yokota Ryo Karakida 46 0 0 04 Nov 2024
Theoretical characterisation of the Gauss-Newton conditioning in Neural Networks Jim Zhao Sidak Pal Singh Aurelien Lucchi AI4CE 48 0 0 04 Nov 2024
PageRank Bandits for Link Prediction Yikun Ban Jiaru Zou Zihao Li Yunzhe Qi Dongqi Fu Jian Kang Hanghang Tong Jingrui He 48 3 0 03 Nov 2024
CRONOS: Enhancing Deep Learning with Scalable GPU Accelerated Convex Neural Networks Miria Feng Zachary Frangella Mert Pilanci BDL 48 1 0 02 Nov 2024
Private, Augmentation-Robust and Task-Agnostic Data Valuation Approach for Data Marketplace Tayyebeh Jahani-Nezhad Parsa Moradi M. Maddah-ali Giuseppe Caire 31 0 0 01 Nov 2024
Improving self-training under distribution shifts via anchored confidence with theoretical guarantees Taejong Joo Diego Klabjan UQCV 51 0 0 01 Nov 2024
Local Superior Soups: A Catalyst for Model Merging in Cross-Silo Federated Learning Minghui Chen Meirui Jiang Xin Zhang Qi Dou Zehua Wang Xiaoxiao Li MoMe FedML 50 2 0 31 Oct 2024
An Application of the Holonomic Gradient Method to the Neural Tangent Kernel Akihiro Sakoda Nobuki Takayama 21 0 0 31 Oct 2024
Kernel-Based Function Approximation for Average Reward Reinforcement Learning: An Optimist No-Regret Algorithm Sattar Vakili Julia Olkhovskaya 33 0 0 30 Oct 2024
Understanding Representation of Deep Equilibrium Models from Neural Collapse Perspective Haixiang Sun Ye Shi 42 0 0 30 Oct 2024
Estimating Neural Network Robustness via Lipschitz Constant and Architecture Sensitivity Abulikemu Abuduweili Changliu Liu 29 1 0 30 Oct 2024
Predicting the Encoding Error of SIRENs Jeremy Vonderfecht Feng Liu AI4CE 40 3 0 29 Oct 2024
Modular Duality in Deep Learning Jeremy Bernstein Laker Newhouse 24 4 0 28 Oct 2024
Plastic Learning with Deep Fourier Features Alex Lewandowski Dale Schuurmans Marlos C. Machado CLL 47 3 0 27 Oct 2024
Emergence of Globally Attracting Fixed Points in Deep Neural Networks With Nonlinear Activations Amir Joudaki Thomas Hofmann MLT 23 0 0 26 Oct 2024
Connecting Joint-Embedding Predictive Architecture with Contrastive Self-supervised Learning Shentong Mo Shengbang Tong 40 1 0 25 Oct 2024
A Random Matrix Theory Perspective on the Spectrum of Learned Features and Asymptotic Generalization Capabilities Yatin Dandi Luca Pesce Hugo Cui Florent Krzakala Yue M. Lu Bruno Loureiro MLT 39 1 0 24 Oct 2024
Diffusion Attribution Score: Evaluating Training Data Influence in Diffusion Models Jinxu Lin Linwei Tao Minjing Dong Chang Xu TDI 44 2 0 24 Oct 2024
Rethinking generalization of classifiers in separable classes scenarios and over-parameterized regimes Julius Martinetz C. Linse Thomas Martinetz 28 0 0 22 Oct 2024
Theoretical Limitations of Ensembles in the Age of Overparameterization Niclas Dern John P. Cunningham Geoff Pleiss BDL UQCV 36 0 0 21 Oct 2024
Robust Feature Learning for Multi-Index Models in High Dimensions Alireza Mousavi-Hosseini Adel Javanmard Murat A. Erdogdu OOD AAML 46 1 0 21 Oct 2024
Offline-to-online Reinforcement Learning for Image-based Grasping with Scarce Demonstrations Bryan Chan Anson Leung James Bergstra OffRL OnRL 64 0 0 19 Oct 2024
A Lipschitz spaces view of infinitely wide shallow neural networks Francesca Bartolucci Marcello Carioni José A. Iglesias Yury Korolev Emanuele Naldi Stefano Vigogna 23 0 0 18 Oct 2024
SurgeryV2: Bridging the Gap Between Model Merging and Multi-Task Learning with Deep Representation Surgery Enneng Yang Li Shen Zhenyi Wang G. Guo Xingwei Wang Xiaocun Cao Jie Zhang Dacheng Tao MoMe 37 4 0 18 Oct 2024
Generalization for Least Squares Regression With Simple Spiked Covariances Jiping Li Rishi Sonthalia 28 0 0 17 Oct 2024
Analyzing Deep Transformer Models for Time Series Forecasting via Manifold Learning Ilya Kaufman Omri Azencot AI4TS 31 2 0 17 Oct 2024
Inductive Gradient Adjustment For Spectral Bias In Implicit Neural Representations Kexuan Shi Hai Chen Leheng Zhang Shuhang Gu 33 1 0 17 Oct 2024
Loss Landscape Characterization of Neural Networks without Over-Parametrization Rustem Islamov Niccolò Ajroldi Antonio Orvieto Aurelien Lucchi 43 4 0 16 Oct 2024
Towards Neural Scaling Laws for Time Series Foundation Models Qingren Yao Chao-Han Huck Yang Renhe Jiang Keli Zhang Ming Jin Shirui Pan AI4TS AI4CE 47 8 0 16 Oct 2024
LLM-Mixer: Multiscale Mixing in LLMs for Time Series Forecasting Md. Kowsher Md. Shohanur Islam Sobuj Nusrat Jahan Prottasha E. Alejandro Alanis O. Garibay Niloofar Yousefi AI4TS 37 0 0 15 Oct 2024
Calabi-Yau metrics through Grassmannian learning and Donaldson's algorithm Carl Henrik Ek Oisin Kim Challenger Mishra 21 2 0 15 Oct 2024
Geometric Inductive Biases of Deep Networks: The Role of Data and Architecture Sajad Movahedi Antonio Orvieto Seyed-Mohsen Moosavi-Dezfooli AI4CE AAML 207 0 0 15 Oct 2024
RoCoFT: Efficient Finetuning of Large Language Models with Row-Column Updates Md. Kowsher Tara Esmaeilbeig Chun-Nam Yu Mojtaba Soltanalian Niloofar Yousefi 37 0 0 14 Oct 2024
Sharper Guarantees for Learning Neural Network Classifiers with Gradient Methods Hossein Taheri Christos Thrampoulidis Arya Mazumdar MLT 36 0 0 13 Oct 2024
Magnituder Layers for Implicit Neural Representations in 3D Sang Min Kim Byeongchan Kim Arijit Sehanobish Krzysztof Choromanski Dongseok Shim Avinava Dubey Min Hwan Oh AI4CE 39 0 0 13 Oct 2024
MUSO: Achieving Exact Machine Unlearning in Over-Parameterized Regimes Ruikai Yang M. He Zhengbao He Youmei Qiu X. Huang MU BDL 42 1 0 11 Oct 2024
Deeper Insights into Deep Graph Convolutional Networks: Stability and Generalization Guangrui Yang Ming Li Han Feng Xiaosheng Zhuang GNN OOD BDL 35 2 0 11 Oct 2024
Adversarial Training Can Provably Improve Robustness: Theoretical Analysis of Feature Learning Process Under Structured Data Binghui Li Yuanzhi Li OOD 38 2 0 11 Oct 2024
Correspondence of NNGP Kernel and the Matern Kernel Amanda Muyskens Benjamin W. Priest I. Goumiri M. Schneider BDL 23 1 0 10 Oct 2024
Identifiability and Sensitivity Analysis of Kriging Weights for the Matern Kernel Amanda Muyskens Benjamin W. Priest I. Goumiri M. Schneider 31 0 0 10 Oct 2024
Features are fate: a theory of transfer learning in high-dimensional regression Javan Tahir Surya Ganguli Grant M. Rotskoff 43 1 0 10 Oct 2024
Generalization Bounds and Model Complexity for Kolmogorov-Arnold Networks Xianyang Zhang Huijuan Zhou 35 1 0 10 Oct 2024
Nesterov acceleration in benignly non-convex landscapes Kanan Gupta Stephan Wojtowytsch 42 2 0 10 Oct 2024
More Experts Than Galaxies: Conditionally-overlapping Experts With Biologically-Inspired Fixed Routing Sagi Shaier Francisco Pereira K. Wense Lawrence E Hunter Matt Jones MoE 46 0 0 10 Oct 2024
Collective variables of neural networks: empirical time evolution and scaling laws S. Tovey Sven Krippendorf M. Spannowsky Konstantin Nikolaou Christian Holm 22 0 0 09 Oct 2024
Task-oriented Time Series Imputation Evaluation via Generalized Representers Zhixian Wang Linxiao Yang Liang Sun Qingsong Wen Yi Wang AI4TS 31 0 0 09 Oct 2024