Gaussian Process Behaviour in Wide Deep Neural Networks

30 April 2018

Papers citing "Gaussian Process Behaviour in Wide Deep Neural Networks"

50 / 391 papers shown

Title
Infinite Width Graph Neural Networks for Node Regression/ Classification Yunus Cobanoglu AI4CE 26 1 0 12 Oct 2023
Commutative Width and Depth Scaling in Deep Neural Networks Soufiane Hayou 49 2 0 02 Oct 2023
Depthwise Hyperparameter Transfer in Residual Networks: Dynamics and Scaling Limit Blake Bordelon Lorenzo Noci Mufan Li Boris Hanin Cengiz Pehlevan 35 22 0 28 Sep 2023
A Primer on Bayesian Neural Networks: Review and Debates Federico Danieli Konstantinos Pitas M. Vladimirova Vincent Fortuin BDL AAML 56 18 0 28 Sep 2023
Convolutional Deep Kernel Machines Edward Milsom Ben Anson Laurence Aitchison BDL 26 5 0 18 Sep 2023
Connecting NTK and NNGP: A Unified Theoretical Framework for Wide Neural Network Learning Dynamics Yehonatan Avidan Qianyi Li H. Sompolinsky 60 8 0 08 Sep 2023
Les Houches Lectures on Deep Learning at Large & Infinite Width Yasaman Bahri Boris Hanin Antonin Brossollet Vittorio Erba Christian Keup Rosalba Pacelli James B. Simon AI4CE 27 2 0 04 Sep 2023
Six Lectures on Linearized Neural Networks Theodor Misiakiewicz Andrea Montanari 47 12 0 25 Aug 2023
Local Kernel Renormalization as a mechanism for feature learning in overparametrized Convolutional Neural Networks R. Aiudi R. Pacelli A. Vezzani R. Burioni P. Rotondo MLT 21 15 0 21 Jul 2023
Quantitative CLTs in Deep Neural Networks Stefano Favaro Boris Hanin Domenico Marinucci I. Nourdin G. Peccati BDL 41 12 0 12 Jul 2023
Fundamental limits of overparametrized shallow neural networks for supervised learning Francesco Camilli D. Tieplova Jean Barbier 38 9 0 11 Jul 2023
Neural Network Field Theories: Non-Gaussianity, Actions, and Locality M. Demirtaş James Halverson Anindita Maiti M. Schwartz Keegan Stoner AI4CE 23 10 0 06 Jul 2023
Neural Hilbert Ladders: Multi-Layer Neural Networks in Function Space Zhengdao Chen 44 1 0 03 Jul 2023
The Shaped Transformer: Attention Models in the Infinite Depth-and-Width Limit Lorenzo Noci Chuning Li Mufan Li Bobby He Thomas Hofmann Chris J. Maddison Daniel M. Roy 38 31 0 30 Jun 2023
Gaussian random field approximation via Stein's method with applications to wide random neural networks Krishnakumar Balasubramanian L. Goldstein Nathan Ross Adil Salim 35 8 0 28 Jun 2023
Uniform Convergence of Deep Neural Networks with Lipschitz Continuous Activation Functions and Variable Widths Yuesheng Xu Haizhang Zhang 39 3 0 02 Jun 2023
Initial Guessing Bias: How Untrained Networks Favor Some Classes Emanuele Francazi Aurelien Lucchi Marco Baity-Jesi AI4CE 28 4 0 01 Jun 2023
Synaptic Weight Distributions Depend on the Geometry of Plasticity Roman Pogodin Jonathan H. Cornford Arna Ghosh Gauthier Gidel Guillaume Lajoie Blake A. Richards 23 4 0 30 May 2023
A Rainbow in Deep Network Black Boxes Florentin Guth Brice Ménard G. Rochette S. Mallat 30 10 0 29 May 2023
On the impact of activation and normalization in obtaining isometric embeddings at initialization Amir Joudaki Hadi Daneshmand Francis R. Bach 21 9 0 28 May 2023
An Improved Variational Approximate Posterior for the Deep Wishart Process Sebastian W. Ober Ben Anson Edward Milsom Laurence Aitchison BDL 31 5 0 23 May 2023
Mind the spikes: Benign overfitting of kernels and neural networks in fixed dimension Moritz Haas David Holzmüller U. V. Luxburg Ingo Steinwart MLT 40 14 0 23 May 2023
Posterior Inference on Shallow Infinitely Wide Bayesian Neural Networks under Weights with Unbounded Variance Jorge Loría A. Bhadra UQCV BDL 39 1 0 18 May 2023
Structures of Neural Network Effective Theories cCaugin Ararat Tianji Cai Cem Tekin Zhengkang Zhang 57 7 0 03 May 2023
When Do Graph Neural Networks Help with Node Classification? Investigating the Impact of Homophily Principle on Node Distinguishability Sitao Luan Chenqing Hua Minkai Xu Qincheng Lu Jiaqi Zhu Xiaoming Chang Jie Fu J. Leskovec Doina Precup 44 3 0 25 Apr 2023
Do deep neural networks have an inbuilt Occam's razor? Chris Mingard Henry Rees Guillermo Valle Pérez A. Louis UQCV BDL 21 16 0 13 Apr 2023
Non-asymptotic approximations of Gaussian neural networks via second-order Poincaré inequalities Alberto Bordino Stefano Favaro S. Fortini 28 7 0 08 Apr 2023
Infinitely wide limits for deep Stable neural networks: sub-linear, linear and super-linear activation functions Alberto Bordino Stefano Favaro S. Fortini 32 7 0 08 Apr 2023
Dynamics of Finite Width Kernel and Prediction Fluctuations in Mean Field Neural Networks Blake Bordelon Cengiz Pehlevan MLT 38 29 0 06 Apr 2023
Biological Sequence Kernels with Guaranteed Flexibility Alan N. Amin Eli N. Weinstein D. Marks 40 4 0 06 Apr 2023
Effective Theory of Transformers at Initialization Emily Dinan Sho Yaida Susan Zhang 30 14 0 04 Apr 2023
Neural signature kernels as infinite-width-depth-limits of controlled ResNets Nicola Muca Cirone M. Lemercier C. Salvi 24 23 0 30 Mar 2023
Inferring networks from time series: a neural approach Thomas Gaskin G. Pavliotis Mark Girolami AI4TS 32 7 0 30 Mar 2023
Sparse Gaussian Processes with Spherical Harmonic Features Revisited Stefanos Eleftheriadis Dominic Richards J. Hensman 24 1 0 28 Mar 2023
Online Learning for the Random Feature Model in the Student-Teacher Framework Roman Worschech B. Rosenow 46 0 0 24 Mar 2023
Kernel Regression with Infinite-Width Neural Networks on Millions of Examples Ben Adlam Jaehoon Lee Shreyas Padhy Zachary Nado Jasper Snoek 26 11 0 09 Mar 2023
Bayesian inference with finitely wide neural networks Chi-Ken Lu BDL 37 0 0 06 Mar 2023
Deep Transformers without Shortcuts: Modifying Self-attention for Faithful Signal Propagation Bobby He James Martens Guodong Zhang Aleksandar Botev Andy Brock Samuel L. Smith Yee Whye Teh 27 30 0 20 Feb 2023
Guided Deep Kernel Learning Idan Achituve Gal Chechik Ethan Fetaya BDL 31 5 0 19 Feb 2023
The Geometry of Neural Nets' Parameter Spaces Under Reparametrization Agustinus Kristiadi Felix Dangel Philipp Hennig 32 11 0 14 Feb 2023
Graph Neural Network-Inspired Kernels for Gaussian Processes in Semi-Supervised Learning Zehao Niu M. Anitescu Jing Chen BDL 27 4 0 12 Feb 2023
Over-parameterised Shallow Neural Networks with Asymmetrical Node Scaling: Global Convergence Guarantees and Feature Learning François Caron Fadhel Ayed Paul Jung Hoileong Lee Juho Lee Hongseok Yang 67 2 0 02 Feb 2023
Width and Depth Limits Commute in Residual Networks Soufiane Hayou Greg Yang 47 14 0 01 Feb 2023
Deterministic equivalent and error universality of deep random features learning Dominik Schröder Hugo Cui Daniil Dmitriev Bruno Loureiro MLT 37 28 0 01 Feb 2023
Bayes-optimal Learning of Deep Random Networks of Extensive-width Hugo Cui Florent Krzakala Lenka Zdeborová BDL 30 35 0 01 Feb 2023
Gradient Descent in Neural Networks as Sequential Learning in RKBS A. Shilton Sunil R. Gupta Santu Rana Svetha Venkatesh MLT 19 1 0 01 Feb 2023
Deep networks for system identification: a Survey G. Pillonetto Aleksandr Aravkin Daniel Gedon L. Ljung Antônio H. Ribeiro Thomas B. Schon OOD 37 36 0 30 Jan 2023
A Simple Algorithm For Scaling Up Kernel Methods Tengyu Xu Bryan Kelly Semyon Malamud 21 0 0 26 Jan 2023
Neural networks learn to magnify areas near decision boundaries Jacob A. Zavatone-Veth Sheng Yang Julian Rubinfien Cengiz Pehlevan MLT AI4CE 28 6 0 26 Jan 2023
Estimating Causal Effects using a Multi-task Deep Ensemble Ziyang Jiang Zhuoran Hou Yi-Ling Liu Yiman Ren Keyu Li David Carlson CML 24 6 0 26 Jan 2023