Deep Neural Networks as Gaussian Processes

1 November 2017

Jascha Narain Sohl-Dickstein

UQCV

BDL

ArXiv PDF HTML

Papers citing "Deep Neural Networks as Gaussian Processes"

50 / 692 papers shown

Title
Implicit Bias of Linear RNNs M Motavali Emami Mojtaba Sahraee-Ardakan Parthe Pandit S. Rangan A. Fletcher 20 11 0 19 Jan 2021
Correlated Weights in Infinite Limits of Deep Convolutional Neural Networks Adrià Garriga-Alonso Mark van der Wilk 17 4 0 11 Jan 2021
Scaling Up Bayesian Uncertainty Quantification for Inverse Problems using Deep Neural Networks Shiwei Lan Shuyi Li Babak Shahbaba UQCV BDL 35 16 0 11 Jan 2021
Infinitely Wide Tensor Networks as Gaussian Process Erdong Guo D. Draper 19 2 0 07 Jan 2021
The Bayesian Method of Tensor Networks Erdong Guo D. Draper 14 3 0 01 Jan 2021
Perspective: A Phase Diagram for Deep Learning unifying Jamming, Feature Learning and Lazy Training Mario Geiger Leonardo Petrini Matthieu Wyart DRL 31 11 0 30 Dec 2020
Mathematical Models of Overparameterized Neural Networks Cong Fang Hanze Dong Tong Zhang 40 22 0 27 Dec 2020
Tight Bounds on the Smallest Eigenvalue of the Neural Tangent Kernel for Deep ReLU Networks Quynh N. Nguyen Marco Mondelli Guido Montúfar 25 81 0 21 Dec 2020
Defence against adversarial attacks using classical and quantum-enhanced Boltzmann machines Aidan Kehoe P. Wittek Yanbo Xue Alejandro Pozas-Kerstjens AAML 37 7 0 21 Dec 2020
Recent advances in deep learning theory Fengxiang He Dacheng Tao AI4CE 24 50 0 20 Dec 2020
Multi-fidelity Bayesian Neural Networks: Algorithms and Applications Xuhui Meng H. Babaee George Karniadakis 22 129 0 19 Dec 2020
Guiding Neural Network Initialization via Marginal Likelihood Maximization Anthony S. Tai Chunfeng Huang 13 0 0 17 Dec 2020
Enhanced Recurrent Neural Tangent Kernels for Non-Time-Series Data Sina Alemohammad Randall Balestriero Zichao Wang Richard Baraniuk AI4TS 11 1 0 09 Dec 2020
Analyzing Finite Neural Networks: Can We Trust Neural Tangent Kernel Theory? Mariia Seleznova Gitta Kutyniok AAML 24 29 0 08 Dec 2020
Generalization bounds for deep learning Guillermo Valle Pérez A. Louis BDL 13 44 0 07 Dec 2020
Statistical Mechanics of Deep Linear Neural Networks: The Back-Propagating Kernel Renormalization Qianyi Li H. Sompolinsky 30 69 0 07 Dec 2020
Neural Network Gaussian Process Considering Input Uncertainty for Composite Structures Assembly Cheolhei Lee Jianguo Wu Wei Cao Xiaowei Yue 19 19 0 21 Nov 2020
On the Dynamics of Training Attention Models Haoye Lu Yongyi Mao A. Nayak 16 7 0 19 Nov 2020
A Review of Uncertainty Quantification in Deep Learning: Techniques, Applications and Challenges Moloud Abdar Farhad Pourpanah Sadiq Hussain Dana Rezazadegan Li Liu ... Xiaochun Cao Abbas Khosravi U. Acharya V. Makarenkov S. Nahavandi BDL UQCV 56 1,884 0 12 Nov 2020
Towards NNGP-guided Neural Architecture Search Daniel S. Park Jaehoon Lee Daiyi Peng Yuan Cao Jascha Narain Sohl-Dickstein BDL 26 33 0 11 Nov 2020
Kernel Dependence Network Chieh-Tsai Wu A. Masoomi Arthur Gretton Jennifer Dy 16 0 0 04 Nov 2020
Which Minimizer Does My Neural Network Converge To? Manuel Nonnenmacher David Reeb Ingo Steinwart ODL 8 4 0 04 Nov 2020
Dataset Meta-Learning from Kernel Ridge-Regression Timothy Nguyen Zhourung Chen Jaehoon Lee DD 36 241 0 30 Oct 2020
Do Wide and Deep Networks Learn the Same Things? Uncovering How Neural Network Representations Vary with Width and Depth Thao Nguyen M. Raghu Simon Kornblith OOD 16 264 0 29 Oct 2020
A Bayesian Perspective on Training Speed and Model Selection Clare Lyle Lisa Schut Binxin Ru Y. Gal Mark van der Wilk 44 24 0 27 Oct 2020
Are wider nets better given the same number of parameters? A. Golubeva Behnam Neyshabur Guy Gur-Ari 32 44 0 27 Oct 2020
A Probabilistic Representation of Deep Learning for Improving The Information Theoretic Interpretability Xinjie Lan Kenneth Barner FAtt 19 2 0 27 Oct 2020
Wearing a MASK: Compressed Representations of Variable-Length Sequences Using Recurrent Neural Tangent Kernels Sina Alemohammad Hossein Babaei Randall Balestriero Matt Y. Cheung Ahmed Imtiaz Humayun ... Naiming Liu Lorenzo Luzi Jasper Tan Zichao Wang Richard G. Baraniuk 14 4 0 27 Oct 2020
Stable ResNet Soufiane Hayou Eugenio Clerico Bo He George Deligiannidis Arnaud Doucet Judith Rousseau ODL SSeg 46 51 0 24 Oct 2020
Label-Aware Neural Tangent Kernel: Toward Better Generalization and Local Elasticity Shuxiao Chen Hangfeng He Weijie J. Su 20 23 0 22 Oct 2020
Stationary Activations for Uncertainty Calibration in Deep Learning Lassi Meronen Christabella Irwanto Arno Solin UQCV BDL 14 18 0 19 Oct 2020
The Ridgelet Prior: A Covariance Function Approach to Prior Specification for Bayesian Neural Networks Takuo Matsubara Chris J. Oates F. Briol BDL UQCV 21 17 0 16 Oct 2020
Exploring the Uncertainty Properties of Neural Networks' Implicit Priors in the Infinite-Width Limit Ben Adlam Jaehoon Lee Lechao Xiao Jeffrey Pennington Jasper Snoek UQCV BDL 31 16 0 14 Oct 2020
Machine Learning Force Fields Oliver T. Unke Stefan Chmiela H. E. Sauceda M. Gastegger I. Poltavsky Kristof T. Schütt A. Tkatchenko K. Müller AI4CE 41 891 0 14 Oct 2020
Improving Local Identifiability in Probabilistic Box Embeddings S. Dasgupta Michael Boratko Dongxu Zhang Luke Vilnis Xiang Lorraine Li Andrew McCallum 29 54 0 09 Oct 2020
Ensembling geophysical models with Bayesian Neural Networks Ushnish Sengupta Matt Amos J. S. Hosking C. Rasmussen M. Juniper P. Young UQCV BDL 14 17 0 07 Oct 2020
An Infinite-Feature Extension for Bayesian ReLU Nets That Fixes Their Asymptotic Overconfidence Agustinus Kristiadi Matthias Hein Philipp Hennig BDL 26 9 0 06 Oct 2020
Deep kernel processes Laurence Aitchison Adam X. Yang Sebastian W. Ober BDL 24 41 0 04 Oct 2020
Uncertainty-Aware Multi-Modal Ensembling for Severity Prediction of Alzheimer's Dementia U. Sarawgi W. Zulfikar Rishab Khincha Pattie Maes UQCV 14 2 0 03 Oct 2020
Deep Equals Shallow for ReLU Networks in Kernel Regimes A. Bietti Francis R. Bach 37 85 0 30 Sep 2020
Normalization Techniques in Training DNNs: Methodology, Analysis and Application Lei Huang Jie Qin Yi Zhou Fan Zhu Li Liu Ling Shao AI4CE 12 257 0 27 Sep 2020
Why have a Unified Predictive Uncertainty? Disentangling it using Deep Split Ensembles U. Sarawgi W. Zulfikar Rishab Khincha Pattie Maes PER UQCV BDL UD 23 7 0 25 Sep 2020
Tensor Programs III: Neural Matrix Laws Greg Yang 19 45 0 22 Sep 2020
Kernel-Based Smoothness Analysis of Residual Networks Tom Tirer Joan Bruna Raja Giryes 24 19 0 21 Sep 2020
InClass Nets: Independent Classifier Networks for Nonparametric Estimation of Conditional Independence Mixture Models and Unsupervised Classification Konstantin T. Matchev Prasanth Shyamsundar CML 21 0 0 31 Aug 2020
Predicting Training Time Without Training L. Zancato Alessandro Achille Avinash Ravichandran Rahul Bhotika Stefano Soatto 26 24 0 28 Aug 2020
A Dynamical Central Limit Theorem for Shallow Neural Networks Zhengdao Chen Grant M. Rotskoff Joan Bruna Eric Vanden-Eijnden 30 30 0 21 Aug 2020
Asymptotics of Wide Convolutional Neural Networks Anders Andreassen Ethan Dyer 22 23 0 19 Aug 2020
Neural Networks and Quantum Field Theory James Halverson Anindita Maiti Keegan Stoner 29 76 0 19 Aug 2020
Adaptive Signal Variances: CNN Initialization Through Modern Architectures Takahiko Henmi E. R. R. Zara Yoshihiro Hirohashi Tsuyoshi Kato 18 2 0 16 Aug 2020