v1v2v3 (latest)

Deep Neural Networks as Gaussian Processes

1 November 2017

Jascha Narain Sohl-Dickstein

UQCV

BDL

ArXiv (abs)PDF HTML

Papers citing "Deep Neural Networks as Gaussian Processes"

50 / 696 papers shown

Title
Meta-Principled Family of Hyperparameter Scaling Strategies Sho Yaida 118 16 0 10 Oct 2022
Layer Ensembles Illia Oleksiienko Alexandros Iosifidis BDL UQCV 69 1 0 10 Oct 2022
The Influence of Learning Rule on Representation Dynamics in Wide Neural Networks Blake Bordelon Cengiz Pehlevan 115 23 0 05 Oct 2022
Uncertainty-Aware Meta-Learning for Multimodal Task Distributions Cesar Almecija Apoorva Sharma Navid Azizan OOD UQCV 78 5 0 04 Oct 2022
On the infinite-depth limit of finite-width neural networks Soufiane Hayou 97 23 0 03 Oct 2022
Joint Embedding Self-Supervised Learning in the Kernel Regime B. Kiani Randall Balestriero Yubei Chen S. Lloyd Yann LeCun SSL 120 15 0 29 Sep 2022
A connection between probability, physics and neural networks Sascha Ranftl PINN 78 9 0 26 Sep 2022
Variational Inference for Infinitely Deep Neural Networks Achille Nazaret David M. Blei BDL 109 11 0 21 Sep 2022
Fast Neural Kernel Embeddings for General Activations Insu Han A. Zandieh Jaehoon Lee Roman Novak Lechao Xiao Amin Karbasi 120 19 0 09 Sep 2022
On Kernel Regression with Data-Dependent Kernels James B. Simon BDL 77 3 0 04 Sep 2022
Neural Tangent Kernel: A Survey Eugene Golikov Eduard Pokonechnyy Vladimir Korviakov 76 14 0 29 Aug 2022
Bayesian Neural Network Language Modeling for Speech Recognition Boyang Xue Shoukang Hu Junhao Xu Mengzhe Geng Xunying Liu Helen M. Meng UQCV BDL 140 18 0 28 Aug 2022
Gaussian Process Surrogate Models for Neural Networks Michael Y. Li Erin Grant Thomas Griffiths BDL SyDa 111 8 0 11 Aug 2022
Deep Maxout Network Gaussian Process Libin Liang Ye Tian Ge Cheng BDL 30 0 0 08 Aug 2022
Multi-fidelity surrogate modeling using long short-term memory networks Paolo Conti Mengwu Guo Andrea Manzoni J. Hesthaven AI4CE 80 48 0 05 Aug 2022
What Can Be Learnt With Wide Convolutional Neural Networks? Francesco Cagnetta Alessandro Favero Matthieu Wyart MLT 162 12 0 01 Aug 2022
Gradient-based Bi-level Optimization for Deep Learning: A Survey Can Chen Xiangshan Chen Chen Ma Zixuan Liu Xue Liu 209 39 0 24 Jul 2022
Statistical Hypothesis Testing Based on Machine Learning: Large Deviations Analysis P. Braca L. Millefiori A. Aubry S. Maranò A. De Maio P. Willett 91 12 0 22 Jul 2022
Single Model Uncertainty Estimation via Stochastic Data Centering Jayaraman J. Thiagarajan Rushil Anirudh V. Narayanaswamy P. Bremer UQCV OOD 67 28 0 14 Jul 2022
On the Robustness of Bayesian Neural Networks to Adversarial Attacks Luca Bortolussi Ginevra Carbone Luca Laurenti A. Patané G. Sanguinetti Matthew Wicker AAML 54 13 0 13 Jul 2022
Synergy and Symmetry in Deep Learning: Interactions between the Data, Model, and Inference Algorithm Lechao Xiao Jeffrey Pennington 101 10 0 11 Jul 2022
Variational Neural Networks Illia Oleksiienko D. Tran Alexandros Iosifidis BDL UQCV 67 8 0 04 Jul 2022
Memory Safe Computations with XLA Compiler A. Artemev Tilman Roeder Mark van der Wilk 86 8 0 28 Jun 2022
AutoInit: Automatic Initialization via Jacobian Tuning Tianyu He Darshil Doshi Andrey Gromov 73 4 0 27 Jun 2022
Distributional Gaussian Processes Layers for Out-of-Distribution Detection S. Popescu D. Sharp James H. Cole Konstantinos Kamnitsas Ben Glocker OOD 118 0 0 27 Jun 2022
A Fast, Well-Founded Approximation to the Empirical Neural Tangent Kernel Mohamad Amin Mohamadi Wonho Bae Danica J. Sutherland AAML 111 28 0 25 Jun 2022
Laziness, Barren Plateau, and Noise in Machine Learning Junyu Liu Zexi Lin Liang Jiang 67 21 0 19 Jun 2022
Photoelectric Factor Prediction Using Automated Learning and Uncertainty Quantification K. Alsamadony A. Ibrahim S. Elkatatny A. Abdulraheem 41 1 0 17 Jun 2022
Fast Finite Width Neural Tangent Kernel Roman Novak Jascha Narain Sohl-Dickstein S. Schoenholz AAML 78 56 0 17 Jun 2022
Large-width asymptotics for ReLU neural networks with $α$ -Stable initializations Stefano Favaro S. Fortini Stefano Peluchetti 73 2 0 16 Jun 2022
Wide Bayesian neural networks have a simple weight posterior: theory and accelerated sampling Jiri Hron Roman Novak Jeffrey Pennington Jascha Narain Sohl-Dickstein UQCV BDL 88 7 0 15 Jun 2022
Implicit Regularization or Implicit Conditioning? Exact Risk Trajectories of SGD in High Dimensions Courtney Paquette Elliot Paquette Ben Adlam Jeffrey Pennington 68 14 0 15 Jun 2022
Deep Variational Implicit Processes Luis A. Ortega Simón Rodríguez Santana Daniel Hernández-Lobato BDL 72 5 0 14 Jun 2022
Gradient Boosting Performs Gaussian Process Inference Aleksei Ustimenko Artem Beliakov Liudmila Prokhorenkova BDL 94 5 0 11 Jun 2022
Overcoming the Spectral Bias of Neural Value Approximation Ge Yang Anurag Ajay Pulkit Agrawal 107 26 0 09 Jun 2022
Adversarial Reprogramming Revisited Matthias Englert R. Lazic AAML 104 11 0 07 Jun 2022
The Neural Covariance SDE: Shaped Infinite Depth-and-Width Networks at Initialization Mufan Li Mihai Nica Daniel M. Roy 107 39 0 06 Jun 2022
Asymptotic Properties for Bayesian Neural Network in Besov Space Kyeongwon Lee Jaeyong Lee BDL 80 4 0 01 Jun 2022
Rethinking Bayesian Learning for Data Analysis: The Art of Prior and Inference in Sparsity-Aware Modeling Lei Cheng Feng Yin Sergios Theodoridis S. Chatzis Tsung-Hui Chang 132 78 0 28 May 2022
Why So Pessimistic? Estimating Uncertainties for Offline RL through Ensembles, and Why Their Independence Matters Seyed Kamyar Seyed Ghasemipour S. Gu Ofir Nachum OffRL 97 72 0 27 May 2022
Position: Tensor Networks are a Valuable Asset for Green AI Eva Memmel Clara Menzen Jetze T. Schuurmans Frederiek Wesel Kim Batselier 71 6 0 25 May 2022
Gaussian Pre-Activations in Neural Networks: Myth or Reality? Pierre Wolinski Julyan Arbel AI4CE 255 9 0 24 May 2022
Split personalities in Bayesian Neural Networks: the case for full marginalisation David Yallup Will Handley Michael P. Hobson A. Lasenby Pablo Lemos 54 1 0 23 May 2022
Mean-Field Analysis of Two-Layer Neural Networks: Global Optimality with Linear Convergence Rates Jingwei Zhang Xunpeng Huang Jincheng Yu MLT 68 1 0 19 May 2022
Diverse Weight Averaging for Out-of-Distribution Generalization Alexandre Ramé Matthieu Kirchmeyer Thibaud Rahier A. Rakotomamonjy Patrick Gallinari Matthieu Cord OOD 266 138 0 19 May 2022
Self-Consistent Dynamical Field Theory of Kernel Evolution in Wide Neural Networks Blake Bordelon Cengiz Pehlevan MLT 104 85 0 19 May 2022
Deep neural networks with dependent weights: Gaussian Process mixture limit, heavy tails, sparsity and compressibility Hoileong Lee Fadhel Ayed Paul Jung Juho Lee Hongseok Yang François Caron 112 10 0 17 May 2022
Incorporating Prior Knowledge into Neural Networks through an Implicit Composite Kernel Ziyang Jiang Tongshu Zheng Yiling Liu David Carlson 121 4 0 15 May 2022
Sobolev Acceleration and Statistical Optimality for Learning Elliptic Equations via Gradient Descent Yiping Lu Jose H. Blanchet Lexing Ying 110 8 0 15 May 2022
Deep Architecture Connectivity Matters for Its Convergence: A Fine-Grained Analysis Wuyang Chen Wei-Ping Huang Xinyu Gong Boris Hanin Zhangyang Wang 101 7 0 11 May 2022