Efficient Parametric Approximations of Neural Network Function Space
Distance

Efficient Parametric Approximations of Neural Network Function Space Distance

7 February 2023

Roger C. Grosse

Papers citing "Efficient Parametric Approximations of Neural Network Function Space Distance"

16 / 16 papers shown

Title
Streamlining Prediction in Bayesian Deep Learning Marcus Klasson Talal Alrawajfeh Mikko Heikkilä Martin Trapp UQCV BDL 173 2 0 27 Nov 2024
Wide Neural Networks Forget Less Catastrophically Seyed Iman Mirzadeh Arslan Chaudhry Dong Yin Huiyi Hu Razvan Pascanu Dilan Görür Mehrdad Farajtabar CLL 59 65 0 21 Oct 2021
Fast Model Editing at Scale E. Mitchell Charles Lin Antoine Bosselut Chelsea Finn Christopher D. Manning KELM 320 364 0 21 Oct 2021
A Theoretical Analysis of Catastrophic Forgetting through the NTK Overlap Matrix T. Doan Mehdi Abbana Bennani Bogdan Mazoure Guillaume Rabusseau Pierre Alquier CLL 60 83 0 07 Oct 2020
Variational Auto-Regressive Gaussian Processes for Continual Learning Sanyam Kapoor Theofanis Karaletsos T. Bui BDL 33 26 0 09 Jun 2020
On the distance between two neural networks and the stability of learning Jeremy Bernstein Arash Vahdat Yisong Yue Xuan Li ODL 227 58 0 09 Feb 2020
SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models through Principled Regularized Optimization Haoming Jiang Pengcheng He Weizhu Chen Xiaodong Liu Jianfeng Gao T. Zhao 73 561 0 08 Nov 2019
Uncertainty-guided Continual Learning with Bayesian Neural Networks Sayna Ebrahimi Mohamed Elhoseiny Trevor Darrell Marcus Rohrbach CLL BDL 56 196 0 06 Jun 2019
Limitations of the Empirical Fisher Approximation for Natural Gradient Descent Frederik Kunstner Lukas Balles Philipp Hennig 68 215 0 29 May 2019
Measuring and regularizing networks in function space Ari S. Benjamin David Rolnick Konrad Paul Kording 40 139 0 21 May 2018
Online Structured Laplace Approximations For Overcoming Catastrophic Forgetting H. Ritter Aleksandar Botev David Barber BDL CLL 81 329 0 20 May 2018
Understanding Black-box Predictions via Influence Functions Pang Wei Koh Percy Liang TDI 169 2,878 0 14 Mar 2017
Overcoming catastrophic forgetting in neural networks J. Kirkpatrick Razvan Pascanu Neil C. Rabinowitz J. Veness Guillaume Desjardins ... A. Grabska-Barwinska Demis Hassabis Claudia Clopath D. Kumaran R. Hadsell CLL 315 7,478 0 02 Dec 2016
An Empirical Investigation of Catastrophic Forgetting in Gradient-Based Neural Networks Ian Goodfellow M. Berk Mirza Xia Da Aaron Courville Yoshua Bengio 137 1,439 0 21 Dec 2013
Exact solutions to the nonlinear dynamics of learning in deep linear neural networks Andrew M. Saxe James L. McClelland Surya Ganguli ODL 162 1,844 0 20 Dec 2013
Revisiting Natural Gradient for Deep Networks Razvan Pascanu Yoshua Bengio ODL 122 388 0 16 Jan 2013