Universality of Gradient Descent Neural Network Training

27 July 2020

Papers citing "Universality of Gradient Descent Neural Network Training"

32 / 32 papers shown

Title
Meta-Learning in Neural Networks: A Survey Timothy M. Hospedales Antreas Antoniou P. Micaelli Amos Storkey OOD 340 1,967 0 11 Apr 2020
Nonlinear Approximation and (Deep) ReLU Networks Ingrid Daubechies Ronald A. DeVore S. Foucart Boris Hanin G. Petrova 76 141 0 05 May 2019
Biologically inspired alternatives to backpropagation through time for learning in recurrent neural nets G. Bellec Franz Scherr Elias Hajek Darjan Salaj Robert Legenstein Wolfgang Maass PINN 79 89 0 25 Jan 2019
FBNet: Hardware-Aware Efficient ConvNet Design via Differentiable Neural Architecture Search Bichen Wu Xiaoliang Dai Peizhao Zhang Yanghan Wang Fei Sun Yiming Wu Yuandong Tian Peter Vajda Yangqing Jia Kurt Keutzer MQ 97 1,300 0 09 Dec 2018
A Convergence Theory for Deep Learning via Over-Parameterization Zeyuan Allen-Zhu Yuanzhi Li Zhao Song AI4CE ODL 218 1,461 0 09 Nov 2018
Gradient Descent Finds Global Minima of Deep Neural Networks S. Du Jason D. Lee Haochuan Li Liwei Wang Masayoshi Tomizuka ODL 168 1,134 0 09 Nov 2018
Biologically-plausible learning algorithms can scale to large datasets Y. Chitour Honglin Chen Zhenyu Liao T. Poggio 64 76 0 08 Nov 2018
A Convergence Analysis of Gradient Descent for Deep Linear Neural Networks Sanjeev Arora Nadav Cohen Noah Golowich Wei Hu 108 290 0 04 Oct 2018
Learning Overparameterized Neural Networks via Stochastic Gradient Descent on Structured Data Yuanzhi Li Yingyu Liang MLT 185 653 0 03 Aug 2018
Implementing Neural Turing Machines Mark Collier Jöran Beel 35 50 0 23 Jul 2018
Universality of Deep Convolutional Neural Networks Ding-Xuan Zhou HAI PINN 309 514 0 28 May 2018
Spurious Local Minima are Common in Two-Layer ReLU Neural Networks Itay Safran Ohad Shamir 151 263 0 24 Dec 2017
Deep linear neural networks with arbitrary loss: All local minima are global T. Laurent J. V. Brecht ODL 49 136 0 05 Dec 2017
Meta-Learning and Universality: Deep Representations and Gradient Descent can Approximate any Learning Algorithm Chelsea Finn Sergey Levine SSL 86 223 0 31 Oct 2017
Approximating Continuous Functions by ReLU Nets of Minimal Width Boris Hanin Mark Sellke 97 234 0 31 Oct 2017
The Expressive Power of Neural Networks: A View from the Width Zhou Lu Hongming Pu Feicheng Wang Zhiqiang Hu Liwei Wang 94 892 0 08 Sep 2017
Learning Transferable Architectures for Scalable Image Recognition Barret Zoph Vijay Vasudevan Jonathon Shlens Quoc V. Le 163 5,595 0 21 Jul 2017
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks Chelsea Finn Pieter Abbeel Sergey Levine OOD 798 11,866 0 09 Mar 2017
Large-Scale Evolution of Image Classifiers Esteban Real Sherry Moore Andrew Selle Saurabh Saxena Y. Suematsu Jie Tan Quoc V. Le Alexey Kurakin 116 1,637 0 03 Mar 2017
Understanding deep learning requires rethinking generalization Chiyuan Zhang Samy Bengio Moritz Hardt Benjamin Recht Oriol Vinyals HAI 304 4,623 0 10 Nov 2016
Neural Architecture Search with Reinforcement Learning Barret Zoph Quoc V. Le 416 5,367 0 05 Nov 2016
Decoupled Neural Interfaces using Synthetic Gradients Max Jaderberg Wojciech M. Czarnecki Simon Osindero Oriol Vinyals Alex Graves David Silver Koray Kavukcuoglu 75 356 0 18 Aug 2016
No bad local minima: Data independent training error guarantees for multilayer neural networks Daniel Soudry Y. Carmon 153 235 0 26 May 2016
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 1.8K 193,426 0 10 Dec 2015
Difference Target Propagation Dong-Hyun Lee Saizheng Zhang Asja Fischer Yoshua Bengio AAML 64 348 0 23 Dec 2014
Qualitatively characterizing neural network optimization problems Ian Goodfellow Oriol Vinyals Andrew M. Saxe ODL 103 522 0 19 Dec 2014
The Loss Surfaces of Multilayer Networks A. Choromańska Mikael Henaff Michaël Mathieu Gerard Ben Arous Yann LeCun ODL 249 1,196 0 30 Nov 2014
How transferable are features in deep neural networks? J. Yosinski Jeff Clune Yoshua Bengio Hod Lipson OOD 188 8,321 0 06 Nov 2014
Neural Turing Machines Alex Graves Greg Wayne Ivo Danihelka 93 2,325 0 20 Oct 2014
Sequence to Sequence Learning with Neural Networks Ilya Sutskever Oriol Vinyals Quoc V. Le AIMat 349 20,518 0 10 Sep 2014
Neural Machine Translation by Jointly Learning to Align and Translate Dzmitry Bahdanau Kyunghyun Cho Yoshua Bengio AIMat 465 27,263 0 01 Sep 2014
DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition Jeff Donahue Yangqing Jia Oriol Vinyals Judy Hoffman Ning Zhang Eric Tzeng Trevor Darrell VLM ObjD 174 4,948 0 06 Oct 2013