Recovery Guarantees for One-hidden-layer Neural Networks

10 June 2017

Inderjit S. Dhillon

Papers citing "Recovery Guarantees for One-hidden-layer Neural Networks"

50 / 223 papers shown

Title
SGD Converges to Global Minimum in Deep Learning via Star-convex Path Yi Zhou Junjie Yang Huishuai Zhang Yingbin Liang Vahid Tarokh 79 74 0 02 Jan 2019
Elimination of All Bad Local Minima in Deep Learning Kenji Kawaguchi L. Kaelbling 102 45 0 02 Jan 2019
On the Benefit of Width for Neural Networks: Disappearance of Bad Basins Dawei Li Tian Ding Ruoyu Sun 148 39 0 28 Dec 2018
Towards a Theoretical Understanding of Hashing-Based Neural Nets Yibo Lin Zhao Song Lin F. Yang 43 5 0 26 Dec 2018
Overparameterized Nonlinear Learning: Gradient Descent Takes the Shortest Path? Samet Oymak Mahdi Soltanolkotabi ODL 73 177 0 25 Dec 2018
Learning and Generalization in Overparameterized Neural Networks, Going Beyond Two Layers Zeyuan Allen-Zhu Yuanzhi Li Yingyu Liang MLT 237 775 0 12 Nov 2018
A Convergence Theory for Deep Learning via Over-Parameterization Zeyuan Allen-Zhu Yuanzhi Li Zhao Song AI4CE ODL 308 1,472 0 09 Nov 2018
Gradient Descent Finds Global Minima of Deep Neural Networks S. Du Jason D. Lee Haochuan Li Liwei Wang Masayoshi Tomizuka ODL 361 1,137 0 09 Nov 2018
Learning Two Layer Rectified Neural Networks in Polynomial Time Ainesh Bakshi Rajesh Jayaram David P. Woodruff NoLa 191 70 0 05 Nov 2018
Towards a Zero-One Law for Column Subset Selection Zhao Song David P. Woodruff Peilin Zhong 61 33 0 04 Nov 2018
On the Convergence Rate of Training Recurrent Neural Networks Zeyuan Allen-Zhu Yuanzhi Li Zhao Song 253 193 0 29 Oct 2018
Subgradient Descent Learns Orthogonal Dictionaries Yu Bai Qijia Jiang Ju Sun 165 51 0 25 Oct 2018
Depth with Nonlinearity Creates No Bad Local Minima in ResNets Kenji Kawaguchi Yoshua Bengio ODL 111 64 0 21 Oct 2018
Small ReLU networks are powerful memorizers: a tight analysis of memorization capacity Chulhee Yun S. Sra Ali Jadbabaie 164 118 0 17 Oct 2018
Learning Two-layer Neural Networks with Symmetric Inputs Rong Ge Rohith Kuditipudi Zhize Li Xiang Wang OOD MLT 201 59 0 16 Oct 2018
Learning One-hidden-layer Neural Networks under General Input Distributions Weihao Gao Ashok Vardhan Makkuva Sewoong Oh Pramod Viswanath MLT 84 29 0 09 Oct 2018
A Convergence Analysis of Gradient Descent for Deep Linear Neural Networks Sanjeev Arora Nadav Cohen Noah Golowich Wei Hu 182 293 0 04 Oct 2018
Efficiently testing local optimality and escaping saddles for ReLU networks Chulhee Yun S. Sra Ali Jadbabaie 90 10 0 28 Sep 2018
On the loss landscape of a class of deep neural networks with no bad local valleys Quynh N. Nguyen Mahesh Chandra Mukkamala Matthias Hein 97 87 0 27 Sep 2018
Nonconvex Optimization Meets Low-Rank Matrix Factorization: An Overview Yuejie Chi Yue M. Lu Yuxin Chen 75 427 0 25 Sep 2018
Stochastic Gradient Descent Learns State Equations with Nonlinear Activations Samet Oymak 78 43 0 09 Sep 2018
Two Dimensional Stochastic Configuration Networks for Image Data Analytics Ming Li Dianhui Wang 21 2 0 06 Sep 2018
On the Decision Boundary of Deep Neural Networks Yu Li Lizhong Ding Xin Gao UQCV 47 37 0 16 Aug 2018
Learning ReLU Networks on Linearly Separable Data: Algorithm, Optimality, and Generalization G. Wang G. Giannakis Jie Chen MLT 83 132 0 14 Aug 2018
Learning Overparameterized Neural Networks via Stochastic Gradient Descent on Structured Data Yuanzhi Li Yingyu Liang MLT 230 653 0 03 Aug 2018
Tensor Methods for Additive Index Models under Discordance and Heterogeneity Krishnakumar Balasubramanian Jianqing Fan Zhuoran Yang 52 13 0 17 Jul 2018
Model Reconstruction from Model Explanations S. Milli Ludwig Schmidt Anca Dragan Moritz Hardt FAtt 66 179 0 13 Jul 2018
Learning ReLU Networks via Alternating Minimization Gauri Jagatap Chinmay Hegde 70 11 0 20 Jun 2018
Learning One-hidden-layer ReLU Networks via Gradient Descent Xiao Zhang Yaodong Yu Lingxiao Wang Quanquan Gu MLT 131 135 0 20 Jun 2018
Algorithmic Regularization in Learning Deep Homogeneous Models: Layers are Automatically Balanced S. Du Wei Hu Jason D. Lee MLT 176 243 0 04 Jun 2018
Autoencoders Learn Generative Linear Models THANH VAN NGUYEN Raymond K. W. Wong Chinmay Hegde DRL 53 4 0 02 Jun 2018
Nonlinear Inductive Matrix Completion based on One-layer Neural Networks Kai Zhong Zhao Song Prateek Jain Inderjit S. Dhillon 23 6 0 26 May 2018
A Unified Framework for Training Neural Networks H. Ghauch H. S. Ghadikolaei Carlo Fischione Mikael Skoglund AI4CE 26 0 0 23 May 2018
Adding One Neuron Can Eliminate All Bad Local Minima Shiyu Liang Ruoyu Sun Jason D. Lee R. Srikant 109 90 0 22 May 2018
How Many Samples are Needed to Estimate a Convolutional or Recurrent Neural Network? S. Du Yining Wang Xiyu Zhai Sivaraman Balakrishnan Ruslan Salakhutdinov Aarti Singh SSL 91 57 0 21 May 2018
Improved Learning of One-hidden-layer Convolutional Neural Networks with Overlaps S. Du Surbhi Goel MLT 95 17 0 20 May 2018
End-to-end Learning of a Convolutional Neural Network via Deep Tensor Decomposition Samet Oymak Mahdi Soltanolkotabi 87 12 0 16 May 2018
Gradient Descent for One-Hidden-Layer Neural Networks: Polynomial Convergence and SQ Lower Bounds Santosh Vempala John Wilmes MLT 114 51 0 07 May 2018
A Mean Field View of the Landscape of Two-Layers Neural Networks Song Mei Andrea Montanari Phan-Minh Nguyen MLT 115 863 0 18 Apr 2018
A Provably Correct Algorithm for Deep Learning that Actually Works Eran Malach Shai Shalev-Shwartz MLT 123 31 0 26 Mar 2018
On the Power of Over-parametrization in Neural Networks with Quadratic Activation S. Du Jason D. Lee 188 272 0 03 Mar 2018
Breaking the gridlock in Mixture-of-Experts: Consistent and Efficient Algorithms Ashok Vardhan Makkuva Sewoong Oh Sreeram Kannan Pramod Viswanath MoE 49 19 0 21 Feb 2018
On the Connection Between Learning Two-Layers Neural Networks and Tensor Decomposition Marco Mondelli Andrea Montanari MLT CML 94 59 0 20 Feb 2018
Understanding the Loss Surface of Neural Networks for Binary Classification Shiyu Liang Ruoyu Sun Yixuan Li R. Srikant 99 88 0 19 Feb 2018
Guaranteed Recovery of One-Hidden-Layer Neural Networks via Cross Entropy H. Fu Yuejie Chi Yingbin Liang FedML 103 39 0 18 Feb 2018
Nonconvex Matrix Factorization from Rank-One Measurements Yuanxin Li Cong Ma Yuxin Chen Yuejie Chi 85 52 0 17 Feb 2018
Gradient descent with identity initialization efficiently learns positive definite linear transformations by deep residual networks Peter L. Bartlett D. Helmbold Philip M. Long 154 117 0 16 Feb 2018
A Simple Proximal Stochastic Gradient Method for Nonsmooth Nonconvex Optimization Zhize Li Jian Li 111 116 0 13 Feb 2018
Small nonlinearities in activation functions create bad local minima in neural networks Chulhee Yun S. Sra Ali Jadbabaie ODL 127 95 0 10 Feb 2018
Learning One Convolutional Layer with Overlapping Patches Surbhi Goel Adam R. Klivans Raghu Meka MLT 90 81 0 07 Feb 2018