Global Optimality in Tensor Factorization, Deep Learning, and Beyond

24 June 2015

Papers citing "Global Optimality in Tensor Factorization, Deep Learning, and Beyond"

50 / 51 papers shown

Title
Differentially Private Adapters for Parameter Efficient Acoustic Modeling Chun-Wei Ho Chao-Han Huck Yang Sabato Marco Siniscalchi 26 1 0 19 May 2023
Are All Losses Created Equal: A Neural Collapse Perspective Jinxin Zhou Chong You Xiao Li Kangning Liu Sheng Liu Qing Qu Zhihui Zhu 36 59 0 04 Oct 2022
On the generalization of learning algorithms that do not converge N. Chandramoorthy Andreas Loukas Khashayar Gatmiry Stefanie Jegelka MLT 19 11 0 16 Aug 2022
Neural Collapse: A Review on Modelling Principles and Generalization Vignesh Kothapalli 25 74 0 08 Jun 2022
On the Optimization Landscape of Neural Collapse under MSE Loss: Global Optimality with Unconstrained Features Jinxin Zhou Xiao Li Tian Ding Chong You Qing Qu Zhihui Zhu 30 99 0 02 Mar 2022
Low-Pass Filtering SGD for Recovering Flat Optima in the Deep Learning Optimization Landscape Devansh Bisla Jing Wang A. Choromańska 25 34 0 20 Jan 2022
Over-Parametrized Matrix Factorization in the Presence of Spurious Stationary Points Armin Eftekhari 24 1 0 25 Dec 2021
Two-level monotonic multistage recommender systems Ben Dai Xiaotong Shen Wei Pan 11 1 0 06 Oct 2021
Tensor Methods in Computer Vision and Deep Learning Yannis Panagakis Jean Kossaifi Grigorios G. Chrysos James Oldfield M. Nicolaou Anima Anandkumar S. Zafeiriou 27 119 0 07 Jul 2021
Understanding approximate and unrolled dictionary learning for pattern recovery Benoit Malézieux Thomas Moreau M. Kowalski MU 22 10 0 11 Jun 2021
Marginalizable Density Models D. Gilboa Ari Pakman Thibault Vatter BDL 32 5 0 08 Jun 2021
A Geometric Analysis of Neural Collapse with Unconstrained Features Zhihui Zhu Tianyu Ding Jinxin Zhou Xiao Li Chong You Jeremias Sulam Qing Qu 27 194 0 06 May 2021
The Nonconvex Geometry of Linear Inverse Problems Armin Eftekhari Peyman Mohajerin Esfahani 26 1 0 07 Jan 2021
Learning Graph Neural Networks with Approximate Gradient Descent Qunwei Li Shaofeng Zou Leon Wenliang Zhong GNN 32 1 0 07 Dec 2020
Beyond Linearization: On Quadratic and Higher-Order Approximation of Wide Neural Networks Yu Bai J. Lee 24 116 0 03 Oct 2019
Stochastic Conditional Generative Networks with Basis Decomposition Ze Wang Xiuyuan Cheng Guillermo Sapiro Qiang Qiu GAN 21 18 0 25 Sep 2019
Fine-Grained Analysis of Optimization and Generalization for Overparameterized Two-Layer Neural Networks Sanjeev Arora S. Du Wei Hu Zhiyuan Li Ruosong Wang MLT 55 961 0 24 Jan 2019
Gradient Descent Finds Global Minima of Deep Neural Networks S. Du J. Lee Haochuan Li Liwei Wang Masayoshi Tomizuka ODL 44 1,122 0 09 Nov 2018
On the Convergence Rate of Training Recurrent Neural Networks Zeyuan Allen-Zhu Yuanzhi Li Zhao Song 20 191 0 29 Oct 2018
Benefits of over-parameterization with EM Ji Xu Daniel J. Hsu A. Maleki 38 29 0 26 Oct 2018
Regularization Matters: Generalization and Optimization of Neural Nets v.s. their Induced Kernel Colin Wei J. Lee Qiang Liu Tengyu Ma 23 245 0 12 Oct 2018
Gradient Descent Provably Optimizes Over-parameterized Neural Networks S. Du Xiyu Zhai Barnabás Póczós Aarti Singh MLT ODL 47 1,250 0 04 Oct 2018
Global Optimality in Separable Dictionary Learning with Applications to the Analysis of Diffusion MRI Evan Schwab B. Haeffele René Vidal N. Charon OOD MedIm 19 2 0 15 Jul 2018
Adding One Neuron Can Eliminate All Bad Local Minima Shiyu Liang Ruoyu Sun J. Lee R. Srikant 37 89 0 22 May 2018
How Many Samples are Needed to Estimate a Convolutional or Recurrent Neural Network? S. Du Yining Wang Xiyu Zhai Sivaraman Balakrishnan Ruslan Salakhutdinov Aarti Singh SSL 21 57 0 21 May 2018
Improved Learning of One-hidden-layer Convolutional Neural Networks with Overlaps S. Du Surbhi Goel MLT 30 17 0 20 May 2018
The Loss Surface of XOR Artificial Neural Networks D. Mehta Xiaojun Zhao Edgar A. Bernal D. Wales 34 19 0 06 Apr 2018
Constrained Deep Learning using Conditional Gradient and Applications in Computer Vision Sathya Ravi Tuan Dinh Vishnu Suresh Lokhande Vikas Singh AI4CE 33 22 0 17 Mar 2018
Understanding the Loss Surface of Neural Networks for Binary Classification Shiyu Liang Ruoyu Sun Yixuan Li R. Srikant 21 87 0 19 Feb 2018
Spurious Local Minima are Common in Two-Layer ReLU Neural Networks Itay Safran Ohad Shamir 40 261 0 24 Dec 2017
Invariance of Weight Distributions in Rectified MLPs Russell Tsuchida Farbod Roosta-Khorasani M. Gallagher MLT 32 35 0 24 Nov 2017
Tensor Regression Networks Jean Kossaifi Zachary Chase Lipton Arinbjorn Kolbeinsson Aran Khanna Tommaso Furlanello Anima Anandkumar 3DV 43 145 0 26 Jul 2017
Theoretical insights into the optimization landscape of over-parameterized shallow neural networks Mahdi Soltanolkotabi Adel Javanmard J. Lee 36 415 0 16 Jul 2017
Recovery Guarantees for One-hidden-layer Neural Networks Kai Zhong Zhao Song Prateek Jain Peter L. Bartlett Inderjit S. Dhillon MLT 31 336 0 10 Jun 2017
The loss surface of deep and wide neural networks Quynh N. Nguyen Matthias Hein ODL 51 283 0 26 Apr 2017
Deep Relaxation: partial differential equations for optimizing deep neural networks Pratik Chaudhari Adam M. Oberman Stanley Osher Stefano Soatto G. Carlier 27 153 0 17 Apr 2017
Robust Kronecker-Decomposable Component Analysis for Low-Rank Modeling Mehdi Bahri Yannis Panagakis S. Zafeiriou 37 14 0 22 Mar 2017
Curriculum Dropout Pietro Morerio Jacopo Cavazza Riccardo Volpi René Vidal Vittorio Murino ODL 28 101 0 18 Mar 2017
How ConvNets model Non-linear Transformations Dipan K. Pal Marios Savvides 11 0 0 24 Feb 2017
Understanding Deep Neural Networks with Rectified Linear Units R. Arora A. Basu Poorya Mianjy Anirbit Mukherjee PINN 35 633 0 04 Nov 2016
Globally Optimal Training of Generalized Polynomial Neural Networks with Nonlinear Spectral Methods A. Gautier Quynh N. Nguyen Matthias Hein 19 32 0 28 Oct 2016
Master's Thesis : Deep Learning for Visual Recognition Rémi Cadène Nicolas Thome Matthieu Cord 37 4 0 18 Oct 2016
Convexified Convolutional Neural Networks Yuchen Zhang Percy Liang Martin J. Wainwright 26 64 0 04 Sep 2016
No bad local minima: Data independent training error guarantees for multilayer neural networks Daniel Soudry Y. Carmon 19 235 0 26 May 2016
Robust Large Margin Deep Neural Networks Jure Sokolić Raja Giryes Guillermo Sapiro M. Rodrigues 26 307 0 26 May 2016
Unconstrained Still/Video-Based Face Verification with Deep Convolutional Neural Networks Jun-Cheng Chen Rajeev Ranjan Swami Sankaranarayanan Amit Kumar Ching-Hui Chen Vishal M. Patel Carlos D. Castillo Rama Chellappa CVBM 27 97 0 09 May 2016
On the energy landscape of deep networks Pratik Chaudhari Stefano Soatto ODL 40 27 0 20 Nov 2015
On the Quality of the Initial Basin in Overspecified Neural Networks Itay Safran Ohad Shamir 8 127 0 13 Nov 2015
On the Expressive Power of Deep Learning: A Tensor Analysis Nadav Cohen Or Sharir Amnon Shashua 21 468 0 16 Sep 2015
The Loss Surfaces of Multilayer Networks A. Choromańska Mikael Henaff Michaël Mathieu Gerard Ben Arous Yann LeCun ODL 183 1,185 0 30 Nov 2014