An overview of gradient descent optimization algorithms

15 September 2016

Papers citing "An overview of gradient descent optimization algorithms"

48 / 998 papers shown

Title
1D Convolutional Neural Networks and Applications: A Survey S. Kiranyaz Onur Avcı Osama Abdeljaber T. Ince Moncef Gabbouj D. Inman 3DV 11 1,874 0 09 May 2019
Sketch2code: Generating a website from a paper mockup Alex Robinson 3DV 30 36 0 09 May 2019
Combining Planning and Deep Reinforcement Learning in Tactical Decision Making for Autonomous Driving C. Hoel Katherine Driggs-Campbell Krister Wolff L. Laine Mykel J. Kochenderfer 13 232 0 06 May 2019
Inverse Halftoning Through Structure-Aware Deep Convolutional Neural Networks Chang-Hwan Son 16 14 0 02 May 2019
Declarative Recursive Computation on an RDBMS, or, Why You Should Use a Database For Distributed Machine Learning Dimitrije Jankov Shangyu Luo Binhang Yuan Zhuhua Cai Jia Zou C. Jermaine Zekai J. Gao 26 60 0 25 Apr 2019
Unsupervised Adversarial Domain Adaptation Based On The Wasserstein Distance For Acoustic Scene Classification K. Drossos P. Magron Tuomas Virtanen 18 37 0 24 Apr 2019
Convergence rates for the stochastic gradient descent method for non-convex objective functions Benjamin J. Fehrman Benjamin Gess Arnulf Jentzen 19 101 0 02 Apr 2019
Machine Vision for Natural Gas Methane Emissions Detection Using an Infrared Camera Jingfan Wang Lyne P. Tchapmi A. Ravikumar M. McGuire Clay S. Bell D. Zimmerle Silvio Savarese A. Brandt 13 100 0 01 Apr 2019
Block stochastic gradient descent for large-scale tomographic reconstruction in a parallel network Yushan Gao A. Biguri T. Blumensath 26 3 0 28 Mar 2019
Deep learning observables in computational fluid dynamics K. Lye Siddhartha Mishra Deep Ray OOD AI4CE 18 158 0 07 Mar 2019
LOSSGRAD: automatic learning rate in gradient descent B. Wójcik Lukasz Maziarka Jacek Tabor ODL 40 4 0 20 Feb 2019
Supervised Deep Neural Networks (DNNs) for Pricing/Calibration of Vanilla/Exotic Options Under Various Different Processes Ali Hirsa T. Karatas Amir Oskoui 14 26 0 15 Feb 2019
Bifidelity data-assisted neural networks in nonintrusive reduced-order modeling Chuan Lu Xueyu Zhu 18 11 0 01 Feb 2019
Federated Collaborative Filtering for Privacy-Preserving Personalized Recommendation System Muhammad Ammad-ud-din E. Ivannikova Suleiman A. Khan Were Oyomno Qiang Fu K. E. Tan Adrian Flanagan FedML 31 269 0 29 Jan 2019
Trust Region Value Optimization using Kalman Filtering Shirli Di-Castro Shashua Shie Mannor 19 7 0 23 Jan 2019
Salient Object Detection with Lossless Feature Reflection and Weighted Structural Loss Pingping Zhang Wei Liu Huchuan Lu Chunhua Shen 23 52 0 21 Jan 2019
Optimizing Deep Neural Networks with Multiple Search Neuroevolution Ahmed Aly David Weikersdorfer C. Delaunay 16 7 0 17 Jan 2019
Location-Centered House Price Prediction: A Multi-Task Learning Approach Guangliang Gao Z. Bao Jie Cao •. A. K. Qin Timos Sellis Zhiang Wu 17 40 0 07 Jan 2019
Deep Energies for Estimating Three-Dimensional Facial Pose and Expression Michael Bao Jane Wu Xinwei Yao Ronald Fedkiw 3DH 23 4 0 07 Dec 2018
Investigating performance of neural networks and gradient boosting models approximating microscopic traffic simulations in traffic optimization tasks P. Góra M. Brzeski Marcin Mo.zejko Arkadiusz Klemenko A. Kochanski 16 6 0 02 Dec 2018
HSD-CNN: Hierarchically self decomposing CNN architecture using class specific filter sensitivity analysis Kasanagottu Sairam J. Mukherjee A. Patra P. Das 24 5 0 11 Nov 2018
A Hitchhiker's Guide On Distributed Training of Deep Neural Networks K. Chahal Manraj Singh Grover Kuntal Dey 3DH OOD 6 53 0 28 Oct 2018
Quasi-hyperbolic momentum and Adam for deep learning Jerry Ma Denis Yarats ODL 84 129 0 16 Oct 2018
$Learning to fail: Predicting fracture evolution in brittle material models using recurrent graph convolutional neural networks$ Learning to fail: Predicting fracture evolution in brittle material models using recurrent graph convolutional neural networks Max Schwarzer Bryce Rogan Yadong Ruan Zhengming Song Diana Lee ... V. Chau B. Moore E. Rougier Hari S. Viswanathan G. Srinivasan AI4CE 12 70 0 14 Oct 2018
CHOPT : Automated Hyperparameter Optimization Framework for Cloud-Based Machine Learning Platforms Jingwoong Kim Minkyu Kim Heungseok Park Ernar Kusdavletov Dongjun Lee A. Kim Ji-Hoon Kim Jung-Woo Ha Nako Sung 28 14 0 08 Oct 2018
NSGA-Net: Neural Architecture Search using Multi-Objective Genetic Algorithm Zhichao Lu Ian Whalen Vishnu Boddeti Yashesh D. Dhebar Kalyanmoy Deb E. Goodman W. Banzhaf 34 81 0 08 Oct 2018
Application of Machine Learning in Wireless Networks: Key Techniques and Open Issues Yaohua Sun M. Peng Yangcheng Zhou Yuzhe Huang S. Mao 19 429 0 24 Sep 2018
Machine Learning for semi linear PDEs Quentin Chan-Wai-Nam Joseph Mikael X. Warin ODL 21 111 0 20 Sep 2018
Capacity Control of ReLU Neural Networks by Basis-path Norm Shuxin Zheng Qi Meng Huishuai Zhang Wei-neng Chen Nenghai Yu Tie-Yan Liu 24 23 0 19 Sep 2018
UAV Pose Estimation using Cross-view Geolocalization with Satellite Imagery Akshay Shetty Grace Gao 22 40 0 16 Sep 2018
Fast and Robust Symmetric Image Registration Based on Distances Combining Intensity and Spatial Information Johan Öfverstedt Joakim Lindblad Natasa Sladoje 9 42 0 30 Jul 2018
Convolutional Recurrent Neural Networks for Glucose Prediction Kezhi Li J. Daniels Chengyuan Liu P. Herrero Pantelis Georgiou BDL 19 215 0 09 Jul 2018
Solving the Kolmogorov PDE by means of deep learning C. Beck S. Becker Philipp Grohs Nor Jaafari Arnulf Jentzen 19 91 0 01 Jun 2018
An improvement of the convergence proof of the ADAM-Optimizer Sebastian Bock Josef Goppold M. Weiß 15 139 0 27 Apr 2018
High-dimension Tensor Completion via Gradient-based Optimization Under Tensor-train Format Longhao Yuan Qibin Zhao Lihua Gui Jianting Cao ViT 18 55 0 05 Apr 2018
Deep Reinforcement Learning for Traffic Light Control in Vehicular Networks Xiaoyuan Liang Xunsheng Du Guiling Wang Zhu Han 27 410 0 29 Mar 2018
Lower error bounds for the stochastic gradient descent optimization algorithm: Sharp convergence rates for slowly and fast decaying learning rates Arnulf Jentzen Philippe von Wurstemberger 75 31 0 22 Mar 2018
Efficient Hardware Realization of Convolutional Neural Networks using Intra-Kernel Regular Pruning Maurice Yang Mahmoud Faraj Assem Hussein V. Gaudet CVBM 22 12 0 15 Mar 2018
Deep Learning in Mobile and Wireless Networking: A Survey Chaoyun Zhang P. Patras Hamed Haddadi 45 1,304 0 12 Mar 2018
The History Began from AlexNet: A Comprehensive Survey on Deep Learning Approaches Md. Zahangir Alom T. Taha C. Yakopcic Stefan Westberg P. Sidike Mst Shamima Nasrin B. Van Essen A. Awwal V. Asari VLM 29 873 0 03 Mar 2018
Slow and Stale Gradients Can Win the Race: Error-Runtime Trade-offs in Distributed SGD Sanghamitra Dutta Gauri Joshi Soumyadip Ghosh Parijat Dube P. Nagpurkar 31 193 0 03 Mar 2018
$$\mathcal{G}$-SGD: Optimizing ReLU Neural Networks in its Positively Scale-Invariant Space$ $\mathcal{G}$ -SGD: Optimizing ReLU Neural Networks in its Positively Scale-Invariant Space Qi Meng Shuxin Zheng Huishuai Zhang Wei Chen Zhi-Ming Ma Tie-Yan Liu 35 38 0 11 Feb 2018
Recent Advances in Recurrent Neural Networks Hojjat Salehinejad Sharan Sankar Joseph Barfett E. Colak S. Valaee AI4TS 30 573 0 29 Dec 2017
Estimating Historical Hourly Traffic Volumes via Machine Learning and Vehicle Probe Data: A Maryland Case Study Przemysław Sekuła Nikola Marković Zachary Vander Laan K. Sadabadi 32 62 0 02 Nov 2017
Clickbait Detection in Tweets Using Self-attentive Network Yiwei Zhou 22 53 0 15 Oct 2017
Train longer, generalize better: closing the generalization gap in large batch training of neural networks Elad Hoffer Itay Hubara Daniel Soudry ODL 44 795 0 24 May 2017
Deep Robust Kalman Filter Shirli Di-Castro Shashua Shie Mannor BDL 30 28 0 07 Mar 2017
Neural Machine Translation and Sequence-to-sequence Models: A Tutorial Graham Neubig AIMat 37 171 0 05 Mar 2017