An overview of gradient descent optimization algorithms

15 September 2016

Papers citing "An overview of gradient descent optimization algorithms"

50 / 996 papers shown

Title
Deep Learning with Functional Inputs Barinder Thind Kevin Multani Jiguo Cao 19 21 0 17 Jun 2020
Interaction Networks: Using a Reinforcement Learner to train other Machine Learning algorithms Florian Dietz 17 1 0 15 Jun 2020
Almost sure convergence rates for Stochastic Gradient Descent and Stochastic Heavy Ball Othmane Sebbouh Robert Mansel Gower Aaron Defazio 6 22 0 14 Jun 2020
A comparative study of 2D image segmentation algorithms for traumatic brain lesions using CT data from the ProTECTIII multicenter clinical trial Shruti Jadon Owen P. Leary I. Pan Tyler Harder D. Wright Lisa H. Merck D. Merck 27 27 0 01 Jun 2020
A Comprehensive Study of Data Augmentation Strategies for Prostate Cancer Detection in Diffusion-weighted MRI using Convolutional Neural Networks Ruqian Hao Khashayar Namdar Lin Liu M. Haider Farzad Khalvati MedIm 18 57 0 01 Jun 2020
ADAHESSIAN: An Adaptive Second Order Optimizer for Machine Learning Z. Yao A. Gholami Sheng Shen Mustafa Mustafa Kurt Keutzer Michael W. Mahoney ODL 39 275 0 01 Jun 2020
Synthetic Learning: Learn From Distributed Asynchronized Discriminator GAN Without Sharing Medical Image Data Qi Chang Hui Qu Yikai Zhang M. Sabuncu Chao Chen Tong Zhang Dimitris N. Metaxas MedIm 34 78 0 29 May 2020
Mass Estimation of Galaxy Clusters with Deep Learning II: CMB Cluster Lensing N. Gupta C. Reichardt 18 13 0 28 May 2020
Generative Adversarial Networks for Bitcoin Data Augmentation Francesco Zola Jan L. Bruse Xabier Etxeberria Barrio M. Galar Raul Orduna Urrutia GAN 22 8 0 27 May 2020
An Introduction to Neural Architecture Search for Convolutional Networks George Kyriakides K. Margaritis AI4CE 25 27 0 22 May 2020
Hidden Markov Chains, Entropic Forward-Backward, and Part-Of-Speech Tagging E. Azeraf E. Monfrini Emmanuel Vignon W. Pieczynski BDL 24 9 0 21 May 2020
Automated Copper Alloy Grain Size Evaluation Using a Deep-learning CNN George S. Baggs P. Guerrier A. Loeb Jason C. Jones 26 9 0 20 May 2020
A Combined Data-driven and Physics-driven Method for Steady Heat Conduction Prediction using Deep Convolutional Neural Networks Hao Ma Xiangyu Y. Hu Yuxuan Zhang Nils Thuerey O. Haidn AI4CE 26 12 0 16 May 2020
MixML: A Unified Analysis of Weakly Consistent Parallel Learning Yucheng Lu J. Nash Christopher De Sa FedML 32 12 0 14 May 2020
A Review of Privacy-preserving Federated Learning for the Internet-of-Things Christopher Briggs Zhong Fan Péter András 28 15 0 24 Apr 2020
Automated diagnosis of COVID-19 with limited posteroanterior chest X-ray images using fine-tuned deep neural networks Narinder Singh Punn Sonali Agarwal 15 191 0 23 Apr 2020
Structure-preserving neural networks Quercus Hernandez Alberto Badías D. González Francisco Chinesta Elías Cueto PINN 22 70 0 09 Apr 2020
Adaptive Partial Scanning Transmission Electron Microscopy with Reinforcement Learning Jeffrey M. Ede 24 12 0 06 Apr 2020
On the convergence of physics informed neural networks for linear second-order elliptic and parabolic type PDEs Yeonjong Shin Jérome Darbon George Karniadakis PINN 14 79 0 03 Apr 2020
OptTyper: Probabilistic Type Inference by Optimising Logical and Natural Constraints Irene Vlassi Pandi Earl T. Barr Andrew D. Gordon Charles Sutton 22 29 0 01 Apr 2020
Explore and Exploit with Heterotic Line Bundle Models Magdalena Larfors Robin Schneider 36 38 0 10 Mar 2020
Joint Parameter-and-Bandwidth Allocation for Improving the Efficiency of Partitioned Edge Learning Dingzhu Wen M. Bennis Kaibin Huang 31 48 0 10 Mar 2020
Warwick Electron Microscopy Datasets Jeffrey M. Ede 22 14 0 02 Mar 2020
CSM-NN: Current Source Model Based Logic Circuit Simulation -- A Neural Network Approach M. Abrishami Massoud Pedram Shahin Nazarian 17 7 0 13 Feb 2020
LaProp: Separating Momentum and Adaptivity in Adam Liu Ziyin Zhikang T.Wang Masahito Ueda ODL 13 18 0 12 Feb 2020
A Comprehensive Survey of Multilingual Neural Machine Translation Raj Dabre Chenhui Chu Anoop Kunchukuttan LRM 33 33 0 04 Jan 2020
Deep Learning-Based Intrusion Detection System for Advanced Metering Infrastructure Zakaria El Mrabet Mehdi Ezzari Hassan El Ghazi B. A. E. Majd 11 14 0 31 Dec 2019
Pipelined Training with Stale Weights of Deep Convolutional Neural Networks Lifu Zhang T. Abdelrahman 21 0 0 29 Dec 2019
SoftAdapt: Techniques for Adaptive Loss Weighting of Neural Networks with Multi-Part Loss Functions A. Heydari Craig Thompson A. Mehmood 29 57 0 27 Dec 2019
Optimization for deep learning: theory and algorithms Ruoyu Sun ODL 25 168 0 19 Dec 2019
Adaptive dynamic programming for nonaffine nonlinear optimal control problem with state constraints Jingliang Duan Zhengyu Liu Shengbo Eben Li Qi Sun Zhenzhong Jia B. Cheng 15 64 0 26 Nov 2019
Smart Predict-and-Optimize for Hard Combinatorial Optimization Problems Jaynta Mandi Emir Demirović Peter Stuckey Tias Guns 15 143 0 22 Nov 2019
Variable Star Classification Using Multi-View Metric Learning K. Johnston S. Caballero-Nieves V. Petit A. Peter Rana Haber 12 3 0 13 Nov 2019
An Efficient and Effective Second-Order Training Algorithm for LSTM-based Adaptive Learning Nuri Mert Vural Salih Ergüt Suleyman Serdar Kozat 16 12 0 22 Oct 2019
Characterizing Deep Learning Training Workloads on Alibaba-PAI Mengdi Wang Chen Meng Guoping Long Chuan Wu Jun Yang Wei Lin Yangqing Jia 22 53 0 14 Oct 2019
Generative Neural Network based Spectrum Sharing using Linear Sum Assignment Problems A. B. Zaki J. Huang Kaishun Wu B. Elhalawany 19 15 0 12 Oct 2019
Demon: Improved Neural Network Training with Momentum Decay John Chen Cameron R. Wolfe Zhaoqi Li Anastasios Kyrillidis ODL 24 15 0 11 Oct 2019
Stochastic gradient descent for hybrid quantum-classical optimization R. Sweke Frederik Wilde Johannes Jakob Meyer Maria Schuld Paul K. Fährmann Barthélémy Meynard-Piganeau Jens Eisert 17 236 0 02 Oct 2019
Locally adaptive activation functions with slope recovery term for deep and physics-informed neural networks Ameya Dilip Jagtap Kenji Kawaguchi George Karniadakis ODL 29 85 0 25 Sep 2019
Deep Convolutions for In-Depth Automated Rock Typing E. E. Baraboshkin L. Ismailova D. Orlov E. Zhukovskaya G. Kalmykov O. V. Khotylev E. Baraboshkin D. Koroteev 33 84 0 23 Sep 2019
A Multi-level procedure for enhancing accuracy of machine learning algorithms K. Lye Siddhartha Mishra Roberto Molinaro 17 32 0 20 Sep 2019
The Wang-Landau Algorithm as Stochastic Optimization and Its Acceleration Chenguang Dai Jun S. Liu 19 4 0 27 Jul 2019
DEAM: Adaptive Momentum with Discriminative Weight for Stochastic Optimization Jiyang Bai Yuxiang Ren Jiawei Zhang ODL 21 1 0 25 Jul 2019
Hyperlink Regression via Bregman Divergence Akifumi Okuno Hidetoshi Shimodaira 33 6 0 22 Jul 2019
A CNN-Based Super-Resolution Technique for Active Fire Detection on Sentinel-2 Data M. Gargiulo Domenico A. G. DellÁglio A. Iodice D. Riccio G. Ruello 14 21 0 25 Jun 2019
Radio Galaxy Zoo: Unsupervised Clustering of Convolutionally Auto-encoded Radio-astronomical Images Nicholas O. Ralph Ray P. Norris Guangchi Fang Laurence A. F. Park T. J. Galvin ... H. Andernach Chris J. Lintott L. Rudnick S. Shabala O. I. Wong 15 34 0 07 Jun 2019
A Novel Deep Neural Network Based Approach for Sparse Code Multiple Access Jinzhi Lin Shengzhong Feng Zhile Yang Yun Zhang Yong Zhang 37 32 0 04 Jun 2019
A multi-path 2.5 dimensional convolutional neural network system for segmenting stroke lesions in brain MRI images Yunzhe Xue F. Farhat Olga Boukrina A. Barrett J. Binder Usman Roshan William W. Graves MedIm 13 64 0 26 May 2019
LGM-Net: Learning to Generate Matching Networks for Few-Shot Learning Huaiyu Li Weiming Dong Xing Mei Chongyang Ma Feiyue Huang Bao-Gang Hu OffRL 32 98 0 15 May 2019
Deep Neural Networks for Marine Debris Detection in Sonar Images Matias Valdenegro-Toro 27 25 0 13 May 2019