An overview of gradient descent optimization algorithms

15 September 2016

Papers citing "An overview of gradient descent optimization algorithms"

50 / 1,004 papers shown

Title
A Probabilistically Motivated Learning Rate Adaptation for Stochastic Optimization Filip de Roos Carl Jidling A. Wills Thomas B. Schon Philipp Hennig 23 3 0 22 Feb 2021
Scalable Balanced Training of Conditional Generative Adversarial Neural Networks on Image Data Massimiliano Lupo Pasini Vittorio Gabbi Junqi Yin S. Perotto N. Laanait GAN AI4CE 24 3 0 21 Feb 2021
A proof of convergence for gradient descent in the training of artificial neural networks for constant target functions Patrick Cheridito Arnulf Jentzen Adrian Riekert Florian Rossmannek 28 24 0 19 Feb 2021
Stochastic Spatio-Temporal Optimization for Control and Co-Design of Systems in Robotics and Applied Physics Ethan N. Evans Andrew P. Kendall Evangelos A. Theodorou AI4CE 28 11 0 18 Feb 2021
Introducing the Hidden Neural Markov Chain framework E. Azeraf E. Monfrini Emmanuel Vignon W. Pieczynski BDL 16 5 0 17 Feb 2021
Momentum Residual Neural Networks Michael E. Sander Pierre Ablin Mathieu Blondel Gabriel Peyré 27 57 0 15 Feb 2021
The Role of Momentum Parameters in the Optimal Convergence of Adaptive Polyak's Heavy-ball Methods Wei Tao Sheng Long Gao-wei Wu Qing Tao 15 14 0 15 Feb 2021
Asymmetric Heavy Tails and Implicit Bias in Gaussian Noise Injections A. Camuto Xiaoyu Wang Lingjiong Zhu Chris Holmes Mert Gurbuzbalaban Umut Simsekli 11 16 0 13 Feb 2021
Self-Supervised Multisensor Change Detection Sudipan Saha Patrick Ebel Xiaoxiang Zhu SSL 29 80 0 12 Feb 2021
COVID-19 identification from volumetric chest CT scans using a progressively resized 3D-CNN incorporating segmentation, augmentation, and class-rebalancing Md. Kamrul Hasan Md. Tasnim Jawad Kazi N. Hasan Sajal Basak Partha Md. Masum Al Masba Shumit Saha 26 21 0 11 Feb 2021
Mutually exciting point process graphs for modelling dynamic networks Francesco Sanna Passino N. Heard 9 14 0 11 Feb 2021
Privacy-Preserving Graph Convolutional Networks for Text Classification Timour Igamberdiev Ivan Habernal GNN 31 33 0 10 Feb 2021
Absolute 3D Pose Estimation and Length Measurement of Severely Deformed Fish from Monocular Videos in Longline Fishing J. Mei Lei Li S. Romain Craig S. Rose Braden Moore Kelsey Magrane 12 5 0 09 Feb 2021
An Unbiased Estimator of the Full-sky CMB Angular Power Spectrum at Large Scales using Neural Networks Pallav Chanda Rajib Saha 6 3 0 08 Feb 2021
An Analytic Layer-wise Deep Learning Framework with Applications to Robotics Huu-Thiet Nguyen C. Cheah Kar-Ann Toh 16 16 0 07 Feb 2021
Robust Principal Component Analysis: A Median of Means Approach Debolina Paul Saptarshi Chakraborty Swagatam Das 24 8 0 05 Feb 2021
Evaluating Deep Learning in SystemML using Layer-wise Adaptive Rate Scaling(LARS) Optimizer Kanchan Chowdhury Ankita Sharma A. Chandrasekar 14 2 0 05 Feb 2021
IWA: Integrated Gradient based White-box Attacks for Fooling Deep Neural Networks Yixiang Wang Jiqiang Liu Xiaolin Chang J. Misic Vojislav B. Mišić AAML 47 12 0 03 Feb 2021
Length Learning for Planar Euclidean Curves B. Or Liam Hazan 15 0 0 03 Feb 2021
The problem of perfect predictors in statistical spike train models Sahand Farhoodi U. Eden 7 3 0 01 Feb 2021
Synthetic Dataset Generation of Driver Telematics Banghee So J. Boucher Emiliano A. Valdez 30 24 0 30 Jan 2021
Choice modelling in the age of machine learning -- discussion paper S. Cranenburgh S. Wang A. Vij Francisco Câmara Pereira J. Walker 28 88 0 28 Jan 2021
Reverse Derivative Ascent: A Categorical Approach to Learning Boolean Circuits Paul W. Wilson Fabio Zanasi 41 15 0 26 Jan 2021
A fusion method for multi-valued data Martin Papvco Iosu Rodríguez-Martínez Javier Fumanal-Idocin A. Altalhi H. Bustince 16 7 0 25 Jan 2021
Optimizing Convergence for Iterative Learning of ARIMA for Stationary Time Series K. Styp-Rekowski Florian Schmidt O. Kao AI4TS 9 0 0 25 Jan 2021
Modern Machine and Deep Learning Systems as a way to achieve Man-Computer Symbiosis Chirag Gupta 28 0 0 24 Jan 2021
Expression Recognition Analysis in the Wild Donato Cafarelli F. V. Massoli Fabrizio Falchi Claudio Gennaro Giuseppe Amato CVBM 33 0 0 22 Jan 2021
A Review on Deep Learning in UAV Remote Sensing L. Osco J. M. Junior A. P. Ramos L. Jorge S. Fatholahi J. Silva E. Matsubara H. Pistori W. Gonçalves Jonathan Li AI4Cl 39 342 0 22 Jan 2021
Knowledge-Preserving Incremental Social Event Detection via Heterogeneous GNNs Yuwei Cao Hao Peng Jia Wu Yingtong Dou Jianxin Li Philip S. Yu 27 90 0 21 Jan 2021
Learning DNN networks using un-rectifying ReLU with compressed sensing application W. Hwang Shih-Shuo Tung 11 2 0 18 Jan 2021
Hybrid Quantum-Classical Graph Convolutional Network Samuel Yen-Chi Chen T. Wei Chao Zhang Haiwang Yu Shinjae Yoo GNN 18 36 0 15 Jan 2021
Scared into Action: How Partisanship and Fear are Associated with Reactions to Public Health Directives M. Lindow David DeFranza Arul Mishra Himanshu Mishra AI4CE 11 0 0 14 Jan 2021
Advances in Electron Microscopy with Deep Learning Jeffrey M. Ede 35 2 0 04 Jan 2021
Algorithmic Complexities in Backpropagation and Tropical Neural Networks Ozgur Ceyhan 17 0 0 03 Jan 2021
Recoding latent sentence representations -- Dynamic gradient-based activation modification in RNNs Dennis Ulmer 33 0 0 03 Jan 2021
An Artificial Intelligence System for Combined Fruit Detection and Georeferencing, Using RTK-Based Perspective Projection in Drone Imagery Angus Baird Stefano Giani 17 1 0 01 Jan 2021
Fast covariance parameter estimation of spatial Gaussian process models using neural networks Florian Gerber D. Nychka 9 37 0 30 Dec 2020
Generalized Categorisation of Digital Pathology Whole Image Slides using Unsupervised Learning Mostafa E. A. Ibrahim K. Bryson 8 0 0 27 Dec 2020
Layer Decomposition Learning Based on Gaussian Convolution Model and Residual Deblurring for Inverse Halftoning Chang-Hwan Son 14 0 0 27 Dec 2020
Using the Naive Bayes as a discriminative classifier E. Azeraf E. Monfrini W. Pieczynski 20 0 0 25 Dec 2020
Vehicle Re-identification Based on Dual Distance Center Loss Zhijun Hu Yong-mei Xu Jie Wen Lilei Sun Sun · Raja 16 0 0 23 Dec 2020
Quantum Convolutional Neural Networks for High Energy Physics Data Analysis Samuel Yen-Chi Chen T. Wei Chao Zhang Haiwang Yu Shinjae Yoo 36 104 0 22 Dec 2020
Mobile Robot Planner with Low-cost Cameras Using Deep Reinforcement Learning M. Tran N. Ly 16 1 0 21 Dec 2020
Artificial Neural Networks to Impute Rounded Zeros in Compositional Data M. Templ 16 8 0 18 Dec 2020
Learning-based Prediction and Uplink Retransmission for Wireless Virtual Reality (VR) Network Xiaonan Liu Xinyu Li Yansha Deng 12 3 0 16 Dec 2020
Masksembles for Uncertainty Estimation N. Durasov Timur M. Bagautdinov Pierre Baqué Pascal Fua OOD UQCV 11 81 0 15 Dec 2020
CosSGD: Communication-Efficient Federated Learning with a Simple Cosine-Based Quantization Yang He Hui-Po Wang M. Zenk Mario Fritz FedML MQ 22 8 0 15 Dec 2020
Recovery of Linear Components: Reduced Complexity Autoencoder Designs Federico Zocco Seán F. McLoone 25 4 0 14 Dec 2020
An Adaptive Memory Multi-Batch L-BFGS Algorithm for Neural Network Training Federico Zocco Seán F. McLoone ODL 26 4 0 14 Dec 2020
CHS-Net: A Deep learning approach for hierarchical segmentation of COVID-19 infected CT images Narinder Singh Punn Sonali Agarwal 32 31 0 13 Dec 2020