An overview of gradient descent optimization algorithms

15 September 2016

Papers citing "An overview of gradient descent optimization algorithms"

50 / 996 papers shown

Title
Attentional-Biased Stochastic Gradient Descent Q. Qi Yi Tian Xu Rong Jin W. Yin Tianbao Yang ODL 31 12 0 13 Dec 2020
The Lottery Tickets Hypothesis for Supervised and Self-supervised Pre-training in Computer Vision Models Tianlong Chen Jonathan Frankle Shiyu Chang Sijia Liu Yang Zhang Michael Carbin Zhangyang Wang 27 123 0 12 Dec 2020
The Implicit Bias for Adaptive Optimization Algorithms on Homogeneous Neural Networks Bohan Wang Qi Meng Wei Chen Tie-Yan Liu 30 33 0 11 Dec 2020
Deep Mining Generation of Lung Cancer Malignancy Models from Chest X-ray Images M. J. Horry Subrata Chakraborty B. Pradhan M. Paul D. Gomes Anwaar-ul Haq 23 11 0 10 Dec 2020
Electric Vehicle Battery Remaining Charging Time Estimation Considering Charging Accuracy and Charging Profile Prediction Junzhe Shi Min Tian Sang-Hoon Han Tung-Yan Wu Yifan Tang 11 25 0 09 Dec 2020
River: machine learning for streaming data in Python Jacob Montiel Max Halford S. Mastelini Geoffrey Bolmier Raphael Sourty ... Adil Zouitine Heitor Murilo Gomes Jesse Read T. Abdessalem Albert Bifet AI4TS AI4CE 22 191 0 08 Dec 2020
A Variant of Gradient Descent Algorithm Based on Gradient Averaging Saugata Purkayastha Sukannya Purkayastha ODL 11 2 0 04 Dec 2020
SSGD: A safe and efficient method of gradient descent Jinhuan Duan Xianxian Li Shiqi Gao Jinyan Wang Ziliang Zhong 10 4 0 03 Dec 2020
Towards Repairing Neural Networks Correctly Guoliang Dong Jun Sun Jingyi Wang Xinyu Wang Ting Dai 22 23 0 03 Dec 2020
Intrusion Detection Systems for IoT: opportunities and challenges offered by Edge Computing and Machine Learning Pietro Spadaccino F. Cuomo 16 19 0 02 Dec 2020
MUSCLE: Strengthening Semi-Supervised Learning Via Concurrent Unsupervised Learning Using Mutual Information Maximization Hanchen Xie Mohamed E. Hussein Aram Galstyan Wael Abd-Almageed SSL 28 8 0 30 Nov 2020
Sparse-View Spectral CT Reconstruction Using Deep Learning Wail Mustafa C. Kehl U. L. Olsen Søren Kimmer Schou Gregersen David Malmgren-Hansen J. Kehres A. Dahl 24 10 0 30 Nov 2020
Privacy-Preserving Federated Learning for UAV-Enabled Networks: Learning-Based Joint Scheduling and Resource Management Helin Yang Jun Zhao Zehui Xiong Kwok-Yan Lam Sumei Sun Liang Xiao 11 179 0 28 Nov 2020
LocKedge: Low-Complexity Cyberattack Detection in IoT Edge Computing Truong Thu Huong Ta Phuong Bac D. M. Long B. D. Thang N. T. Binh T. D. Luong Tran Kim Phuc 31 43 0 28 Nov 2020
On Generalization of Adaptive Methods for Over-parameterized Linear Regression Vatsal Shah Soumya Basu Anastasios Kyrillidis Sujay Sanghavi AI4CE 25 4 0 28 Nov 2020
Temporal Autoencoder with U-Net Style Skip-Connections for Frame Prediction Jay Santokhi P. Daga Joned Sarwar Anna Jordan Emil Hewage 4 5 0 25 Nov 2020
SMG: A Shuffling Gradient-Based Method with Momentum Trang H. Tran Lam M. Nguyen Quoc Tran-Dinh 23 21 0 24 Nov 2020
Improving epidemic testing and containment strategies using machine learning Laura Natali Saga Helgadottir O. Maragò Giovanni Volpe 26 6 0 23 Nov 2020
ZORB: A Derivative-Free Backpropagation Algorithm for Neural Networks Varun Ranganathan Alex Lewandowski ODL 11 7 0 17 Nov 2020
MG-GCN: Fast and Effective Learning with Mix-grained Aggregators for Training Large Graph Convolutional Networks Tao Huang Yihan Zhang Jiajing Wu Junyuan Fang Zibin Zheng GNN 14 2 0 17 Nov 2020
Advances in the training, pruning and enforcement of shape constraints of Morphological Neural Networks using Tropical Algebra Nikolaos Dimitriadis Petros Maragos 13 9 0 15 Nov 2020
Federated Multi-Mini-Batch: An Efficient Training Approach to Federated Learning in Non-IID Environments Reza Nasirigerdeh Mohammad Bakhtiari Reihaneh Torkzadehmahani Amirhossein Bayat M. List David B. Blumenthal Jan Baumbach FedML 24 8 0 13 Nov 2020
Improving Offline Contextual Bandits with Distributional Robustness Otmane Sakhi Louis Faury Flavian Vasile OffRL 7 7 0 13 Nov 2020
Privacy Preservation in Federated Learning: An insightful survey from the GDPR Perspective N. Truong Kai Sun Siyao Wang Florian Guitton Yike Guo FedML 12 9 0 10 Nov 2020
Numerically Solving Parametric Families of High-Dimensional Kolmogorov Partial Differential Equations via Deep Learning Julius Berner Markus Dablander Philipp Grohs 9 46 0 09 Nov 2020
Predictive Process Model Monitoring using Recurrent Neural Networks Johannes De Smedt Jochen De Weerdt 17 0 0 05 Nov 2020
Differentially Private ADMM Algorithms for Machine Learning Tao Xu Fanhua Shang Yuanyuan Liu Hongying Liu Longjie Shen Maoguo Gong 36 17 0 31 Oct 2020
Deep neural network for solving differential equations motivated by Legendre-Galerkin approximation Bryce Chudomelka Youngjoon Hong Hyunwoo J. Kim Jinyoung Park 27 7 0 24 Oct 2020
DualNet: Locate Then Detect Effective Payload with Deep Attention Network Shiyi Yang Peilun Wu Hui Guo 13 9 0 23 Oct 2020
A ReLU Dense Layer to Improve the Performance of Neural Networks Alireza M. Javid Sandipan Das Mikael Skoglund S. Chatterjee 26 31 0 22 Oct 2020
Effects of the Nonlinearity in Activation Functions on the Performance of Deep Learning Models N. Kulathunga N. R. Ranasinghe D. Vrinceanu Zackary Kinsman Lei Huang Yunjiao Wang 10 4 0 14 Oct 2020
Consumer Behaviour in Retail: Next Logical Purchase using Deep Neural Network Ankur Verma 16 6 0 14 Oct 2020
Just Pick a Sign: Optimizing Deep Multitask Models with Gradient Sign Dropout Zhao Chen Jiquan Ngiam Yanping Huang Thang Luong Henrik Kretzschmar Yuning Chai Dragomir Anguelov 41 206 0 14 Oct 2020
AEGD: Adaptive Gradient Descent with Energy Hailiang Liu Xuping Tian ODL 27 11 0 10 Oct 2020
Learning Thermodynamically Stable and Galilean Invariant Partial Differential Equations for Non-equilibrium Flows Juntao Huang Zhiting Ma Y. Zhou W. Yong AI4CE 43 16 0 28 Sep 2020
Federated Learning with Nesterov Accelerated Gradient Zhengjie Yang Wei Bao Dong Yuan Nguyen H. Tran Albert Y. Zomaya FedML 19 29 0 18 Sep 2020
Review: Deep Learning in Electron Microscopy Jeffrey M. Ede 34 79 0 17 Sep 2020
A Qualitative Study of the Dynamic Behavior for Adaptive Gradient Algorithms Chao Ma Lei Wu E. Weinan ODL 19 23 0 14 Sep 2020
Variational Preparation of the Sachdev-Ye-Kitaev Thermofield Double V. P. Su 15 7 0 09 Sep 2020
Self-Adaptive Physics-Informed Neural Networks using a Soft Attention Mechanism L. McClenny U. Braga-Neto PINN 28 444 0 07 Sep 2020
On segmentation of pectoralis muscle in digital mammograms by means of deep learning H. Soleimani O. Michailovich 6 21 0 29 Aug 2020
Gravilon: Applications of a New Gradient Descent Method to Machine Learning Chad Kelterborn Marcin Mazur B. Petrenko ODL 9 4 0 26 Aug 2020
A Survey on Large-scale Machine Learning Meng Wang Weijie Fu Xiangnan He Shijie Hao Xindong Wu 22 109 0 10 Aug 2020
A Comparison of Optimization Algorithms for Deep Learning Derya Soydaner 87 151 0 28 Jul 2020
CNN Detection of GAN-Generated Face Images based on Cross-Band Co-occurrences Analysis Mauro Barni Kassem Kallas Ehsan Nowroozi B. Tondi CVBM 22 76 0 25 Jul 2020
Learn distributed GAN with Temporary Discriminators Hui Qu Yikai Zhang Qi Chang Zhennan Yan Chao Chen Dimitris N. Metaxas FedML 21 16 0 17 Jul 2020
Balancing Rates and Variance via Adaptive Batch-Size for Stochastic Optimization Problems Zhan Gao Alec Koppel Alejandro Ribeiro 30 10 0 02 Jul 2020
Influence Functions in Deep Learning Are Fragile S. Basu Phillip E. Pope S. Feizi TDI 37 219 0 25 Jun 2020
Explainable CNN-attention Networks (C-Attention Network) for Automated Detection of Alzheimer's Disease Ning Wang Mingxuan Chen K. P. Subbalakshmi 20 22 0 25 Jun 2020
A Constructive, Type-Theoretic Approach to Regression via Global Optimisation D. Ghica Todd Waugh Ambridge 10 0 0 23 Jun 2020