ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 1609.04747
  4. Cited By
An overview of gradient descent optimization algorithms
v1v2 (latest)

An overview of gradient descent optimization algorithms

15 September 2016
Sebastian Ruder
    ODL
ArXiv (abs)PDFHTML

Papers citing "An overview of gradient descent optimization algorithms"

50 / 698 papers shown
Title
Modern Machine and Deep Learning Systems as a way to achieve
  Man-Computer Symbiosis
Modern Machine and Deep Learning Systems as a way to achieve Man-Computer Symbiosis
Chirag Gupta
69
0
0
24 Jan 2021
On managing vulnerabilities in AI/ML systems
On managing vulnerabilities in AI/ML systems
Jonathan M. Spring
April Galyardt
A. Householder
Nathan M. VanHoudnos
64
19
0
22 Jan 2021
Expression Recognition Analysis in the Wild
Expression Recognition Analysis in the Wild
Donato Cafarelli
F. V. Massoli
Fabrizio Falchi
Claudio Gennaro
Giuseppe Amato
CVBM
124
0
0
22 Jan 2021
A Review on Deep Learning in UAV Remote Sensing
A Review on Deep Learning in UAV Remote Sensing
L. Osco
J. M. Junior
A. P. Ramos
L. Jorge
S. Fatholahi
J. Silva
E. Matsubara
H. Pistori
W. Gonçalves
Jonathan Li
AI4Cl
101
364
0
22 Jan 2021
Knowledge-Preserving Incremental Social Event Detection via
  Heterogeneous GNNs
Knowledge-Preserving Incremental Social Event Detection via Heterogeneous GNNs
Dongyuan Li
Hao Peng
Hongzhi Zhang
Yingtong Dou
Jianxin Li
Philip S. Yu
82
98
0
21 Jan 2021
Hybrid Quantum-Classical Graph Convolutional Network
Hybrid Quantum-Classical Graph Convolutional Network
Samuel Yen-Chi Chen
T. Wei
Chao Zhang
Haiwang Yu
Shinjae Yoo
GNN
88
36
0
15 Jan 2021
Algorithmic Complexities in Backpropagation and Tropical Neural Networks
Algorithmic Complexities in Backpropagation and Tropical Neural Networks
Ozgur Ceyhan
29
1
0
03 Jan 2021
Using the Naive Bayes as a discriminative classifier
Using the Naive Bayes as a discriminative classifier
E. Azeraf
E. Monfrini
W. Pieczynski
32
0
0
25 Dec 2020
Quantum Convolutional Neural Networks for High Energy Physics Data
  Analysis
Quantum Convolutional Neural Networks for High Energy Physics Data Analysis
Samuel Yen-Chi Chen
T. Wei
Chao Zhang
Haiwang Yu
Shinjae Yoo
99
118
0
22 Dec 2020
Mobile Robot Planner with Low-cost Cameras Using Deep Reinforcement
  Learning
Mobile Robot Planner with Low-cost Cameras Using Deep Reinforcement Learning
M. Tran
N. Ly
25
1
0
21 Dec 2020
Artificial Neural Networks to Impute Rounded Zeros in Compositional Data
Artificial Neural Networks to Impute Rounded Zeros in Compositional Data
M. Templ
45
8
0
18 Dec 2020
Learning-based Prediction and Uplink Retransmission for Wireless Virtual
  Reality (VR) Network
Learning-based Prediction and Uplink Retransmission for Wireless Virtual Reality (VR) Network
Xiaonan Liu
Xinyu Li
Yansha Deng
45
3
0
16 Dec 2020
Recovery of Linear Components: Reduced Complexity Autoencoder Designs
Recovery of Linear Components: Reduced Complexity Autoencoder Designs
Federico Zocco
Seán F. McLoone
109
4
0
14 Dec 2020
An Adaptive Memory Multi-Batch L-BFGS Algorithm for Neural Network
  Training
An Adaptive Memory Multi-Batch L-BFGS Algorithm for Neural Network Training
Federico Zocco
Seán F. McLoone
ODL
55
5
0
14 Dec 2020
CHS-Net: A Deep learning approach for hierarchical segmentation of
  COVID-19 infected CT images
CHS-Net: A Deep learning approach for hierarchical segmentation of COVID-19 infected CT images
Narinder Singh Punn
Sonali Agarwal
114
32
0
13 Dec 2020
Attentional-Biased Stochastic Gradient Descent
Attentional-Biased Stochastic Gradient Descent
Q. Qi
Yi Tian Xu
Rong Jin
W. Yin
Tianbao Yang
ODL
84
12
0
13 Dec 2020
The Lottery Tickets Hypothesis for Supervised and Self-supervised
  Pre-training in Computer Vision Models
The Lottery Tickets Hypothesis for Supervised and Self-supervised Pre-training in Computer Vision Models
Tianlong Chen
Jonathan Frankle
Shiyu Chang
Sijia Liu
Yang Zhang
Michael Carbin
Zhangyang Wang
99
123
0
12 Dec 2020
The Implicit Bias for Adaptive Optimization Algorithms on Homogeneous
  Neural Networks
The Implicit Bias for Adaptive Optimization Algorithms on Homogeneous Neural Networks
Bohan Wang
Qi Meng
Wei Chen
Tie-Yan Liu
84
36
0
11 Dec 2020
Deep Mining Generation of Lung Cancer Malignancy Models from Chest X-ray
  Images
Deep Mining Generation of Lung Cancer Malignancy Models from Chest X-ray Images
M. J. Horry
Subrata Chakraborty
B. Pradhan
M. Paul
D. Gomes
Anwaar-ul Haq
56
11
0
10 Dec 2020
River: machine learning for streaming data in Python
River: machine learning for streaming data in Python
Jacob Montiel
Max Halford
S. Mastelini
Geoffrey Bolmier
Raphael Sourty
...
Adil Zouitine
Heitor Murilo Gomes
Jesse Read
T. Abdessalem
Albert Bifet
AI4TSAI4CE
91
200
0
08 Dec 2020
SSGD: A safe and efficient method of gradient descent
SSGD: A safe and efficient method of gradient descent
Jinhuan Duan
Xianxian Li
Shiqi Gao
Jinyan Wang
Ziliang Zhong
46
4
0
03 Dec 2020
Towards Repairing Neural Networks Correctly
Towards Repairing Neural Networks Correctly
Guoliang Dong
Jun Sun
Jingyi Wang
Xinyu Wang
Ting Dai
57
24
0
03 Dec 2020
MYSTIKO : : Cloud-Mediated, Private, Federated Gradient Descent
MYSTIKO : : Cloud-Mediated, Private, Federated Gradient Descent
K.R. Jayaram
Archit Verma
A. Verma
Gegi Thomas
Colin Sutcher-Shepard
FedML
45
11
0
01 Dec 2020
MUSCLE: Strengthening Semi-Supervised Learning Via Concurrent
  Unsupervised Learning Using Mutual Information Maximization
MUSCLE: Strengthening Semi-Supervised Learning Via Concurrent Unsupervised Learning Using Mutual Information Maximization
Hanchen Xie
Mohamed E. Hussein
Aram Galstyan
Wael Abd-Almageed
SSL
59
8
0
30 Nov 2020
Sparse-View Spectral CT Reconstruction Using Deep Learning
Sparse-View Spectral CT Reconstruction Using Deep Learning
Wail Mustafa
C. Kehl
U. L. Olsen
Søren Kimmer Schou Gregersen
David Malmgren-Hansen
J. Kehres
A. Dahl
39
10
0
30 Nov 2020
Privacy-Preserving Federated Learning for UAV-Enabled Networks:
  Learning-Based Joint Scheduling and Resource Management
Privacy-Preserving Federated Learning for UAV-Enabled Networks: Learning-Based Joint Scheduling and Resource Management
Helin Yang
Jun Zhao
Zehui Xiong
Kwok-Yan Lam
Sumei Sun
Liang Xiao
70
188
0
28 Nov 2020
LocKedge: Low-Complexity Cyberattack Detection in IoT Edge Computing
LocKedge: Low-Complexity Cyberattack Detection in IoT Edge Computing
Truong Thu Huong
Ta Phuong Bac
D. M. Long
B. D. Thang
N. T. Binh
T. D. Luong
Tran Kim Phuc
50
45
0
28 Nov 2020
On Generalization of Adaptive Methods for Over-parameterized Linear
  Regression
On Generalization of Adaptive Methods for Over-parameterized Linear Regression
Vatsal Shah
Soumya Basu
Anastasios Kyrillidis
Sujay Sanghavi
AI4CE
59
4
0
28 Nov 2020
Temporal Autoencoder with U-Net Style Skip-Connections for Frame
  Prediction
Temporal Autoencoder with U-Net Style Skip-Connections for Frame Prediction
Jay Santokhi
P. Daga
Joned Sarwar
Anna Jordan
Emil Hewage
27
5
0
25 Nov 2020
SMG: A Shuffling Gradient-Based Method with Momentum
SMG: A Shuffling Gradient-Based Method with Momentum
Trang H. Tran
Lam M. Nguyen
Quoc Tran-Dinh
80
22
0
24 Nov 2020
Improving epidemic testing and containment strategies using machine
  learning
Improving epidemic testing and containment strategies using machine learning
Laura Natali
Saga Helgadottir
O. Maragò
Giovanni Volpe
51
6
0
23 Nov 2020
Natural-gradient learning for spiking neurons
Natural-gradient learning for spiking neurons
Elena Kreutzer
Walter Senn
Mihai A. Petrovici
48
13
0
23 Nov 2020
ZORB: A Derivative-Free Backpropagation Algorithm for Neural Networks
ZORB: A Derivative-Free Backpropagation Algorithm for Neural Networks
Varun Ranganathan
Alex Lewandowski
ODL
59
7
0
17 Nov 2020
Advances in the training, pruning and enforcement of shape constraints
  of Morphological Neural Networks using Tropical Algebra
Advances in the training, pruning and enforcement of shape constraints of Morphological Neural Networks using Tropical Algebra
Nikolaos Dimitriadis
Petros Maragos
115
9
0
15 Nov 2020
Federated Multi-Mini-Batch: An Efficient Training Approach to Federated
  Learning in Non-IID Environments
Federated Multi-Mini-Batch: An Efficient Training Approach to Federated Learning in Non-IID Environments
Reza Nasirigerdeh
Mohammad Bakhtiari
Reihaneh Torkzadehmahani
Amirhossein Bayat
M. List
David B. Blumenthal
Jan Baumbach
FedML
46
8
0
13 Nov 2020
Improving Offline Contextual Bandits with Distributional Robustness
Improving Offline Contextual Bandits with Distributional Robustness
Otmane Sakhi
Louis Faury
Flavian Vasile
OffRL
41
7
0
13 Nov 2020
Privacy Preservation in Federated Learning: An insightful survey from
  the GDPR Perspective
Privacy Preservation in Federated Learning: An insightful survey from the GDPR Perspective
N. Truong
Kai Sun
Siyao Wang
Florian Guitton
Yike Guo
FedML
65
9
0
10 Nov 2020
Predictive Process Model Monitoring using Recurrent Neural Networks
Predictive Process Model Monitoring using Recurrent Neural Networks
Johannes De Smedt
Jochen De Weerdt
42
0
0
05 Nov 2020
Differentially Private ADMM Algorithms for Machine Learning
Differentially Private ADMM Algorithms for Machine Learning
Tao Xu
Fanhua Shang
Yuanyuan Liu
Hongying Liu
Longjie Shen
Maoguo Gong
91
18
0
31 Oct 2020
Deep neural network for solving differential equations motivated by
  Legendre-Galerkin approximation
Deep neural network for solving differential equations motivated by Legendre-Galerkin approximation
Bryce Chudomelka
Youngjoon Hong
Hyunwoo J. Kim
Jinyoung Park
74
7
0
24 Oct 2020
DualNet: Locate Then Detect Effective Payload with Deep Attention
  Network
DualNet: Locate Then Detect Effective Payload with Deep Attention Network
Shiyi Yang
Peilun Wu
Hui Guo
45
10
0
23 Oct 2020
Measure Transport with Kernel Stein Discrepancy
Measure Transport with Kernel Stein Discrepancy
Matthew A. Fisher
T. Nolan
Matthew M. Graham
D. Prangle
Chris J. Oates
OT
124
15
0
22 Oct 2020
A ReLU Dense Layer to Improve the Performance of Neural Networks
A ReLU Dense Layer to Improve the Performance of Neural Networks
Alireza M. Javid
Sandipan Das
Mikael Skoglund
Saikat Chatterjee
73
32
0
22 Oct 2020
Influence-Augmented Online Planning for Complex Environments
Influence-Augmented Online Planning for Complex Environments
J. He
Miguel Suau
F. Oliehoek
34
6
0
21 Oct 2020
Effects of the Nonlinearity in Activation Functions on the Performance
  of Deep Learning Models
Effects of the Nonlinearity in Activation Functions on the Performance of Deep Learning Models
N. Kulathunga
N. R. Ranasinghe
D. Vrinceanu
Zackary Kinsman
Lei Huang
Yunjiao Wang
18
5
0
14 Oct 2020
Machine Learning Force Fields
Machine Learning Force Fields
Oliver T. Unke
Stefan Chmiela
H. E. Sauceda
M. Gastegger
I. Poltavsky
Kristof T. Schütt
A. Tkatchenko
K. Müller
AI4CE
145
940
0
14 Oct 2020
Just Pick a Sign: Optimizing Deep Multitask Models with Gradient Sign
  Dropout
Just Pick a Sign: Optimizing Deep Multitask Models with Gradient Sign Dropout
Zhao Chen
Jiquan Ngiam
Yanping Huang
Thang Luong
Henrik Kretzschmar
Yuning Chai
Dragomir Anguelov
90
221
0
14 Oct 2020
Experimental Quantum Generative Adversarial Networks for Image
  Generation
Experimental Quantum Generative Adversarial Networks for Image Generation
Heliang Huang
Yuxuan Du
Mingming Gong
You-Wei Zhao
Yulin Wu
...
Chao Lu
Yu-Ao Chen
Dacheng Tao
Xiaobo Zhu
Jian-Wei Pan
GAN
89
183
0
13 Oct 2020
AEGD: Adaptive Gradient Descent with Energy
AEGD: Adaptive Gradient Descent with Energy
Hailiang Liu
Xuping Tian
ODL
62
11
0
10 Oct 2020
Deep Autoencoder based Energy Method for the Bending, Vibration, and
  Buckling Analysis of Kirchhoff Plates
Deep Autoencoder based Energy Method for the Bending, Vibration, and Buckling Analysis of Kirchhoff Plates
X. Zhuang
Hongwei Guo
N. Alajlan
Timon Rabczuk
AI4CE
57
327
0
09 Oct 2020
Previous
123...8910...121314
Next