ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 1609.04747
  4. Cited By
An overview of gradient descent optimization algorithms

An overview of gradient descent optimization algorithms

15 September 2016
Sebastian Ruder
    ODL
ArXivPDFHTML

Papers citing "An overview of gradient descent optimization algorithms"

50 / 1,015 papers shown
Title
Ship Performance Monitoring using Machine-learning
Ship Performance Monitoring using Machine-learning
Prateek Gupta
Adil Rasheed
S. Steen
13
39
0
07 Oct 2021
Accelerated Componentwise Gradient Boosting using Efficient Data
  Representation and Momentum-based Optimization
Accelerated Componentwise Gradient Boosting using Efficient Data Representation and Momentum-based Optimization
Daniel Schalk
B. Bischl
David Rügamer
27
3
0
07 Oct 2021
Improving Adversarial Robustness for Free with Snapshot Ensemble
Improving Adversarial Robustness for Free with Snapshot Ensemble
Yihao Wang
AAML
UQCV
17
1
0
07 Oct 2021
Use of Deterministic Transforms to Design Weight Matrices of a Neural
  Network
Use of Deterministic Transforms to Design Weight Matrices of a Neural Network
Pol Grau Jurado
Xinyue Liang
Alireza M. Javid
S. Chatterjee
26
0
0
06 Oct 2021
Effectiveness of Optimization Algorithms in Deep Image Classification
Effectiveness of Optimization Algorithms in Deep Image Classification
Zhaoyang Zhu
Haozhe Sun
Chi Zhang
ODL
13
1
0
04 Oct 2021
Implementation of Parallel Simplified Swarm Optimization in CUDA
Implementation of Parallel Simplified Swarm Optimization in CUDA
W. Yeh
Zhenyao Liu
Shi-Yi Tan
Shang-Ke Huang
14
0
0
01 Oct 2021
AIive: Interactive Visualization and Sonification of Neural Networks in
  Virtual Reality
AIive: Interactive Visualization and Sonification of Neural Networks in Virtual Reality
Zhuoyue Lyu
Jiannan Li
Bryan Wang
11
16
0
30 Sep 2021
Automated Estimation of Construction Equipment Emission using Inertial
  Sensors and Machine Learning Models
Automated Estimation of Construction Equipment Emission using Inertial Sensors and Machine Learning Models
Farid Shahnavaz
Reza Akhavian
12
13
0
27 Sep 2021
Speeding-up One-vs-All Training for Extreme Classification via Smart
  Initialization
Speeding-up One-vs-All Training for Extreme Classification via Smart Initialization
Erik Schultheis
Rohit Babbar
22
2
0
27 Sep 2021
A survey on deep learning approaches for breast cancer diagnosis
A survey on deep learning approaches for breast cancer diagnosis
Timothy C. H. Kwong
S. Mazaheri
MedIm
30
4
0
18 Sep 2021
Patch-based Medical Image Segmentation using Matrix Product State Tensor
  Networks
Patch-based Medical Image Segmentation using Matrix Product State Tensor Networks
Raghavendra Selvan
Erik Dam
Soren Alexander Flensborg
Jens Petersen
MedIm
35
2
0
15 Sep 2021
FSER: Deep Convolutional Neural Networks for Speech Emotion Recognition
FSER: Deep Convolutional Neural Networks for Speech Emotion Recognition
Bonaventure F. P. Dossou
Yeno K. S. Gbenou
6
7
0
15 Sep 2021
MMCoVaR: Multimodal COVID-19 Vaccine Focused Data Repository for Fake
  News Detection and a Baseline Architecture for Classification
MMCoVaR: Multimodal COVID-19 Vaccine Focused Data Repository for Fake News Detection and a Baseline Architecture for Classification
Mingxuan Chen
Xinqiao Chu
K. P. Subbalakshmi
46
26
0
14 Sep 2021
RobustART: Benchmarking Robustness on Architecture Design and Training
  Techniques
RobustART: Benchmarking Robustness on Architecture Design and Training Techniques
Shiyu Tang
Ruihao Gong
Yan Wang
Aishan Liu
Jiakai Wang
...
Xianglong Liu
D. Song
Alan Yuille
Philip Torr
Dacheng Tao
VLM
AAML
26
107
0
11 Sep 2021
Multi-Tensor Network Representation for High-Order Tensor Completion
Multi-Tensor Network Representation for High-Order Tensor Completion
Chang Nie
Huan Wang
Zhihui Lai
17
2
0
09 Sep 2021
EMA: Auditing Data Removal from Trained Models
EMA: Auditing Data Removal from Trained Models
Yangsibo Huang
Xiaoxiao Li
Kai Li
18
14
0
08 Sep 2021
Backdoor Attack and Defense for Deep Regression
Backdoor Attack and Defense for Deep Regression
Xi Li
G. Kesidis
David J. Miller
V. Lucic
AAML
19
6
0
06 Sep 2021
On Faster Convergence of Scaled Sign Gradient Descent
On Faster Convergence of Scaled Sign Gradient Descent
Xiuxian Li
Kuo-Yi Lin
Li Li
Yiguang Hong
Jie-bin Chen
ODL
6
10
0
04 Sep 2021
Deep Learning on Edge TPUs
Deep Learning on Edge TPUs
A. Kist
Andreas M Kist
38
17
0
31 Aug 2021
A Convolutional Neural Network-based Approach to Field Reconstruction
A Convolutional Neural Network-based Approach to Field Reconstruction
R. Ponciroli
A. Rovinelli
L. Ibarra
8
1
0
27 Aug 2021
When and how epochwise double descent happens
When and how epochwise double descent happens
Cory Stephenson
Tyler Lee
36
15
0
26 Aug 2021
ExamGAN and Twin-ExamGAN for Exam Script Generation
ExamGAN and Twin-ExamGAN for Exam Script Generation
Zhengyang Wu
Kefeng Deng
Judy Qiu
Yong Tang
16
1
0
22 Aug 2021
Understanding Data Storage and Ingestion for Large-Scale Deep
  Recommendation Model Training
Understanding Data Storage and Ingestion for Large-Scale Deep Recommendation Model Training
Mark Zhao
Niket Agarwal
Aarti Basant
B. Gedik
Satadru Pan
...
Kevin Wilfong
Harsha Rastogi
Carole-Jean Wu
Christos Kozyrakis
Parikshit Pol
GNN
34
70
0
20 Aug 2021
SplitGuard: Detecting and Mitigating Training-Hijacking Attacks in Split
  Learning
SplitGuard: Detecting and Mitigating Training-Hijacking Attacks in Split Learning
Ege Erdogan
Alptekin Kupcu
A. E. Cicek
AAML
27
32
0
20 Aug 2021
DeepCVA: Automated Commit-level Vulnerability Assessment with Deep
  Multi-task Learning
DeepCVA: Automated Commit-level Vulnerability Assessment with Deep Multi-task Learning
T. H. Le
David Hin
Roland Croft
Muhammad Ali Babar
30
51
0
18 Aug 2021
Memory-Efficient Factorization Machines via Binarizing both Data and
  Model Coefficients
Memory-Efficient Factorization Machines via Binarizing both Data and Model Coefficients
Yu Geng
Liang Lan
8
0
0
17 Aug 2021
Neuron Campaign for Initialization Guided by Information Bottleneck
  Theory
Neuron Campaign for Initialization Guided by Information Bottleneck Theory
Haitao Mao
Xu Chen
Qiang Fu
Lun Du
Shi Han
Dongmei Zhang
AI4CE
26
10
0
14 Aug 2021
A proof of convergence for the gradient descent optimization method with
  random initializations in the training of neural networks with ReLU
  activation for piecewise linear target functions
A proof of convergence for the gradient descent optimization method with random initializations in the training of neural networks with ReLU activation for piecewise linear target functions
Arnulf Jentzen
Adrian Riekert
38
13
0
10 Aug 2021
RCA-IUnet: A residual cross-spatial attention guided inception U-Net
  model for tumor segmentation in breast ultrasound imaging
RCA-IUnet: A residual cross-spatial attention guided inception U-Net model for tumor segmentation in breast ultrasound imaging
Narinder Singh Punn
Sonali Agarwal
32
59
0
05 Aug 2021
Super Neurons
Super Neurons
S. Kiranyaz
Junaid Malik
Mehmet Yamaç
Mert Duman
Ilke Adalioglu
E. Guldogan
T. Ince
Moncef Gabbouj
SupR
27
7
0
03 Aug 2021
On The State of Data In Computer Vision: Human Annotations Remain
  Indispensable for Developing Deep Learning Models
On The State of Data In Computer Vision: Human Annotations Remain Indispensable for Developing Deep Learning Models
Z. Emam
Andrew Kondrich
Sasha Harrison
Felix Lau
Yushi Wang
Aerin Kim
E. Branson
VLM
38
11
0
31 Jul 2021
Robust and Active Learning for Deep Neural Network Regression
Robust and Active Learning for Deep Neural Network Regression
Xi Li
G. Kesidis
David J. Miller
Maxime Bergeron
Ryan Ferguson
V. Lucic
24
1
0
28 Jul 2021
MAG-Net: Multi-task attention guided network for brain tumor
  segmentation and classification
MAG-Net: Multi-task attention guided network for brain tumor segmentation and classification
S. Gupta
Narinder Singh Punn
S. K. Sonbhadra
Sonali Agarwal
37
8
0
26 Jul 2021
Joint Direction and Proximity Classification of Overlapping Sound Events
  from Binaural Audio
Joint Direction and Proximity Classification of Overlapping Sound Events from Binaural Audio
D. Krause
A. Politis
A. Mesaros
14
7
0
26 Jul 2021
Deep Adaptive Arbitrary Polynomial Chaos Expansion: A Mini-data-driven
  Semi-supervised Method for Uncertainty Quantification
Deep Adaptive Arbitrary Polynomial Chaos Expansion: A Mini-data-driven Semi-supervised Method for Uncertainty Quantification
W. Yao
Xiaohu Zheng
Jun Zhang
Ning Wang
Guijian Tang
20
32
0
22 Jul 2021
A High-Performance Adaptive Quantization Approach for Edge CNN
  Applications
A High-Performance Adaptive Quantization Approach for Edge CNN Applications
Hsu-Hsun Chin
R. Tsay
Hsin-I Wu
MQ
24
5
0
18 Jul 2021
SA-GD: Improved Gradient Descent Learning Strategy with Simulated
  Annealing
SA-GD: Improved Gradient Descent Learning Strategy with Simulated Annealing
Zhicheng Cai
34
4
0
15 Jul 2021
Neighbor-view Enhanced Model for Vision and Language Navigation
Neighbor-view Enhanced Model for Vision and Language Navigation
Dongyan An
Yuankai Qi
Yan Huang
Qi Wu
Liang Wang
Tieniu Tan
LM&Ro
24
67
0
15 Jul 2021
Disparity Between Batches as a Signal for Early Stopping
Disparity Between Batches as a Signal for Early Stopping
Mahsa Forouzesh
Patrick Thiran
41
8
0
14 Jul 2021
Detection of Abnormal Behavior with Self-Supervised Gaze Estimation
Detection of Abnormal Behavior with Self-Supervised Gaze Estimation
Suneung Kim
Seong-Whan Lee
11
2
0
14 Jul 2021
A Convolutional Neural Network Approach to the Classification of
  Engineering Models
A Convolutional Neural Network Approach to the Classification of Engineering Models
Bharadwaj Manda
Pranjal Bhaskare
Ramanathan Muthuganapathy
14
25
0
14 Jul 2021
ML-Quest: A Game for Introducing Machine Learning Concepts to K-12
  Students
ML-Quest: A Game for Introducing Machine Learning Concepts to K-12 Students
S. Priya
Shubhankar Bhadra
S. Chimalakonda
AI4Ed
17
27
0
13 Jul 2021
Transfer Learning in Multi-Agent Reinforcement Learning with Double
  Q-Networks for Distributed Resource Sharing in V2X Communication
Transfer Learning in Multi-Agent Reinforcement Learning with Double Q-Networks for Distributed Resource Sharing in V2X Communication
Hammad Zafar
Zoran Utkovski
Martin Kasparick
S. Stańczak
OffRL
21
3
0
13 Jul 2021
BCNet: A Deep Convolutional Neural Network for Breast Cancer Grading
BCNet: A Deep Convolutional Neural Network for Breast Cancer Grading
Pouya Hallaj Zavareh
Atefeh Safayari
Hamidreza Bolhasani
21
9
0
11 Jul 2021
Activated Gradients for Deep Neural Networks
Activated Gradients for Deep Neural Networks
Mei Liu
Liangming Chen
Xiaohao Du
Long Jin
Mingsheng Shang
ODL
AI4CE
35
135
0
09 Jul 2021
A Multi-modal and Multi-task Learning Method for Action Unit and
  Expression Recognition
A Multi-modal and Multi-task Learning Method for Action Unit and Expression Recognition
Yue Jin
Tianqing Zheng
Chao Gao
Guoqiang Xu
35
38
0
09 Jul 2021
A Leap among Quantum Computing and Quantum Neural Networks: A Survey
A Leap among Quantum Computing and Quantum Neural Networks: A Survey
F. V. Massoli
Lucia Vadicamo
Giuseppe Amato
Fabrizio Falchi
27
32
0
06 Jul 2021
SplitAVG: A heterogeneity-aware federated deep learning method for
  medical imaging
SplitAVG: A heterogeneity-aware federated deep learning method for medical imaging
Miao Zhang
Liangqiong Qu
Praveer Singh
Jayashree Kalpathy-Cramer
D. Rubin
OOD
FedML
29
62
0
06 Jul 2021
A comparison of LSTM and GRU networks for learning symbolic sequences
A comparison of LSTM and GRU networks for learning symbolic sequences
Roberto Cahuantzi
Xinye Chen
S. Güttel
28
136
0
05 Jul 2021
Photozilla: A Large-Scale Photography Dataset and Visual Embedding for
  20 Photography Styles
Photozilla: A Large-Scale Photography Dataset and Visual Embedding for 20 Photography Styles
Trisha Singhal
Junhua Liu
L. Blessing
Kwan Hui Lim
19
3
0
21 Jun 2021
Previous
123...141516...192021
Next