An overview of gradient descent optimization algorithms

15 September 2016

Papers citing "An overview of gradient descent optimization algorithms"

50 / 1,016 papers shown

Title
Eloss in the way: A Sensitive Input Quality Metrics for Intelligent Driving Hao-Ting Yang Shiyan Zhang Zhuo Yang Xinyu Zhang 27 0 0 02 Feb 2023
QLABGrad: a Hyperparameter-Free and Convergence-Guaranteed Scheme for Deep Learning Minghan Fu Fang-Xiang Wu ODL 42 7 0 01 Feb 2023
Adapting Step-size: A Unified Perspective to Analyze and Improve Gradient-based Methods for Adversarial Attacks Wei Tao Lei Bao Long Sheng Gao-wei Wu Qing Tao AAML 27 1 0 27 Jan 2023
Multi-limb Split Learning for Tumor Classification on Vertically Distributed Data Omar S. Ads Mayar M. Alfares Mohammed Abdel-Megeed Salem 37 10 0 27 Jan 2023
Construction of Uniform Designs over Continuous Domain in Computer Experiments Jianfa Lai K. Fang Xiao-Ling Peng Yuxuan Lin 19 3 0 25 Jan 2023
Towards Rigorous Understanding of Neural Networks via Semantics-preserving Transformations Maximilian Schlüter Gerrit Nolte Alnis Murtovi Bernhard Steffen 34 6 0 19 Jan 2023
SlideVQA: A Dataset for Document Visual Question Answering on Multiple Images Ryota Tanaka Kyosuke Nishida Kosuke Nishida Taku Hasegawa Itsumi Saito Kuniko Saito 25 74 0 12 Jan 2023
Generative-Contrastive Learning for Self-Supervised Latent Representations of 3D Shapes from Multi-Modal Euclidean Input Chengzhi Wu Julius Pfrommer Mingyuan Zhou Jürgen Beyerer SSL 33 5 0 11 Jan 2023
AdaPoinTr: Diverse Point Cloud Completion with Adaptive Geometry-Aware Transformers Xumin Yu Yongming Rao Ziyi Wang Jiwen Lu Jie Zhou ViT 34 57 0 11 Jan 2023
Balance is Essence: Accelerating Sparse Training via Adaptive Gradient Correction Bowen Lei Dongkuan Xu Ruqi Zhang Shuren He Bani Mallick 47 6 0 09 Jan 2023
Fair Multi-Exit Framework for Facial Attribute Classification Ching-Hao Chiu Hao-Wei Chung Yu-Jen Chen Yiyu Shi Tsung-Yi Ho CVBM 16 4 0 08 Jan 2023
Informed Down-Sampled Lexicase Selection: Identifying productive training cases for efficient problem solving Ryan Boldi Martin Briesch Dominik Sobania Alexander Lalejini Thomas Helmuth Franz Rothlauf Charles Ofria Lee Spector 55 22 0 04 Jan 2023
Class-Continuous Conditional Generative Neural Radiance Field Jiwook Kim Minhyeok Lee 35 4 0 03 Jan 2023
DRG-Net: Interactive Joint Learning of Multi-lesion Segmentation and Classification for Diabetic Retinopathy Grading Hasan Md Tusfiqur D. M. Nguyen M. T. N. Truong T. A. Nguyen Binh Duc Nguyen ... H. Profitlich Ngoc T. T. Than Ngan Le P. Xie Daniel Sonntag MedIm 32 8 0 30 Dec 2022
A Dynamics Theory of Implicit Regularization in Deep Low-Rank Matrix Factorization JIAN-PENG Cao Chao Qian Yihui Huang Dicheng Chen Yuncheng Gao Jiyang Dong D. Guo X. Qu 29 1 0 29 Dec 2022
OrthoGAN:High-Precision Image Generation for Teeth Orthodontic Visualization Feihong Shen Jingjing Liu Hai-Zhen Li B. Fang Chenglong Ma Jinxiang Hao Yang Feng Youyi Zheng Youyi Zheng MedIm DiffM 57 0 0 29 Dec 2022
VoronoiPatches: Evaluating A New Data Augmentation Method Steffen Illium Gretchen Griffin Michael Kolle Maximilian Zorn Jonas Nusslein Claudia Linnhoff-Popien 33 0 0 20 Dec 2022
Input Normalized Stochastic Gradient Descent Training of Deep Neural Networks S. Atici Hongyi Pan Ahmet Enis Cetin ODL 18 0 0 20 Dec 2022
Analysis and application of multispectral data for water segmentation using machine learning Shubham Gupta D. Uma R. Hebbar 26 0 0 16 Dec 2022
Plastic Contaminant Detection in Aerial Imagery of Cotton Fields with Deep Learning Pappu K. Yadav J. Thomasson Robert G Hardin S. Searcy U. Braga-Neto ... R. Rodriguez Daniel E. Martin J. Enciso K. Meza Emma L. White 28 0 0 14 Dec 2022
On Mini-Batch Training with Varying Length Time Series Brian Kenji Iwana AI4TS 21 3 0 13 Dec 2022
HOTCOLD Block: Fooling Thermal Infrared Detectors with a Novel Wearable Design Hui Wei Zhixiang Wang Xuemei Jia Yinqiang Zheng Haoling Tang Shiníchi Satoh Zheng Wang AAML 13 39 0 12 Dec 2022
AP: Selective Activation for De-sparsifying Pruned Neural Networks Shiyu Liu Rohan Ghosh Dylan Tan Mehul Motani AAML 28 0 0 09 Dec 2022
Optimizing Learning Rate Schedules for Iterative Pruning of Deep Neural Networks Shiyu Liu Rohan Ghosh John Tan Chong Min Mehul Motani 47 0 0 09 Dec 2022
A perspective on physical reservoir computing with nanomagnetic devices D. Allwood Matthew O. A. Ellis David Griffin T. Hayward Luca Manneschi ... Martin A. Trefzer Eleni Vasilaki G. Venkat Ian T. Vidamour Chester Wringe 22 40 0 09 Dec 2022
Short term prediction of demand for ride hailing services: A deep learning approach Long Chen Piyushimita P. Thakuriah K. Ampountolas AI4TS 30 21 0 07 Dec 2022
Generalized Gradient Flows with Provable Fixed-Time Convergence and Fast Evasion of Non-Degenerate Saddle Points Mayank Baranwal Param Budhraja V. Raj A. Hota 33 2 0 07 Dec 2022
A Temporal Graph Neural Network for Cyber Attack Detection and Localization in Smart Grids Seyed Hamed Haghshenas A. Hasnat M. Naeini 26 28 0 07 Dec 2022
Leveraging Angular Information Between Feature and Classifier for Long-tailed Learning: A Prediction Reformulation Approach Haoxu Wang Junchi Yan 26 1 0 03 Dec 2022
Brain Tumor MRI Classification using a Novel Deep Residual and Regional CNN Mirza Mumtaz Zahoor Dr. Saddam Hussain Khan 21 28 0 29 Nov 2022
A Particle-based Sparse Gaussian Process Optimizer Minh Nguyen Omatharv Bharat Vaidya Yi Wang 18 0 0 26 Nov 2022
Deep Learning Training Procedure Augmentations Cristian Simionescu 11 1 0 25 Nov 2022
A comparative study of source-finding techniques in HI emission line cubes using SoFiA, MTObjects, and supervised deep learning J. Barkai M. Verheijen Estefania Talavera Martinez M. Wilkinson 23 0 0 23 Nov 2022
Privacy in Practice: Private COVID-19 Detection in X-Ray Images (Extended Version) Lucas Lange Maja Schneider Peter Christen Erhard Rahm 29 7 0 21 Nov 2022
DualApp: Tight Over-Approximation for Neural Network Robustness Verification via Under-Approximation Yiting Wu Zhaodi Zhang Zhiyi Xue Si Liu Hao Fei AAML 34 0 0 21 Nov 2022
Open-Set Automatic Target Recognition Bardia Safaei VS Vibashan Celso M. de Melo Shuowen Hu Vishal M. Patel 46 8 0 10 Nov 2022
FedLesScan: Mitigating Stragglers in Serverless Federated Learning M. Elzohairy Mohak Chadha Anshul Jindal Andreas Grafberger Jiatao Gu Michael Gerndt Osama Abboud FedML 31 7 0 10 Nov 2022
A Solution for a Fundamental Problem of 3D Inference based on 2D Representations T. N. Nguyen 11 0 0 09 Nov 2022
Differentiable Quantum Programming with Unbounded Loops Wang Fang Mingsheng Ying Xiaodi Wu 24 1 0 08 Nov 2022
A Deep Double Ritz Method (D $^2$ RM) for solving Partial Differential Equations using Neural Networks C. Uriarte David Pardo I. Muga J. Muñoz‐Matute 49 18 0 07 Nov 2022
Optical Channel Impulse Response-Based Localization Using An Artificial Neural Network Hamid Hosseinianfar H. Rabbani M. Brandt-Pearce 20 0 0 02 Nov 2022
Differentiable Model Selection for Ensemble Learning James Kotary Vincenzo Di Vito Ferdinando Fioretto 107 9 0 01 Nov 2022
The role of prior information and computational power in Machine Learning Diego Marcondes Adilson Simonis Junior Barrera 11 2 0 31 Oct 2022
Mitigating Unfairness via Evolutionary Multi-objective Ensemble Learning Qingquan Zhang Jialin Liu Zeqi Zhang J. Wen Bifei Mao Xin Yao FaML 48 17 0 30 Oct 2022
Hierarchical Federated Learning with Momentum Acceleration in Multi-Tier Networks Zhengjie Yang Sen Fu Wei Bao Dong Yuan Albert Y. Zomaya FedML 49 6 0 26 Oct 2022
A Continuous Convolutional Trainable Filter for Modelling Unstructured Data Dario Coscia L. Meneghetti N. Demo G. Stabile G. Rozza 29 8 0 24 Oct 2022
Federated Learning and Meta Learning: Approaches, Applications, and Directions Xiaonan Liu Yansha Deng Arumugam Nallanathan M. Bennis 74 32 0 24 Oct 2022
SurCo: Learning Linear Surrogates For Combinatorial Nonlinear Optimization Problems Aaron Ferber Taoan Huang Daochen Zha M. Schubert Benoit Steiner B. Dilkina Yuandong Tian 41 20 0 22 Oct 2022
Differentiable Self-Adaptive Learning Rate Bozhou Chen Hongzhi Wang Chenmin Ba ODL 30 4 0 19 Oct 2022
Layer-wise Relevance Propagation for Echo State Networks applied to Earth System Variability Marco Landt-Hayen Peer Kröger Martin Claus W. Rath 6 3 0 18 Oct 2022