v1v2 (latest)

An overview of gradient descent optimization algorithms

15 September 2016

Papers citing "An overview of gradient descent optimization algorithms"

50 / 697 papers shown

Title
Construction of Uniform Designs over Continuous Domain in Computer Experiments Jianfa Lai K. Fang Xiao-Ling Peng Yuxuan Lin 38 3 0 25 Jan 2023
Towards Rigorous Understanding of Neural Networks via Semantics-preserving Transformations Maximilian Schlüter Gerrit Nolte Alnis Murtovi Bernhard Steffen 75 6 0 19 Jan 2023
SlideVQA: A Dataset for Document Visual Question Answering on Multiple Images Ryota Tanaka Kyosuke Nishida Kosuke Nishida Taku Hasegawa Itsumi Saito Kuniko Saito 66 85 0 12 Jan 2023
Balance is Essence: Accelerating Sparse Training via Adaptive Gradient Correction Bowen Lei Dongkuan Xu Ruqi Zhang Shuren He Bani Mallick 119 6 0 09 Jan 2023
Fair Multi-Exit Framework for Facial Attribute Classification Ching-Hao Chiu Hao-Wei Chung Yu-Jen Chen Yiyu Shi Tsung-Yi Ho CVBM 70 4 0 08 Jan 2023
Informed Down-Sampled Lexicase Selection: Identifying productive training cases for efficient problem solving Ryan Boldi Martin Briesch Dominik Sobania Alexander Lalejini Thomas Helmuth Franz Rothlauf Charles Ofria Lee Spector 114 23 0 04 Jan 2023
Class-Continuous Conditional Generative Neural Radiance Field Jiwook Kim Minhyeok Lee 101 4 0 03 Jan 2023
DRG-Net: Interactive Joint Learning of Multi-lesion Segmentation and Classification for Diabetic Retinopathy Grading Hasan Md Tusfiqur D. M. Nguyen M. T. N. Truong T. A. Nguyen Binh Duc Nguyen ... H. Profitlich Ngoc T. T. Than Ngan Le P. Xie Daniel Sonntag MedIm 83 8 0 30 Dec 2022
A Dynamics Theory of Implicit Regularization in Deep Low-Rank Matrix Factorization JIAN-PENG Cao Chao Qian Yihui Huang Dicheng Chen Yuncheng Gao Jiyang Dong D. Guo X. Qu 139 1 0 29 Dec 2022
OrthoGAN:High-Precision Image Generation for Teeth Orthodontic Visualization Feihong Shen Jingjing Liu Hai-Zhen Li B. Fang Chenglong Ma Jinxiang Hao Yang Feng Youyi Zheng Youyi Zheng MedIm DiffM 219 1 0 29 Dec 2022
VoronoiPatches: Evaluating A New Data Augmentation Method Steffen Illium Gretchen Griffin Michael Kolle Maximilian Zorn Jonas Nusslein Claudia Linnhoff-Popien 61 0 0 20 Dec 2022
Analysis and application of multispectral data for water segmentation using machine learning Shubham Gupta D. Uma R. Hebbar 97 0 0 16 Dec 2022
Plastic Contaminant Detection in Aerial Imagery of Cotton Fields with Deep Learning Pappu K. Yadav J. Thomasson Robert G Hardin S. Searcy U. Braga-Neto ... R. Rodriguez Daniel E. Martin J. Enciso K. Meza Emma L. White 90 0 0 14 Dec 2022
On Mini-Batch Training with Varying Length Time Series Brian Kenji Iwana AI4TS 48 3 0 13 Dec 2022
HOTCOLD Block: Fooling Thermal Infrared Detectors with a Novel Wearable Design Hui Wei Zhixiang Wang Xuemei Jia Yinqiang Zheng Haoling Tang Shiníchi Satoh Zheng Wang AAML 83 40 0 12 Dec 2022
AP: Selective Activation for De-sparsifying Pruned Neural Networks Shiyu Liu Rohan Ghosh Dylan Tan Mehul Motani AAML 61 0 0 09 Dec 2022
Optimizing Learning Rate Schedules for Iterative Pruning of Deep Neural Networks Shiyu Liu Rohan Ghosh John Tan Chong Min Mehul Motani 79 0 0 09 Dec 2022
A perspective on physical reservoir computing with nanomagnetic devices D. Allwood Matthew O. A. Ellis David Griffin T. Hayward Luca Manneschi ... Martin A. Trefzer Eleni Vasilaki G. Venkat Ian T. Vidamour Chester Wringe 44 43 0 09 Dec 2022
Short term prediction of demand for ride hailing services: A deep learning approach Long Chen Piyushimita P. Thakuriah K. Ampountolas AI4TS 59 22 0 07 Dec 2022
Generalized Gradient Flows with Provable Fixed-Time Convergence and Fast Evasion of Non-Degenerate Saddle Points Mayank Baranwal Param Budhraja V. Raj A. Hota 69 3 0 07 Dec 2022
A Temporal Graph Neural Network for Cyber Attack Detection and Localization in Smart Grids Seyed Hamed Haghshenas A. Hasnat M. Naeini 67 28 0 07 Dec 2022
Leveraging Angular Information Between Feature and Classifier for Long-tailed Learning: A Prediction Reformulation Approach Haoxu Wang Junchi Yan 65 1 0 03 Dec 2022
Brain Tumor MRI Classification using a Novel Deep Residual and Regional CNN Mirza Mumtaz Zahoor Dr. Saddam Hussain Khan 67 31 0 29 Nov 2022
A Particle-based Sparse Gaussian Process Optimizer Minh Nguyen Omatharv Bharat Vaidya Yi Wang 43 0 0 26 Nov 2022
Deep Learning Training Procedure Augmentations Cristian Simionescu 107 1 0 25 Nov 2022
Privacy in Practice: Private COVID-19 Detection in X-Ray Images (Extended Version) Lucas Lange Maja Schneider Peter Christen Erhard Rahm 93 7 0 21 Nov 2022
Open-Set Automatic Target Recognition Bardia Safaei VS Vibashan Celso M. de Melo Shuowen Hu Vishal M. Patel 73 10 0 10 Nov 2022
Differentiable Quantum Programming with Unbounded Loops Wang Fang Mingsheng Ying Xiaodi Wu 38 1 0 08 Nov 2022
A Deep Double Ritz Method (D $^2$ RM) for solving Partial Differential Equations using Neural Networks C. Uriarte David Pardo I. Muga J. Muñoz‐Matute 103 18 0 07 Nov 2022
Optical Channel Impulse Response-Based Localization Using An Artificial Neural Network Hamid Hosseinianfar H. Rabbani M. Brandt-Pearce 31 0 0 02 Nov 2022
Differentiable Model Selection for Ensemble Learning James Kotary Vincenzo Di Vito Ferdinando Fioretto 203 9 0 01 Nov 2022
Mitigating Unfairness via Evolutionary Multi-objective Ensemble Learning Qingquan Zhang Jialin Liu Zeqi Zhang J. Wen Bifei Mao Xin Yao FaML 79 19 0 30 Oct 2022
Hierarchical Federated Learning with Momentum Acceleration in Multi-Tier Networks Zhengjie Yang Sen Fu Wei Bao Dong Yuan Albert Y. Zomaya FedML 99 7 0 26 Oct 2022
A Continuous Convolutional Trainable Filter for Modelling Unstructured Data Dario Coscia L. Meneghetti N. Demo G. Stabile G. Rozza 84 8 0 24 Oct 2022
SurCo: Learning Linear Surrogates For Combinatorial Nonlinear Optimization Problems Aaron Ferber Taoan Huang Daochen Zha M. Schubert Benoit Steiner B. Dilkina Yuandong Tian 102 22 0 22 Oct 2022
Differentiable Self-Adaptive Learning Rate Bozhou Chen Hongzhi Wang Chenmin Ba ODL 33 4 0 19 Oct 2022
Layer-wise Relevance Propagation for Echo State Networks applied to Earth System Variability Marco Landt-Hayen Peer Kröger Martin Claus W. Rath 38 4 0 18 Oct 2022
DPIS: An Enhanced Mechanism for Differentially Private SGD with Importance Sampling Jianxin Wei Ergute Bao X. Xiao Yifan Yang 90 21 0 18 Oct 2022
BLOX: Macro Neural Architecture Search Benchmark and Algorithms Thomas C. P. Chau Łukasz Dudziak Hongkai Wen Nicholas D. Lane Mohamed S. Abdelfattah 72 13 0 13 Oct 2022
How to Sift Out a Clean Data Subset in the Presence of Data Poisoning? Yi Zeng Minzhou Pan Himanshu Jahagirdar Ming Jin Lingjuan Lyu R. Jia AAML 85 21 0 12 Oct 2022
AdaNorm: Adaptive Gradient Norm Correction based Optimizer for CNNs S. Dubey S. Singh B. B. Chaudhuri ODL 60 8 0 12 Oct 2022
Scaling up Stochastic Gradient Descent for Non-convex Optimisation S. Mohamad H. Alamri A. Bouchachia 85 3 0 06 Oct 2022
FedMT: Federated Learning with Mixed-type Labels Qiong Zhang Jing Peng Xin Zhang A. Talhouk Gang Niu Xiaoxiao Li FedML 135 0 0 05 Oct 2022
On Physics-Informed Neural Networks for Quantum Computers Stefano Markidis PINN 90 19 0 28 Sep 2022
Untargeted Backdoor Watermark: Towards Harmless and Stealthy Dataset Copyright Protection Yiming Li Yang Bai Yong Jiang Yong-Liang Yang Shutao Xia Bo Li AAML 142 110 0 27 Sep 2022
Investigating and Mitigating Failure Modes in Physics-informed Neural Networks (PINNs) S. Basir PINN AI4CE 114 24 0 20 Sep 2022
A study on the deviations in performance of FNNs and CNNs in the realm of grayscale adversarial images Durga Shree Nagabushanam Steve Mathew C. L. Chowdhary AAML 117 1 0 17 Sep 2022
One-Shot Doc Snippet Detection: Powering Search in Document Beyond Text Abhinav Java Shripad Deshmukh Milan Aggarwal Surgan Jandial Mausoom Sarkar Balaji Krishnamurthy 56 3 0 12 Sep 2022
Modelling of physical systems with a Hopf bifurcation using mechanistic models and machine learning K. H. Lee David A.W. Barton L. Renson 76 12 0 07 Sep 2022
Parallel and Streaming Wavelet Neural Networks for Classification and Regression under Apache Spark E Venkatesh Yelleti Vivek V. Ravi Shiva Shankar Orsu 63 6 0 07 Sep 2022