An overview of gradient descent optimization algorithms

15 September 2016

Papers citing "An overview of gradient descent optimization algorithms"

50 / 1,016 papers shown

Title
Grad-PU: Arbitrary-Scale Point Cloud Upsampling via Gradient Descent with Learned Distance Functions Yun He Danhang Tang Yinda Zhang Xiangyang Xue Yanwei Fu 3DPC 36 49 0 24 Apr 2023
Universal Adversarial Backdoor Attacks to Fool Vertical Federated Learning in Cloud-Edge Collaboration Peng Chen Xin Du Zhihui Lu Hongfeng Chai FedML AAML 39 10 0 22 Apr 2023
Benchmarking Low-Shot Robustness to Natural Distribution Shifts Aaditya K. Singh Kartik Sarangmath Prithvijit Chattopadhyay Judy Hoffman OOD 56 1 0 21 Apr 2023
Hybrid quantum physics-informed neural networks for simulating computational fluid dynamics in complex shapes Alexander Sedykh Maninadh Podapaka Asel Sagingalieva Karan Pinto M. Pflitsch A. Melnikov AI4CE 38 30 0 21 Apr 2023
Angle based dynamic learning rate for gradient descent Neel Mishra Kiran Ravish ODL 42 1 0 20 Apr 2023
Gradient-Free Textual Inversion Zhengcong Fei Mingyuan Fan Junshi Huang DiffM 38 31 0 12 Apr 2023
Fracture Detection in Pediatric Wrist Trauma X-ray Images Using YOLOv8 Algorithm Rui Ju Weiming Cai 37 119 0 11 Apr 2023
Hierarchical Disentanglement-Alignment Network for Robust SAR Vehicle Recognition Wei-Jang Li Wei Yang Wenpeng Zhang Tianpeng Liu Yongxiang Liu Yong-Jin Liu 40 18 0 07 Apr 2023
Can we learn better with hard samples? Subin Sahayam John Zakkam Umarani Jayaraman 19 2 0 07 Apr 2023
Spectral Gap Regularization of Neural Networks Edric Tam David B. Dunson FedML 30 0 0 06 Apr 2023
Unconstrained Parametrization of Dissipative and Contracting Neural Ordinary Differential Equations D. Martinelli C. Galimberti I. Manchester Luca Furieri Giancarlo Ferrari-Trecate 25 11 0 06 Apr 2023
High Accuracy Uncertainty-Aware Interatomic Force Modeling with Equivariant Bayesian Neural Networks Tim Rensmeyer Benjamin Craig D. Kramer Oliver Niggemann BDL 51 3 0 05 Apr 2023
Bayesian neural networks via MCMC: a Python-based tutorial Rohitash Chandra Royce Chen Joshua Simmons BDL 36 10 0 02 Apr 2023
A two-head loss function for deep Average-K classification Camille Garcin Maximilien Servajean Alexis Joly Joseph Salmon 22 0 0 31 Mar 2023
Anatomically aware dual-hop learning for pulmonary embolism detection in CT pulmonary angiograms Florin Condrea S. Rapaka Lucian Itu Puneet Sharma J. Sperl Mohamed Ali Marius Leordeanu 37 5 0 30 Mar 2023
Fast inference of latent space dynamics in huge relational event networks I. Artico Ernst C. Wit BDL 26 1 0 29 Mar 2023
Random Weights Networks Work as Loss Prior Constraint for Image Restoration Man Zhou Naishan Zheng Jie Huang Xiangyu Rui Chunle Guo Deyu Meng Chongyi Li Liang Feng 35 0 0 29 Mar 2023
Searching for long faint astronomical high energy transients: a data driven approach Riccardo Crupi G. Dilillo Kester Ward E. Bissaldi F. Fiore A. Vacchi 16 6 0 28 Mar 2023
Architecturing Binarized Neural Networks for Traffic Sign Recognition Andreea Postovan Madalina Erascu 33 4 0 27 Mar 2023
MuxFlow: Efficient and Safe GPU Sharing in Large-Scale Production Deep Learning Clusters Yihao Zhao Xin Liu Shufan Liu Xiang Li Yibo Zhu Gang Huang Xuanzhe Liu Xin Jin 40 11 0 24 Mar 2023
DARE-GRAM : Unsupervised Domain Adaptation Regression by Aligning Inverse Gram Matrices Ismail Nejjar Qin Wang Olga Fink 54 31 0 23 Mar 2023
Reimagining Application User Interface (UI) Design using Deep Learning Methods: Challenges and Opportunities Subtain Malik M. T. Saeed Marya Jabeen Zia S. Rasool Liaquat A. Khan Mian Ilyas Ahmed AI4TS AI4CE 17 2 0 23 Mar 2023
Low Rank Optimization for Efficient Deep Learning: Making A Balance between Compact Architecture and Fast Training Xinwei Ou Zhangxin Chen Ce Zhu Yipeng Liu 38 4 0 22 Mar 2023
CLIP goes 3D: Leveraging Prompt Tuning for Language Grounded 3D Recognition Deepti Hegde Jeya Maria Jose Valanarasu Vishal M. Patel CLIP 47 65 0 20 Mar 2023
Collision Cross-entropy for Soft Class Labels and Deep Clustering Z. Zhang Yuri Boykov 23 0 0 13 Mar 2023
SSGD: A smartphone screen glass dataset for defect detection Haonan Han Rui Yang Shuyan Li R. Hu Xiu Li 27 10 0 12 Mar 2023
Scavenger: A Cloud Service for Optimizing Cost and Performance of ML Training S. Tyagi Prateek Sharma 31 5 0 12 Mar 2023
Cloudless-Training: A Framework to Improve Efficiency of Geo-Distributed ML Training W. Tan Xiao Shi Cunchi Lv Xiaofang Zhao FedML 33 1 0 09 Mar 2023
InfoBatch: Lossless Training Speed Up by Unbiased Dynamic Data Pruning Ziheng Qin Kaidi Wang Zangwei Zheng Jianyang Gu Xiang Peng ... Daquan Zhou Lei Shang Baigui Sun Xuansong Xie Yang You 127 47 0 08 Mar 2023
An Analysis of Physics-Informed Neural Networks E. Small PINN 13 1 0 06 Mar 2023
NSGA-PINN: A Multi-Objective Optimization Method for Physics-Informed Neural Network Training B.-L. Lu Christian Moya Guang Lin PINN 37 11 0 03 Mar 2023
Spacetime-Efficient Low-Depth Quantum State Preparation with Applications Kaiwen Gui A. Dalzell Alessandro Achille Martin Suchara Frederic T. Chong 35 17 0 03 Mar 2023
Error mitigation of entangled states using brainbox quantum autoencoders Joséphine Pazem M. Ansari 38 3 0 02 Mar 2023
AdaSAM: Boosting Sharpness-Aware Minimization with Adaptive Learning Rate and Momentum for Training Deep Neural Networks Hao Sun Li Shen Qihuang Zhong Liang Ding Shi-Yong Chen Jingwei Sun Jing Li Guangzhong Sun Dacheng Tao 51 31 0 01 Mar 2023
M-L2O: Towards Generalizable Learning-to-Optimize by Test-Time Fast Self-Adaptation Junjie Yang Xuxi Chen Tianlong Chen Zhangyang Wang Yitao Liang 23 2 0 28 Feb 2023
Learning Large Neighborhood Search for Vehicle Routing in Airport Ground Handling Jianan Zhou Yaoxin Wu Zhiguang Cao Wen Song Jie Zhang Zhenghua Chen AI4TS 20 21 0 27 Feb 2023
Optimizing Quantum Federated Learning Based on Federated Quantum Natural Gradient Descent Jun Qi Xiaolin Zhang Javier Tejedor FedML 25 8 0 27 Feb 2023
SATBA: An Invisible Backdoor Attack Based On Spatial Attention Huasong Zhou Xiaowei Xu Zhenyu Wang Leon Bevan Bullock AAML 30 1 0 25 Feb 2023
Edge-Based Detection and Localization of Adversarial Oscillatory Load Attacks Orchestrated By Compromised EV Charging Stations Khaled Sarieddine M. Sayed Sadegh Torabi Ribal Atallah C. Assi 21 13 0 24 Feb 2023
Unified Convergence Theory of Stochastic and Variance-Reduced Cubic Newton Methods El Mahdi Chayti N. Doikov Martin Jaggi ODL 29 6 0 23 Feb 2023
Neural networks for learning personality traits from natural language Giorgia Adorni GNN 22 0 0 23 Feb 2023
PIFON-EPT: MR-Based Electrical Property Tomography Using Physics-Informed Fourier Networks Xinling Yu José E. C. Serrallés Ilias I. Giannakopoulos Zhengwu Liu Luca Daniel R. Lattanzi Zheng-Wei Zhang 27 10 0 23 Feb 2023
Learning to Generalize Provably in Learning to Optimize Junjie Yang Tianlong Chen Mingkang Zhu Fengxiang He Dacheng Tao Yitao Liang Zhangyang Wang 37 6 0 22 Feb 2023
Dual Policy Learning for Aggregation Optimization in Graph Neural Network-based Recommender Systems Heesoo Jung Sangpil Kim Hogun Park 35 5 0 21 Feb 2023
Generalization capabilities of conditional GAN for turbulent flow under changes of geometry Claudia Drygala F. Mare Hanno Gottschalk AI4CE 35 5 0 20 Feb 2023
Evolving Deep Neural Network by Customized Moth Flame Optimization Algorithm for Underwater Targets Recognition M. Khishe M. Mohammadi Tarik Ahmed Rashid Hoger Mahmud Seyedali Mirjalili 18 4 0 16 Feb 2023
Defect Transfer GAN: Diverse Defect Synthesis for Data Augmentation Ruyu Wang Sabrina Hoppe Eduardo Monari Marco F. Huber 30 17 0 16 Feb 2023
Verifying Generalization in Deep Learning Guy Amir Osher Maayan Tom Zelazny Guy Katz Michael Schapira AAML AI4CE 28 14 0 11 Feb 2023
Text recognition on images using pre-trained CNN Afgani Fajar Rizky N. Yudistira Edy Santoso VLM 37 4 0 10 Feb 2023
PINN Training using Biobjective Optimization: The Trade-off between Data Loss and Residual Loss Fabian Heldmann Sarah Treibert Matthias Ehrhardt K. Klamroth 40 20 0 03 Feb 2023