An overview of gradient descent optimization algorithms

15 September 2016

Papers citing "An overview of gradient descent optimization algorithms"

50 / 1,007 papers shown

Title
Free Lunch for Federated Remote Sensing Target Fine-Grained Classification: A Parameter-Efficient Framework Shengchao Chen Ting Shu Huani Zhao Jiahao Wang Sufen Ren Lina Yang 44 5 0 03 Jan 2024
Learning solutions to some toy constrained optimization problems in infinite dimensional Hilbert spaces Pinak Mandal 8 0 0 02 Jan 2024
Reinforcement Learning for SAR View Angle Inversion with Differentiable SAR Renderer Yanni Wang He Jia Shilei Fu Huiping Lin Feng Xu 16 1 0 02 Jan 2024
Fast gradient-free activation maximization for neurons in spiking neural networks N. Pospelov Andrei Chertkov Maxim Beketov Ivan Oseledets Konstantin Anokhin 32 2 0 28 Dec 2023
MIM4DD: Mutual Information Maximization for Dataset Distillation Yuzhang Shang Zhihang Yuan Yan Yan DD 43 14 0 27 Dec 2023
Mean-field underdamped Langevin dynamics and its spacetime discretization Qiang Fu Ashia Wilson 42 4 0 26 Dec 2023
Robust Neural Pruning with Gradient Sampling Optimization for Residual Neural Networks Juyoung Yun 24 1 0 26 Dec 2023
Entropic Open-set Active Learning Bardia Safaei VS Vibashan C. D. Melo Vishal M. Patel UQCV EDL 38 17 0 21 Dec 2023
Parallel Trust-Region Approaches in Neural Network Training: Beyond Traditional Methods Ken Trotti Samuel A. Cruz Alegría Alena Kopanicáková Rolf Krause 26 0 0 21 Dec 2023
Enabling Mammography with Co-Robotic Ultrasound Yuxin Chen Yifan Yin Julian Brown Kevin Wang Yi Wang Ziyi Wang Russell H. Taylor Yixuan Wu Emad M. Boctor 10 0 0 16 Dec 2023
ELSA: Partial Weight Freezing for Overhead-Free Sparse Network Deployment Paniz Halvachi Alexandra Peste Dan Alistarh Christoph H. Lampert 30 0 0 11 Dec 2023
HeadGaS: Real-Time Animatable Head Avatars via 3D Gaussian Splatting Helisa Dhamo Yinyu Nie Arthur Moreau Jifei Song Richard Shaw Yiren Zhou Eduardo Pérez-Pellitero 3DGS 42 23 0 05 Dec 2023
Rethinking Adversarial Training with Neural Tangent Kernel Guanlin Li Han Qiu Shangwei Guo Jiwei Li Tianwei Zhang AAML 26 0 0 04 Dec 2023
Continuous 16-bit Training: Accelerating 32-bit Pre-Trained Neural Networks Juyoung Yun 14 0 0 30 Nov 2023
Convergence Analysis of Fractional Gradient Descent Ashwani Aggarwal 19 1 0 30 Nov 2023
LiveTune: Dynamic Parameter Tuning for Feedback-Driven Optimization Soheil Zibakhsh Shabgahi Nojan Sheybani Aiden Tabrizi F. Koushanfar 18 0 0 28 Nov 2023
Adaptive Step Sizes for Preconditioned Stochastic Gradient Descent Frederik Köhne Leonie Kreis Anton Schiela Roland A. Herzog 24 1 0 28 Nov 2023
Physics-Informed Neural Network for Discovering Systems with Unmeasurable States with Application to Lithium-Ion Batteries Yuichi Kajiura Jorge Espin Dong Zhang PINN 23 0 0 27 Nov 2023
Adinkra Symbol Recognition using Classical Machine Learning and Deep Learning Michael Adjeisah K. Asamoah Martha Asamoah Yeboah Raji Rafiu King Godwin Ferguson Achaab Kingsley Adjei 34 0 0 27 Nov 2023
Quantum Langevin Dynamics for Optimization Zherui Chen Yuchen Lu Hao Wang Yizhou Liu Tongyang Li AI4CE 21 10 0 27 Nov 2023
CRISP: Hybrid Structured Sparsity for Class-aware Model Pruning Shivam Aggarwal Kuluhan Binici Tulika Mitra VLM 14 2 0 24 Nov 2023
AdapterFL: Adaptive Heterogeneous Federated Learning for Resource-constrained Mobile Computing Systems Ruixuan Liu Ming Hu Zeke Xia Jun Xia Peng Zhang Yihao Huang Yang Liu Mingsong Chen FedML 35 6 0 23 Nov 2023
MultiLoRA: Democratizing LoRA for Better Multi-Task Learning Yiming Wang Yu Lin Xiaodong Zeng Guannan Zhang MoMe 47 20 0 20 Nov 2023
Graph Neural Networks for Pressure Estimation in Water Distribution Systems Huy Truong Andres Tello Alexander Lazovik Victoria Degeler 45 8 0 17 Nov 2023
Nonparametric Teaching for Multiple Learners Chen Zhang Xiaofeng Cao Weiyang Liu Ivor Tsang James T. Kwok 31 4 0 17 Nov 2023
A Novel Neural Network-Based Federated Learning System for Imbalanced and Non-IID Data Mahfuzur Rahman Chowdhury Muhammad Ibrahim FedML 24 0 0 16 Nov 2023
pFedES: Model Heterogeneous Personalized Federated Learning with Feature Extractor Sharing Liping Yi Han Yu Gang Wang Xiaoguang Liu 46 7 0 12 Nov 2023
Beyond Size: How Gradients Shape Pruning Decisions in Large Language Models Rocktim Jyoti Das Mingjie Sun Liqun Ma Zhiqiang Shen VLM 20 13 0 08 Nov 2023
Filtered Partial Differential Equations: a robust surrogate constraint in physics-informed deep learning framework Dashan Zhang Yuntian Chen Shiyi Chen AI4CE 32 2 0 07 Nov 2023
Image Generation and Learning Strategy for Deep Document Forgery Detection Yamato Okamoto Osada Genki Iu Yahiro Rintaro Hasegawa Peifei Zhu Hirokatsu Kataoka AAML 36 0 0 07 Nov 2023
Signal Processing Meets SGD: From Momentum to Filter Zhipeng Yao Guisong Chang Jiaqi Zhang Qi Zhang Dazhou Li Yu Zhang ODL 39 0 0 06 Nov 2023
High Probability Convergence of Adam Under Unbounded Gradients and Affine Variance Noise Yusu Hong Junhong Lin 30 8 0 03 Nov 2023
Nonnegative/Binary Matrix Factorization for Image Classification using Quantum Annealing Hinako Asaoka Kazue Kudo 13 9 0 02 Nov 2023
DINO-Mix: Enhancing Visual Place Recognition with Foundational Vision Model and Feature Mixing Gaoshuang Huang Yang Zhou Xiaofei Hu Chenglong Zhang Luying Zhao Wenjian Gan Mingbo Hou 21 3 0 01 Nov 2023
ROAM: memory-efficient large DNN training via optimized operator ordering and memory layout Huiyao Shu Ang Wang Ziji Shi Hanyu Zhao Yong Li Lu Lu OffRL 34 2 0 30 Oct 2023
The Power of Explainability in Forecast-Informed Deep Learning Models for Flood Mitigation Jimeng Shi Vitalii Stebliankin Giri Narasimhan AI4CE 11 4 0 29 Oct 2023
Embedding in Recommender Systems: A Survey Xiangyu Zhao Maolin Wang Xinjian Zhao Jiansheng Li Shucheng Zhou Dawei Yin Qing Li Jiliang Tang Ruocheng Guo AI4TS 38 10 0 28 Oct 2023
A Data-Centric Online Market for Machine Learning: From Discovery to Pricing Minbiao Han Jonathan Light Steven Xia Sainyam Galhotra Raul Castro Fernandez Haifeng Xu 11 2 0 27 Oct 2023
A Hybrid GNN approach for predicting node data for 3D meshes Shwetha Salimath Francesca Bugiotti Frédéric Magoulès AI4CE 17 0 0 23 Oct 2023
FedSplitX: Federated Split Learning for Computationally-Constrained Heterogeneous Clients Jiyun Shin Jinhyun Ahn Honggu Kang Joonhyuk Kang FedML 65 6 0 23 Oct 2023
pFedLoRA: Model-Heterogeneous Personalized Federated Learning with LoRA Tuning Liping Yi Han Yu Gang Wang Xiaoguang Liu Xiaoxiao Li 51 7 0 20 Oct 2023
Enhancing Deep Neural Network Training Efficiency and Performance through Linear Prediction Hejie Ying Mengmeng Song Yaohong Tang S. Xiao Zimin Xiao 33 8 0 17 Oct 2023
Correcting model misspecification in physics-informed neural networks (PINNs) Zongren Zou Xuhui Meng George Karniadakis PINN 29 41 0 16 Oct 2023
AdaLomo: Low-memory Optimization with Adaptive Learning Rate Kai Lv Hang Yan Qipeng Guo Haijun Lv Xipeng Qiu ODL 27 20 0 16 Oct 2023
LightZero: A Unified Benchmark for Monte Carlo Tree Search in General Sequential Decision Scenarios Yazhe Niu Yuan Pu Zhenjie Yang Xueyan Li Tong Zhou Jiyuan Ren Shuai Hu Hongsheng Li Yu Liu 98 12 0 12 Oct 2023
Attention-Map Augmentation for Hypercomplex Breast Cancer Classification Eleonora Lopez Filippo Betello Federico Carmignani Eleonora Grassucci Danilo Comminiello 27 12 0 11 Oct 2023
Window-based Model Averaging Improves Generalization in Heterogeneous Federated Learning Debora Caldarola Barbara Caputo Marco Ciccone FedML 13 7 0 02 Oct 2023
Modularity in Deep Learning: A Survey Haozhe Sun Isabelle Guyon MoMe 35 2 0 02 Oct 2023
Diver Identification Using Anthropometric Data Ratios for Underwater Multi-Human-Robot Collaboration Jungseok Hong Sadman Sakib Enan Junaed Sattar 46 1 0 29 Sep 2023
Message Propagation Through Time: An Algorithm for Sequence Dependency Retention in Time Series Modeling Shaoming Xu A. Khandelwal Arvind Renganathan Vipin Kumar AI4TS 37 1 0 28 Sep 2023