An overview of gradient descent optimization algorithms

15 September 2016

Papers citing "An overview of gradient descent optimization algorithms"

50 / 996 papers shown

Title
TransResNet: Integrating the Strengths of ViTs and CNNs for High Resolution Medical Image Segmentation via Feature Grafting Muhammad Hamza Sharif Dmitry Demidov Asif Hanif Mohammad Yaqub Min Xu ViT MedIm 31 2 0 01 Oct 2024
Pseudo-Non-Linear Data Augmentation via Energy Minimization Pingbang Hu Mahito Sugiyama 26 0 0 01 Oct 2024
Dynamic neurons: A statistical physics approach for analyzing deep neural networks Donghee Lee Hye-Sung Lee Jaeok Yi 21 1 0 01 Oct 2024
Aggressive Post-Training Compression on Extremely Large Language Models Zining Zhang Yao Chen Bingsheng He Zhenjie Zhang 28 0 0 30 Sep 2024
Membership Privacy Evaluation in Deep Spiking Neural Networks Jiaxin Li Gorka Abad S. Picek Mauro Conti AAML 33 1 0 28 Sep 2024
LW2G: Learning Whether to Grow for Prompt-based Continual Learning Qian Feng Dawei Zhou Hanbin Zhao Chao Zhang Hui Qian VLM CLL 37 3 0 27 Sep 2024
Fairness-aware Multiobjective Evolutionary Learning Qingquan Zhang Jialin Liu Xin Yao 36 1 0 27 Sep 2024
Amodal Instance Segmentation with Diffusion Shape Prior Estimation Minh Tran Khoa T. Vo Tri Nguyen Ngan Le DiffM 36 0 0 26 Sep 2024
CBIDR: A novel method for information retrieval combining image and data by means of TOPSIS applied to medical diagnosis Humberto Giuri Renato A. Krohling 23 0 0 26 Sep 2024
Immersion and Invariance-based Coding for Privacy-Preserving Federated Learning H. Hayati C. Murguia N. van de Wouw FedML 28 0 0 25 Sep 2024
Super Level Sets and Exponential Decay: A Synergistic Approach to Stable Neural Network Training J. Chaudhary Dipak Nidhi J. Heikkonen H. Merisaari R. Kanth 26 0 0 25 Sep 2024
PACE: Poisoning Attacks on Learned Cardinality Estimation Jintao Zhang Chao Zhang Guoliang Li Chengliang Chai 30 8 0 24 Sep 2024
Component-based Sketching for Deep ReLU Nets Di Wang Shao-Bo Lin Deyu Meng Feilong Cao 23 1 0 21 Sep 2024
Deep-Wide Learning Assistance for Insect Pest Classification Toan Nguyen Huy Nguyen Huy Ung Hieu T. Ung Binh T. Nguyen 32 0 0 16 Sep 2024
Adaptive Segmentation-Based Initialization for Steered Mixture of Experts Image Regression Yi-Hsin Li S. Knorr Mårten Sjöström Thomas Sikora 35 0 0 16 Sep 2024
Optimizing the Songwriting Process: Genre-Based Lyric Generation Using Deep Learning Models Tracy Cai Wilson Liang Donte Townes 13 0 0 15 Sep 2024
VSFormer: Mining Correlations in Flexible View Set for Multi-view 3D Shape Understanding Hongyu Sun Yongcai Wang Peng Wang Haoran Deng Xudong Cai Deying Li 29 0 0 14 Sep 2024
A Dynamic Weighting Strategy to Mitigate Worker Node Failure in Distributed Deep Learning Yuesheng Xu Arielle Carr 32 0 0 14 Sep 2024
WarpAdam: A new Adam optimizer based on Meta-Learning approach Chengxi Pan Junshang Chen Jingrui Ye ODL 31 0 0 06 Sep 2024
The AdEMAMix Optimizer: Better, Faster, Older Matteo Pagliardini Pierre Ablin David Grangier ODL 28 8 0 05 Sep 2024
Deep non-parametric logistic model with case-control data and external summary information Hengchao Shi M. Zheng Wen Yu 30 0 0 03 Sep 2024
Quantifying Emergence in Neural Networks: Insights from Pruning and Training Dynamics Faisal AlShinaifi Zeyad Almoaigel Johnny Jingze Li Abdulla Kuleib Gabriel A. Silva 34 0 0 03 Sep 2024
Entropy Loss: An Interpretability Amplifier of 3D Object Detection Network for Intelligent Driving Heng Yang Shiyan Zhang Zhuoyi Yang Xinyu Zhang Li Wang Yifan Tang Jilong Guo Jiajun Li 27 0 0 01 Sep 2024
ResEmoteNet: Bridging Accuracy and Loss Reduction in Facial Emotion Recognition Arnab Kumar Roy H. Kathania Adhitiya Sharma Abhishek Dey Md. Sarfaraj Alam Ansari CVBM 43 3 0 01 Sep 2024
Advancing Machine Learning in Industry 4.0: Benchmark Framework for Rare-event Prediction in Chemical Processes Vikram Sudarshan Warren D. Seider 54 1 0 31 Aug 2024
AdaNAT: Exploring Adaptive Policy for Token-Based Image Generation Zanlin Ni Yulin Wang Renping Zhou Rui Lu Jiayi Guo Jinyi Hu Zhiyuan Liu Yuan Yao Gao Huang 37 7 0 31 Aug 2024
Comparative Analysis: Violence Recognition from Videos using Transfer Learning Dursun Dashdamirov 22 0 0 26 Aug 2024
Adaptive Backtracking For Faster Optimization Joao V. Cavalcanti Laurent Lessard Ashia C. Wilson 16 0 0 23 Aug 2024
Growing Deep Neural Network Considering with Similarity between Neurons Taigo Sakai Kazuhiro Hotta 40 0 0 23 Aug 2024
Tackling Data Heterogeneity in Federated Learning via Loss Decomposition Shuang Zeng Pengxin Guo Shuai Wang Jianbo Wang Yuyin Zhou Liangqiong Qu FedML 37 2 0 22 Aug 2024
Geometrical structures of digital fluctuations in parameter space of neural networks trained with adaptive momentum optimization Igor V. Netay 47 0 0 22 Aug 2024
Detection of Under-represented Samples Using Dynamic Batch Training for Brain Tumor Segmentation from MR Images Subin Sahayam John Michael Sujay Zakkam Yoga Sri Varshan V Umarani Jayaraman 27 0 0 21 Aug 2024
Practical Aspects on Solving Differential Equations Using Deep Learning: A Primer Georgios Is. Detorakis 28 0 0 21 Aug 2024
Dynamic Graph Representation Learning for Passenger Behavior Prediction Mingxuan Xie Tao Zou Junchen Ye Bowen Du Runhe Huang AI4TS 27 0 0 17 Aug 2024
Meta SAC-Lag: Towards Deployable Safe Reinforcement Learning via MetaGradient-based Hyperparameter Tuning Homayoun Honari Amir M. Soufi Enayati Mehran Ghafarian Tamizi H. Najjaran 53 1 0 15 Aug 2024
DiPGrasp: Parallel Local Searching for Efficient Differentiable Grasp Planning Wenqiang Xu Jieyi Zhang Tutian Tang Zhenjun Yu Yutong Li Cewu Lu 43 3 0 08 Aug 2024
SegXAL: Explainable Active Learning for Semantic Segmentation in Driving Scene Scenarios Sriram Mandalika Athira Nambiar 24 1 0 08 Aug 2024
DeepNetBeam: A Framework for the Analysis of Functionally Graded Porous Beams M. Eshaghi M. Bamdad C. Anitescu Yizheng Wang X. Zhuang Timon Rabczuk AI4CE 29 7 0 04 Aug 2024
Conditional LoRA Parameter Generation Aaron Mueller Millicent Li Koyena Pal Wangbo Zhao Yukun Zhou Jiuding Sun Yonatan Belinkov DiffM 41 4 0 02 Aug 2024
Alpha-VI DeepONet: A prior-robust variational Bayesian approach for enhancing DeepONets with uncertainty quantification Soban Nasir Lone Subhayan De R. Nayek BDL 40 1 0 01 Aug 2024
A Systematic Review on Long-Tailed Learning Chongsheng Zhang G. Almpanidis Gaojuan Fan Binquan Deng Yanbo Zhang Ji Liu Aouaidjia Kamel Paolo Soda Joao Gama 29 7 0 01 Aug 2024
Towards Clean-Label Backdoor Attacks in the Physical World Thinh Dao Cuong Chi Le Khoa D. Doan Kok-Seng Wong AAML 34 1 0 27 Jul 2024
Overcoming Binary Adversarial Optimisation with Competitive Coevolution Per Kristian Lehre Shishen Lin AAML 27 1 0 25 Jul 2024
An Ad-hoc graph node vector embedding algorithm for general knowledge graphs using Kinetica-Graph B. Karamete Eli Glaser 45 0 0 22 Jul 2024
Craft: Cross-modal Aligned Features Improve Robustness of Prompt Tuning Jingchen Sun Rohan Sharma Vishnu Suresh Lokhande Changyou Chen 46 0 0 22 Jul 2024
Generally-Occurring Model Change for Robust Counterfactual Explanations Ao Xu Tieru Wu AAML 31 2 0 16 Jul 2024
Gradient Boosting Reinforcement Learning Benjamin Fuhrer Chen Tessler Gal Dalal OffRL AI4CE 52 3 0 11 Jul 2024
SwishReLU: A Unified Approach to Activation Functions for Enhanced Deep Neural Networks Performance Jamshaid Ul Rahman Rubiqa Zulfiqar Asad Khan Nimra 28 4 0 11 Jul 2024
Pareto Low-Rank Adapters: Efficient Multi-Task Learning with Preferences Nikolaos Dimitriadis Pascal Frossard F. Fleuret MoE 67 6 0 10 Jul 2024
Gait Patterns as Biomarkers: A Video-Based Approach for Classifying Scoliosis Zirui Zhou Junhao Liang Zizhao Peng Chao Fan Fengwei An Shiqi Yu 27 3 0 08 Jul 2024