An overview of gradient descent optimization algorithms

15 September 2016

Papers citing "An overview of gradient descent optimization algorithms"

50 / 996 papers shown

Title
Task Arithmetic in Trust Region: A Training-Free Model Merging Approach to Navigate Knowledge Conflicts Wenju Sun Qingyong Li Wen Wang Yangli-ao Geng Boyang Li 44 3 0 28 Jan 2025
Optimization Landscapes Learned: Proxy Networks Boost Convergence in Physics-based Inverse Problems Girnar Goyal Philipp Holl Sweta Agrawal Nils Thuerey AI4CE 48 0 0 27 Jan 2025
Egoistic MDS-based Rigid Body Localization Niclas Führling Giuseppe Thadeu Freitas de Abreu David González González Osvaldo Gonsa 40 1 0 20 Jan 2025
Most Influential Subset Selection: Challenges, Promises, and Beyond Yuzheng Hu Pingbang Hu Han Zhao Jiaqi W. Ma TDI 142 2 0 10 Jan 2025
FIDLAR: Forecast-Informed Deep Learning Architecture for Flood Mitigation Jimeng Shi Zeda Yin Arturo S. Leon J. Obeysekera Giri Narasimhan AI4CE 36 1 0 08 Jan 2025
Measuring Error Alignment for Decision-Making Systems Binxia Xu Antonis Bikakis Daniel Onah A. Vlachidis Luke Dickens 41 0 0 03 Jan 2025
Learning Epidemiological Dynamics via the Finite Expression Method Jianda Du Senwei Liang Chunmei Wang 44 1 0 31 Dec 2024
Grams: Gradient Descent with Adaptive Momentum Scaling Yang Cao Xiaoyu Li Zhao Song ODL 98 2 0 22 Dec 2024
PGD-Imp: Rethinking and Unleashing Potential of Classic PGD with Dual Strategies for Imperceptible Adversarial Attacks Jin Li Zitong Yu Ziqiang He Zhong Wang Xiangui Kang AAML 84 0 0 15 Dec 2024
SMMF: Square-Matricized Momentum Factorization for Memory-Efficient Optimization Kwangryeol Park Seulki Lee 68 0 0 12 Dec 2024
Preventing Conflicting Gradients in Neural Marked Temporal Point Processes T. Bosser Souhaib Ben Taieb AI4TS 69 0 0 11 Dec 2024
Safeguarding Text-to-Image Generation via Inference-Time Prompt-Noise Optimization Jiangweizhi Peng Zhiwei Tang Gaowen Liu Charles Fleming Mingyi Hong 81 2 0 05 Dec 2024
Offline Stochastic Optimization of Black-Box Objective Functions Juncheng Dong Zihao Wu Hamid Jafarkhani Ali Pezeshki Vahid Tarokh OffRL 69 0 0 03 Dec 2024
Curvature in the Looking-Glass: Optimal Methods to Exploit Curvature of Expectation in the Loss Landscape Jed A. Duersch Tommie A. Catanach Alexander Safonov Jeremy Wendt 84 0 0 25 Nov 2024
Beyond adaptive gradient: Fast-Controlled Minibatch Algorithm for large-scale optimization Corrado Coppola Lorenzo Papa Irene Amerini L. Palagi ODL 84 0 0 24 Nov 2024
Deep Learning-Based Automatic Delineation of Liver Domes in kV Triggered Images for Online Breath-hold Reproducibility Verification of Liver Stereotactic Body Radiation Therapy Sugandima Weragoda Ping Xia Kevin Stephans Neil Woody Michael Martens Robert Brown Bingqi Guo 63 0 0 22 Nov 2024
LEAP:D - A Novel Prompt-based Approach for Domain-Generalized Aerial Object Detection Chanyeong Park Heegwang Kim Joonki Paik 33 0 0 14 Nov 2024
IDCIA: Immunocytochemistry Dataset for Cellular Image Analysis Abdurahman Ali Mohammed Catherine Fonder Donald S. Sakaguchi Wallapak Tavanapong Surya K. Mallapragada Azeez Idris 31 1 0 13 Nov 2024
Feature Fusion Transferability Aware Transformer for Unsupervised Domain Adaptation Xiaowei Yu Zhe Huang Zao Zhang ViT 26 1 0 10 Nov 2024
SPGD: Steepest Perturbed Gradient Descent Optimization Amir M. Vahedi Horea T. Ilies 30 1 0 07 Nov 2024
SynthSet: Generative Diffusion Model for Semantic Segmentation in Precision Agriculture Andrew Heschl Mauricio Murillo Keyhan Najafian F. Maleki DiffM 41 1 0 05 Nov 2024
Flashy Backdoor: Real-world Environment Backdoor Attack on SNNs with DVS Cameras Roberto Riaño Gorka Abad S. Picek A. Urbieta AAML 36 0 0 05 Nov 2024
Training on test proteins improves fitness, structure, and function prediction Anton Bushuiev Roman Bushuiev Nikola Zadorozhny Raman Samusevich Hannes Stärk Jiri Sedlar Tomáš Pluskal Josef Sivic 31 0 0 04 Nov 2024
Rethinking Weight Decay for Robust Fine-Tuning of Foundation Models Junjiao Tian Chengyue Huang Z. Kira 44 1 0 03 Nov 2024
An Innovative CGL-MHA Model for Sarcasm Sentiment Recognition Using the MindSpore Framework Zhenkai Qin Qining Luo Xunyi Nong 29 0 0 02 Nov 2024
Human-inspired Perspectives: A Survey on AI Long-term Memory Zihong He Weizhe Lin Hao Zheng Fan Zhang Matt Jones Laurence Aitchison X. Xu Miao Liu Per Ola Kristensson Junxiao Shen 77 2 0 01 Nov 2024
Toward Automated Algorithm Design: A Survey and Practical Guide to Meta-Black-Box-Optimization Zeyuan Ma Hongshu Guo Yue-jiao Gong Jun Zhang Kay Chen Tan 119 2 0 01 Nov 2024
CaAdam: Improving Adam optimizer using connection aware methods Remi Genet Hugo Inzirillo 34 0 0 31 Oct 2024
Simmering: Sufficient is better than optimal for training neural networks Irina Babayan Hazhir Aliahmadi G. Anders 22 0 0 25 Oct 2024
Gradient Descent Efficiency Index Aviral Dhingra 11 0 0 25 Oct 2024
Integration of Communication and Computational Imaging Zhenming Yu Liming Cheng Hongyu Huang Wei Emma Zhang Liang Lin Kun Xu 19 0 0 25 Oct 2024
You Only Look Around: Learning Illumination Invariant Feature for Low-light Object Detection Mingbo Hong Shen Cheng Haibin Huang Haoqiang Fan Shuaicheng Liu ObjD 34 1 0 24 Oct 2024
Hybrid Memory Replay: Blending Real and Distilled Data for Class Incremental Learning Jiangtao Kong Jiacheng Shi Ashley Gao Shaohan Hu Dinesh Manocha Huajie Shao VLM DD 44 1 0 20 Oct 2024
Optimizing Preference Alignment with Differentiable NDCG Ranking Jiacong Zhou Xianyun Wang Jun Yu 32 2 0 17 Oct 2024
AutoAL: Automated Active Learning with Differentiable Query Strategy Search Yifeng Wang Xueying Zhan Siyu Huang OOD 38 0 0 17 Oct 2024
LoKO: Low-Rank Kalman Optimizer for Online Fine-Tuning of Large Models Hossein Abdi Mingfei Sun Andi Zhang Samuel Kaski Wei Pan 30 0 0 15 Oct 2024
LG-CAV: Train Any Concept Activation Vector with Language Guidance Qihan Huang Jie Song Mengqi Xue Han Zhang Bingde Hu Huiqiong Wang Hao Jiang Xingen Wang Xiuming Zhang VLM 34 0 0 14 Oct 2024
The Epochal Sawtooth Effect: Unveiling Training Loss Oscillations in Adam and Other Optimizers Qi Liu Wanjing Ma 16 0 0 14 Oct 2024
Emulators for stellar profiles in binary population modeling Elizabeth Teng Ugur Demir Zoheyr Doctor Philipp M. Srivastava Shamal Lalvani ... Matthias U. Kruckow K. A. Rocha Meng Sun Zepei Xing E. Zapartas 31 0 0 14 Oct 2024
Improving accuracy and convergence of federated learning edge computing methods for generalized DER forecasting applications in power grid V. J. Nair Lucas Pereira AI4CE 25 0 0 13 Oct 2024
Gradients Stand-in for Defending Deep Leakage in Federated Learning H. Yi H. Ren C. Hu Y. Li J. Deng Xin Xie FedML 35 0 0 11 Oct 2024
Randomized Asymmetric Chain of LoRA: The First Meaningful Theoretical Framework for Low-Rank Adaptation Grigory Malinovsky Umberto Michieli Hasan Hammoud Taha Ceritli Hayder Elesedy Mete Ozay Peter Richtárik AI4CE 37 3 0 10 Oct 2024
Optimizing the Training Schedule of Multilingual NMT using Reinforcement Learning Alexis Allemann Àlex R. Atrio Andrei Popescu-Belis 31 0 0 08 Oct 2024
A second-order-like optimizer with adaptive gradient scaling for deep learning Jérôme Bolte Ryan Boustany Edouard Pauwels Andrei Purica ODL 47 0 0 08 Oct 2024
GLOV: Guided Large Language Models as Implicit Optimizers for Vision Language Models Muhammad Jehanzeb Mirza Mengjie Zhao Zhuoyuan Mao Sivan Doveh Wei Lin ... Yuki Mitsufuji Horst Possegger Rogerio Feris Leonid Karlinsky James Glass VLM 84 1 0 08 Oct 2024
Organizing Unstructured Image Collections using Natural Language Mingxuan Liu Zhun Zhong Jun Li Gianni Franchi Subhankar Roy Elisa Ricci VLM 44 3 0 07 Oct 2024
Latent Feature Mining for Predictive Model Enhancement with Large Language Models Bingxuan Li Pengyi Shi Amy Ward 62 9 0 06 Oct 2024
FedCert: Federated Accuracy Certification Minh Hieu Nguyen Huu Tien Nguyen Trung Thanh Nguyen Manh Duong Nguyen Trong Nghia Hoang Truong Thao Nguyen Phi Le Nguyen FedML 37 0 0 04 Oct 2024
A LLM-Powered Automatic Grading Framework with Human-Level Guidelines Optimization Yucheng Chu Hang Li Kaiqi Yang Harry Shomer Hui Liu Yasemin Copur-Gencturk Jiliang Tang LLMAG 55 2 0 03 Oct 2024
Selective Aggregation for Low-Rank Adaptation in Federated Learning Pengxin Guo Shuang Zeng Y. Wang Huijie Fan Feifei Wang Liangqiong Qu FedML 47 10 0 02 Oct 2024