v1v2 (latest)

An overview of gradient descent optimization algorithms

15 September 2016

Papers citing "An overview of gradient descent optimization algorithms"

50 / 697 papers shown

Title
MONOPOLY: Learning to Price Public Facilities for Revaluing Private Properties with Large-Scale Urban Data M. Fan Jizhou Huang An Zhuo Ying Li P. Li Haifeng Wang 166 3 0 27 Nov 2024
Beyond adaptive gradient: Fast-Controlled Minibatch Algorithm for large-scale optimization Corrado Coppola Lorenzo Papa Irene Amerini L. Palagi ODL 133 0 0 24 Nov 2024
SPGD: Steepest Perturbed Gradient Descent Optimization Amir M. Vahedi Horea T. Ilies 153 1 0 07 Nov 2024
Training on test proteins improves fitness, structure, and function prediction Anton Bushuiev Roman Bushuiev Nikola Zadorozhny Raman Samusevich Hannes Stärk Jiri Sedlar Tomáš Pluskal Josef Sivic 54 0 0 04 Nov 2024
Human-inspired Perspectives: A Survey on AI Long-term Memory Zihong He Weizhe Lin Hao Zheng Fan Zhang Matt Jones Laurence Aitchison X. Xu Miao Liu Per Ola Kristensson Junxiao Shen 248 3 0 01 Nov 2024
Toward Automated Algorithm Design: A Survey and Practical Guide to Meta-Black-Box-Optimization Zeyuan Ma Hongshu Guo Yue-Jiao Gong Jun Zhang Kay Chen Tan 298 5 0 01 Nov 2024
Integration of Communication and Computational Imaging Zhenming Yu Liming Cheng Hongyu Huang Wei Emma Zhang Liang Lin Kun Xu 53 0 0 25 Oct 2024
Simmering: Sufficient is better than optimal for training neural networks Irina Babayan Hazhir Aliahmadi G. Anders 46 0 0 25 Oct 2024
AutoAL: Automated Active Learning with Differentiable Query Strategy Search Yifeng Wang Xueying Zhan Siyu Huang OOD 135 1 0 17 Oct 2024
Emulators for stellar profiles in binary population modeling Elizabeth Teng Ugur Demir Zoheyr Doctor Philipp M. Srivastava Shamal Lalvani ... Matthias U. Kruckow K. A. Rocha Meng Sun Zepei Xing E. Zapartas 83 0 0 14 Oct 2024
The Epochal Sawtooth Phenomenon: Unveiling Training Loss Oscillations in Adam and Other Optimizers Qi Liu Wanjing Ma 88 0 0 14 Oct 2024
Optimizing the Training Schedule of Multilingual NMT using Reinforcement Learning Alexis Allemann Àlex R. Atrio Andrei Popescu-Belis 72 0 0 08 Oct 2024
GLOV: Guided Large Language Models as Implicit Optimizers for Vision Language Models Muhammad Jehanzeb Mirza Mengjie Zhao Zhuoyuan Mao Sivan Doveh Wei Lin ... Yuki Mitsufuji Horst Possegger Rogerio Feris Leonid Karlinsky James Glass VLM 222 1 0 08 Oct 2024
Organizing Unstructured Image Collections using Natural Language Mingxuan Liu Zhun Zhong Jun Li Gianni Franchi Subhankar Roy Elisa Ricci VLM 145 5 0 07 Oct 2024
Latent Feature Mining for Predictive Model Enhancement with Large Language Models Bingxuan Li Pengyi Shi Amy Ward 130 11 0 06 Oct 2024
A LLM-Powered Automatic Grading Framework with Human-Level Guidelines Optimization Yucheng Chu Hang Li Kaiqi Yang Harry Shomer Hui Liu Yasemin Copur-Gencturk Jiliang Tang LLMAG 125 3 0 03 Oct 2024
Selective Aggregation for Low-Rank Adaptation in Federated Learning Pengxin Guo Shuang Zeng Y. Wang Huijie Fan Feifei Wang Liangqiong Qu FedML 153 22 0 02 Oct 2024
Dynamic neuron approach to deep neural networks: Decoupling neurons for renormalization group analysis Donghee Lee Hye-Sung Lee Jaeok Yi 49 1 0 01 Oct 2024
Membership Privacy Evaluation in Deep Spiking Neural Networks Jiaxin Li Gorka Abad S. Picek Mauro Conti AAML 77 1 0 28 Sep 2024
Practical Aspects on Solving Differential Equations Using Deep Learning: A Primer Georgios Is. Detorakis 150 0 0 21 Aug 2024
Towards Clean-Label Backdoor Attacks in the Physical World Thinh Dao Cuong Chi Le Khoa D. Doan Kok-Seng Wong AAML 84 1 0 27 Jul 2024
An Ad-hoc graph node vector embedding algorithm for general knowledge graphs using Kinetica-Graph B. Karamete Eli Glaser 162 0 0 22 Jul 2024
Gradient Boosting Reinforcement Learning Benjamin Fuhrer Chen Tessler Gal Dalal OffRL AI4CE 185 3 0 11 Jul 2024
Pareto Low-Rank Adapters: Efficient Multi-Task Learning with Preferences Nikolaos Dimitriadis Pascal Frossard François Fleuret MoE 257 8 0 10 Jul 2024
Bias of Stochastic Gradient Descent or the Architecture: Disentangling the Effects of Overparameterization of Neural Networks Amit Peleg Matthias Hein 81 0 0 04 Jul 2024
BADM: Batch ADMM for Deep Learning Ouya Wang Shenglong Zhou Geoffrey Ye Li ODL 142 1 0 30 Jun 2024
AdaFisher: Adaptive Second Order Optimization via Fisher Information Damien Martins Gomes Yanlei Zhang Eugene Belilovsky Guy Wolf Mahdi S. Hosseini ODL 218 3 0 26 May 2024
GeoAdaLer: Geometric Insights into Adaptive Stochastic Gradient Descent Algorithms Chinedu Eleh Masuzyo Mwanza Ekene S. Aguegboh Hans-Werner van Wyk 81 0 0 25 May 2024
Automatic Differentiation is Essential in Training Neural Networks for Solving Differential Equations Chuqi Chen Yahong Yang Yang Xiang Wenrui Hao 79 3 0 23 May 2024
Visualizing, Rethinking, and Mining the Loss Landscape of Deep Neural Networks Yichu Xu Xin-Chun Li Lan Li De-Chuan Zhan 93 2 0 21 May 2024
Custom Gradient Estimators are Straight-Through Estimators in Disguise Matt Schoenbauer Daniele Moro Lukasz Lew Andrew G. Howard MQ 83 4 0 08 May 2024
A Full Adagrad algorithm with O(Nd) operations Antoine Godichon-Baggioni Wei Lu Bruno Portier ODL 136 0 0 03 May 2024
WHALE-FL: Wireless and Heterogeneity Aware Latency Efficient Federated Learning over Mobile Devices via Adaptive Subnetwork Scheduling Huai-an Su Jiaxiang Geng Liang Li Xiaoqi Qin Yanzhao Hou Xin Fu Miao Pan Miao Pan 117 1 0 01 May 2024
Implementation and Evaluation of a Gradient Descent-Trained Defensible Blackboard Architecture System Jordan Milbrath Jonathan Rivard Jeremy Straub 68 1 0 17 Apr 2024
I/O in Machine Learning Applications on HPC Systems: A 360-degree Survey Noah Lewis J. L. Bez Suren Byna 115 0 0 16 Apr 2024
Stochastic Online Optimization for Cyber-Physical and Robotic Systems Hao Ma Melanie Zeilinger Michael Muehlebach 92 1 0 08 Apr 2024
Optimizing Quantum Convolutional Neural Network Architectures for Arbitrary Data Dimension Changwon Lee Israel F. Araujo Dongha Kim Junghan Lee Siheon Park Ju-Young Ryu Daniel K. Park 69 2 0 28 Mar 2024
MetaCap: Meta-learning Priors from Multi-View Imagery for Sparse-view Human Performance Capture and Rendering Guoxing Sun Rishabh Dabral Pascal Fua Christian Theobalt Marc Habermann 3DH 100 7 0 27 Mar 2024
Node Classification via Semantic-Structural Attention-Enhanced Graph Convolutional Networks Hongyin Zhu GNN 93 0 0 24 Mar 2024
Gradient-based Sampling for Class Imbalanced Semi-supervised Object Detection Jiaming Li Xiangru Lin Wei Zhang Xiao Tan Yingying Li Junyu Han Errui Ding Jingdong Wang Guanbin Li 87 8 0 22 Mar 2024
ShapeFormer: Shape Prior Visible-to-Amodal Transformer-based Amodal Instance Segmentation Minh-Triet Tran Winston Bounsavy Khoa T. Vo Anh Nguyen Tri Minh Nguyen Ngan Le ViT 61 4 0 18 Mar 2024
Evidence, Definitions and Algorithms regarding the Existence of Cohesive-Convergence Groups in Neural Network Optimization Thien An L. Nguyen 24 0 0 08 Mar 2024
Privacy in Cloud Computing through Immersion-based Coding H. Hayati N. van de Wouw C. Murguia 62 1 0 07 Mar 2024
OCD-FL: A Novel Communication-Efficient Peer Selection-based Decentralized Federated Learning Nizar Masmoudi Wael Jaafar 51 2 0 06 Mar 2024
Gradient-based Discrete Sampling with Automatic Cyclical Scheduling Patrick Pynadath Riddhiman Bhattacharya Arun Hariharan Ruqi Zhang 77 5 0 27 Feb 2024
Accelerated Sampling of Rare Events using a Neural Network Bias Potential Xinru Hua R. Ahmad Jose Blanchet Wei Cai AI4CE 118 3 0 13 Jan 2024
Ordering-Flexible Multi-Robot Coordination for MovingTarget Convoying Using Long-TermTask Execution Bin-Bin Hu Yanxin Zhou Henglai Wei Yan Wang Chen Lv 80 8 0 12 Jan 2024
Enabling Mammography with Co-Robotic Ultrasound Yuxin Chen Yifan Yin Julian Brown Kevin Wang Yi Wang Ziyi Wang Russell H. Taylor Yixuan Wu Emad M. Boctor 26 0 0 16 Dec 2023
Convergence Analysis of Fractional Gradient Descent Ashwani Aggarwal 58 1 0 30 Nov 2023
Physics-Informed Neural Network for Discovering Systems with Unmeasurable States with Application to Lithium-Ion Batteries Yuichi Kajiura Jorge Espin Dong Zhang PINN 119 0 0 27 Nov 2023