An overview of gradient descent optimization algorithms

15 September 2016

Papers citing "An overview of gradient descent optimization algorithms"

50 / 1,016 papers shown

Title
DPIS: An Enhanced Mechanism for Differentially Private SGD with Importance Sampling Jianxin Wei Ergute Bao X. Xiao Yifan Yang 48 20 0 18 Oct 2022
An Open-source Benchmark of Deep Learning Models for Audio-visual Apparent and Self-reported Personality Recognition Rongfan Liao Siyang Song Hatice Gunes VLM 34 17 0 17 Oct 2022
POGD: Gradient Descent with New Stochastic Rules Feihu Han Sida Xing Suiyang Khoo 36 0 0 15 Oct 2022
BLOX: Macro Neural Architecture Search Benchmark and Algorithms Thomas C. P. Chau Łukasz Dudziak Hongkai Wen Nicholas D. Lane Mohamed S. Abdelfattah 35 13 0 13 Oct 2022
How to Sift Out a Clean Data Subset in the Presence of Data Poisoning? Yi Zeng Minzhou Pan Himanshu Jahagirdar Ming Jin Lingjuan Lyu R. Jia AAML 39 21 0 12 Oct 2022
AdaNorm: Adaptive Gradient Norm Correction based Optimizer for CNNs S. Dubey S. Singh B. B. Chaudhuri ODL 27 8 0 12 Oct 2022
Deep Learning-Derived Optimal Aviation Strategies to Control Pandemics S. Rizvi Akash Awasthi Maria J. Peláez Zhihui Wang V. Cristini Hien Nguyen P. Dogra 22 1 0 12 Oct 2022
Towards Theoretically Inspired Neural Initialization Optimization Yibo Yang Hong Wang Haobo Yuan Zhouchen Lin 32 9 0 12 Oct 2022
Sequential Ensembling for Semantic Segmentation Rawal Khirodkar Brandon A. Smith Siddhartha Chandra Amit Agrawal A. Criminisi 42 2 0 08 Oct 2022
Scaling up Stochastic Gradient Descent for Non-convex Optimisation S. Mohamad H. Alamri A. Bouchachia 50 3 0 06 Oct 2022
FedMT: Federated Learning with Mixed-type Labels Qiong Zhang Jing Peng Xin Zhang A. Talhouk Gang Niu Xiaoxiao Li FedML 64 0 0 05 Oct 2022
COPILOT: Human-Environment Collision Prediction and Localization from Egocentric Videos Boxiao Pan Bokui Shen Davis Rempe Despoina Paschalidou Kaichun Mo Yanchao Yang Leonidas J. Guibas 17 2 0 04 Oct 2022
ASAP: Accurate semantic segmentation for real time performance Jaewoo Park Subin Lee Eon Kim Byeongjun Moon Dabeen Yu Yeonseung Yu Junghwan Kim 30 0 0 04 Oct 2022
Random orthogonal additive filters: a solution to the vanishing/exploding gradient of deep neural networks Andrea Ceni ODL 33 3 0 03 Oct 2022
On Physics-Informed Neural Networks for Quantum Computers Stefano Markidis PINN 34 18 0 28 Sep 2022
Untargeted Backdoor Watermark: Towards Harmless and Stealthy Dataset Copyright Protection Yiming Li Yang Bai Yong Jiang Yong-Liang Yang Shutao Xia Bo Li AAML 56 98 0 27 Sep 2022
Investigating and Mitigating Failure Modes in Physics-informed Neural Networks (PINNs) S. Basir PINN AI4CE 31 21 0 20 Sep 2022
A study on the deviations in performance of FNNs and CNNs in the realm of grayscale adversarial images Durga Shree Nagabushanam Steve Mathew C. L. Chowdhary AAML 20 1 0 17 Sep 2022
A Transfer Function Design Using A Knowledge Database based on Deep Image and Primitive Intensity Profile Features Retrieval Y. Jung J. Kong J. Kim 14 1 0 14 Sep 2022
One-Shot Doc Snippet Detection: Powering Search in Document Beyond Text Abhinav Java Shripad Deshmukh Milan Aggarwal Surgan Jandial Mausoom Sarkar Balaji Krishnamurthy 37 3 0 12 Sep 2022
Convergence of Batch Updating Methods with Approximate Gradients and/or Noisy Measurements: Theory and Computational Results Tadipatri Uday M. Vidyasagar 28 0 0 12 Sep 2022
Deep Learning Models for Detecting Malware Attacks Pascal Maniriho A. N. Mahmood M. Chowdhury AAML 24 6 0 08 Sep 2022
Modelling of physical systems with a Hopf bifurcation using mechanistic models and machine learning K. H. Lee David A.W. Barton L. Renson 43 12 0 07 Sep 2022
Parallel and Streaming Wavelet Neural Networks for Classification and Regression under Apache Spark E Venkatesh Yelleti Vivek V. Ravi Shiva Shankar Orsu 16 6 0 07 Sep 2022
Crowdsourced-based Deep Convolutional Networks for Urban Flood Depth Mapping B. Kharazi A. Behzadan HAI 27 0 0 06 Sep 2022
Automated Defect Recognition of Castings defects using Neural Networks Alberto García-Pérez M. J. Gómez-Silva A. D. L. Escalera MedIm AI4CE 82 23 0 06 Sep 2022
Gait Recognition in the Wild with Multi-hop Temporal Switch Jinkai Zheng Xinchen Liu Xiaoyan Gu Yaoqi Sun Chuang Gan Jiyong Zhang Wu Liu C. Yan CVBM 29 31 0 01 Sep 2022
Progressive Self-Distillation for Ground-to-Aerial Perception Knowledge Transfer Junjie Hu Chenyou Fan Mete Ozay Hua Feng Yuan Gao Tin Lun Lam SSL 32 2 0 29 Aug 2022
Learning Rate Perturbation: A Generic Plugin of Learning Rate Schedule towards Flatter Local Minima Hengyu Liu Qiang Fu Lun Du Tiancheng Zhang Gensitskiy Yu. Shi Han Dongmei Zhang 128 3 0 25 Aug 2022
Bag of Tricks for Out-of-Distribution Generalization Zining Chen Weiqiu Wang Zhaohui Hou Aidong Men Hong Chen 37 2 0 23 Aug 2022
String-based Molecule Generation via Multi-decoder VAE Kisoo Kwon Kuhwan Jung Jung-Geun Park Hwidong Na Jinwoo Shin DRL 36 2 0 23 Aug 2022
RAIN: RegulArization on Input and Network for Black-Box Domain Adaptation Qucheng Peng Zhengming Ding Lingjuan Lyu Lichao Sun Chen Chen OOD MLAU 31 18 0 22 Aug 2022
A Novel Plug-and-Play Approach for Adversarially Robust Generalization Deepak Maurya Adarsh Barik Jean Honorio OOD AAML 46 0 0 19 Aug 2022
Global Convergence of Two-timescale Actor-Critic for Solving Linear Quadratic Regulator Xu-yang Chen Jingliang Duan Yingbin Liang Lin Zhao 32 6 0 18 Aug 2022
Object Detection for Autonomous Dozers Chunfang Liu Burhaneddin Yaman 19 2 0 17 Aug 2022
Federated Quantum Natural Gradient Descent for Quantum Federated Learning Jun Qi FedML 21 16 0 15 Aug 2022
Zeus: Understanding and Optimizing GPU Energy Consumption of DNN Training Jie You Jaehoon Chung Mosharaf Chowdhury 26 75 0 12 Aug 2022
KL-divergence Based Deep Learning for Discrete Time Model Li Liu Xiangeng Fang Di Wang Weijing Tang Kevin He 22 1 0 10 Aug 2022
PECCO: A Profit and Cost-oriented Computation Offloading Scheme in Edge-Cloud Environment with Improved Moth-flame Optimisation Jiashu Wu Hao Dai Yang Wang Shigen Shen Chengzhong Xu 10 6 0 09 Aug 2022
Fast Offline Policy Optimization for Large Scale Recommendation Otmane Sakhi D. Rohde Alexandre Gilotte OffRL 47 3 0 08 Aug 2022
Data-free Backdoor Removal based on Channel Lipschitzness Runkai Zheng Rong Tang Jianze Li Li Liu AAML 29 104 0 05 Aug 2022
Multiple-hypothesis RNN-T Loss for Unsupervised Fine-tuning and Self-training of Neural Transducer Cong-Thanh Do Mohan Li R. Doddipatla 14 3 0 29 Jul 2022
A Survey of Learning on Small Data: Generalization, Optimization, and Challenge Xiaofeng Cao Weixin Bu Sheng-Jun Huang Minling Zhang Ivor W. Tsang Yew-Soon Ong James T. Kwok 40 1 0 29 Jul 2022
Text Classification in Memristor-based Spiking Neural Networks Jinqi Huang A. Serb S. Stathopoulos T. Prodromakis 11 14 0 27 Jul 2022
End-To-End Audiovisual Feature Fusion for Active Speaker Detection Fiseha B. Tesema Zheyuan Lin Shiqiang Zhu Wei Song J. Gu Hong-Chuan Wu 17 4 0 27 Jul 2022
On the benefits of non-linear weight updates Paul Norridge 23 0 0 25 Jul 2022
Integrating Statistical and Machine Learning Approaches to Identify Receptive Field Structure in Neural Populations Mehrad Sarmashghi Shantanu P. Jadhav U. Eden 31 1 0 25 Jul 2022
Auto Machine Learning for Medical Image Analysis by Unifying the Search on Data Augmentation and Neural Architecture Jianwei Zhang Dong Li Lituan Wang Lei Zhang 33 2 0 21 Jul 2022
The Anatomy of Video Editing: A Dataset and Benchmark Suite for AI-Assisted Video Editing Dawit Mureja Argaw Fabian Caba Heilbron Joon-Young Lee Markus Woodson In So Kweon VGen 57 23 0 20 Jul 2022
Pseudo-label Guided Cross-video Pixel Contrast for Robotic Surgical Scene Segmentation with Limited Annotations Yang Yu Zixu Zhao Yueming Jin Guangyong Chen Qi Dou Pheng-Ann Heng 30 4 0 20 Jul 2022