v1v2 (latest)

An overview of gradient descent optimization algorithms

15 September 2016

Papers citing "An overview of gradient descent optimization algorithms"

50 / 698 papers shown

Title
Online Knowledge Distillation via Multi-branch Diversity Enhancement Zheng Li Ying Huang Defang Chen Tianren Luo Ning Cai Zhigeng Pan 69 28 0 02 Oct 2020
LEBANONUPRISING: a thorough study of Lebanese tweets Reda Khalaf Mireille Makary 10 0 0 30 Sep 2020
Learning Thermodynamically Stable and Galilean Invariant Partial Differential Equations for Non-equilibrium Flows Juntao Huang Zhiting Ma Y. Zhou W. Yong AI4CE 63 16 0 28 Sep 2020
Federated Learning with Nesterov Accelerated Gradient Zhengjie Yang Wei Bao Dong Yuan Nguyen H. Tran Albert Y. Zomaya FedML 68 32 0 18 Sep 2020
Review: Deep Learning in Electron Microscopy Jeffrey M. Ede 199 80 0 17 Sep 2020
A Qualitative Study of the Dynamic Behavior for Adaptive Gradient Algorithms Chao Ma Lei Wu E. Weinan ODL 51 25 0 14 Sep 2020
Variational Preparation of the Sachdev-Ye-Kitaev Thermofield Double V. P. Su 17 8 0 09 Sep 2020
Scaling up Differentially Private Deep Learning with Fast Per-Example Gradient Clipping Jaewoo Lee Daniel Kifer 90 57 0 07 Sep 2020
Self-Adaptive Physics-Informed Neural Networks using a Soft Attention Mechanism L. McClenny U. Braga-Neto PINN 98 465 0 07 Sep 2020
An Analysis of Alternating Direction Method of Multipliers for Feed-forward Neural Networks Seyedeh Niusha Alavi Foumani Ce Guo Wayne Luk 14 1 0 06 Sep 2020
GRAFFL: Gradient-free Federated Learning of a Bayesian Generative Model S. Hahn Junghye Lee FedML 28 2 0 29 Aug 2020
On segmentation of pectoralis muscle in digital mammograms by means of deep learning H. Soleimani O. Michailovich 29 21 0 29 Aug 2020
Deep Learning for Constrained Utility Maximisation Ashley Davey Harry Zheng 54 9 0 26 Aug 2020
HydaLearn: Highly Dynamic Task Weighting for Multi-task Learning with Auxiliary Tasks Sam Verboven M. H. Chaudhary Jeroen Berrevoets Wouter Verbeke 57 7 0 26 Aug 2020
Gravilon: Applications of a New Gradient Descent Method to Machine Learning Chad Kelterborn Marcin Mazur B. Petrenko ODL 35 4 0 26 Aug 2020
Utilizing Explainable AI for Quantization and Pruning of Deep Neural Networks Muhammad Sabih Frank Hannig J. Teich MQ 117 25 0 20 Aug 2020
Deep learning for photoacoustic imaging: a survey Changchun Yang Hengrong Lan Feng Gao Fei Gao VLM MedIm 59 21 0 10 Aug 2020
A Survey on Large-scale Machine Learning Meng Wang Weijie Fu Xiangnan He Shijie Hao Xindong Wu 84 112 0 10 Aug 2020
Machine Learning in Nano-Scale Biomedical Engineering Alexandros-Apostolos A. Boulogeorgos Stylianos E. Trevlakis Sotiris A. Tegos V. Papanikolaou G. Karagiannidis AI4CE 41 30 0 05 Aug 2020
Machine learning for metal additive manufacturing: Predicting temperature and melt pool fluid dynamics using physics-informed neural networks Qiming Zhu Zeliang Liu Jinhui Yan PINN AI4CE 83 307 0 28 Jul 2020
A Comparison of Optimization Algorithms for Deep Learning Derya Soydaner 159 159 0 28 Jul 2020
CNN Detection of GAN-Generated Face Images based on Cross-Band Co-occurrences Analysis Mauro Barni Kassem Kallas Ehsan Nowroozi B. Tondi CVBM 90 76 0 25 Jul 2020
Explainable Rumor Detection using Inter and Intra-feature Attention Networks Mingxuan Chen Ning Wang K. P. Subbalakshmi 89 8 0 21 Jul 2020
Learn distributed GAN with Temporary Discriminators Hui Qu Yikai Zhang Qi Chang Zhennan Yan Chao Chen Dimitris N. Metaxas FedML 55 16 0 17 Jul 2020
EfficientHRNet: Efficient Scaling for Lightweight High-Resolution Multi-Person Pose Estimation Christopher Neff A. Sheth Steven Furgurson Hamed Tabkhi 3DH 74 27 0 16 Jul 2020
RDP-GAN: A Rényi-Differential Privacy based Generative Adversarial Network Chuan Ma Jun Li Ming Ding Bo Liu Kang Wei J. Weng H. Vincent Poor SyDa 33 21 0 04 Jul 2020
Deep learning of thermodynamics-aware reduced-order models from data Quercus Hernandez Alberto Badías D. González Francisco Chinesta Elías Cueto PINN AI4CE 76 80 0 03 Jul 2020
Influence Functions in Deep Learning Are Fragile S. Basu Phillip E. Pope Soheil Feizi TDI 156 237 0 25 Jun 2020
Explainable CNN-attention Networks (C-Attention Network) for Automated Detection of Alzheimer's Disease Ning Wang Mingxuan Chen K. P. Subbalakshmi 57 23 0 25 Jun 2020
Large-scale detection and categorization of oil spills from SAR images with deep learning F. Bianchi M. M. Espeseth N. Borch 31 70 0 24 Jun 2020
Learning compact generalizable neural representations supporting perceptual grouping Vijay Veerabadran V. D. Sa 58 2 0 21 Jun 2020
Deep Learning with Functional Inputs Barinder Thind Kevin Multani Jiguo Cao 53 25 0 17 Jun 2020
Almost sure convergence rates for Stochastic Gradient Descent and Stochastic Heavy Ball Othmane Sebbouh Robert Mansel Gower Aaron Defazio 74 23 0 14 Jun 2020
Carathéodory Sampling for Stochastic Gradient Descent Francesco Cosentino Harald Oberhauser Alessandro Abate 43 1 0 02 Jun 2020
A comparative study of 2D image segmentation algorithms for traumatic brain lesions using CT data from the ProTECTIII multicenter clinical trial Shruti Jadon Owen P. Leary I. Pan Tyler Harder D. Wright Lisa H. Merck D. Merck 69 27 0 01 Jun 2020
A Comprehensive Study of Data Augmentation Strategies for Prostate Cancer Detection in Diffusion-weighted MRI using Convolutional Neural Networks Ruqian Hao Khashayar Namdar Lin Liu M. Haider Farzad Khalvati MedIm 40 60 0 01 Jun 2020
ADAHESSIAN: An Adaptive Second Order Optimizer for Machine Learning Z. Yao A. Gholami Sheng Shen Mustafa Mustafa Kurt Keutzer Michael W. Mahoney ODL 160 287 0 01 Jun 2020
Detecting Problem Statements in Peer Assessments Yunkai Xiao Gabriel Zingle Qinjin Jia Harshay Shah Yi Zhang ... Ashwin Balasubramaniam Harshit Patel Priyankha Bhalasubbramanian Vikram Patel E. Gehringer 34 17 0 30 May 2020
Synthetic Learning: Learn From Distributed Asynchronized Discriminator GAN Without Sharing Medical Image Data Qi Chang Hui Qu Yikai Zhang M. Sabuncu Chao Chen Tong Zhang Dimitris N. Metaxas MedIm 108 83 0 29 May 2020
Generative Adversarial Networks for Bitcoin Data Augmentation Francesco Zola Jan L. Bruse Xabier Etxeberria Barrio M. Galar Raul Orduna Urrutia GAN 64 8 0 27 May 2020
Survey: Machine Learning in Production Rendering Shilin Zhu 3DV AI4CE 21 1 0 26 May 2020
Reliability and Performance Assessment of Federated Learning on Clinical Benchmark Data G. Lee S. Shin OOD 39 2 0 24 May 2020
An Introduction to Neural Architecture Search for Convolutional Networks George Kyriakides K. Margaritis AI4CE 90 27 0 22 May 2020
Hidden Markov Chains, Entropic Forward-Backward, and Part-Of-Speech Tagging E. Azeraf E. Monfrini Emmanuel Vignon W. Pieczynski BDL 32 9 0 21 May 2020
Automated Copper Alloy Grain Size Evaluation Using a Deep-learning CNN George S. Baggs P. Guerrier A. Loeb Jason C. Jones 39 9 0 20 May 2020
LALR: Theoretical and Experimental validation of Lipschitz Adaptive Learning Rate in Regression and Neural Networks Snehanshu Saha Tejas Prashanth Suraj Aralihalli Sumedh Basarkod T. Sudarshan S. Dhavala 27 4 0 19 May 2020
A Combined Data-driven and Physics-driven Method for Steady Heat Conduction Prediction using Deep Convolutional Neural Networks Hao Ma Xiangyu Y. Hu Yuxuan Zhang Nils Thuerey O. Haidn AI4CE 48 12 0 16 May 2020
MixML: A Unified Analysis of Weakly Consistent Parallel Learning Yucheng Lu J. Nash Christopher De Sa FedML 91 12 0 14 May 2020
An Extensive Study on Cross-Dataset Bias and Evaluation Metrics Interpretation for Machine Learning applied to Gastrointestinal Tract Abnormality Classification Vajira Thambawita Debesh Jha Hugo Lewi Hammer H. Johansen Dag Johansen Pål Halvorsen Michael A. Riegler 65 45 0 08 May 2020
DeePore: a deep learning workflow for rapid and comprehensive characterization of porous materials A. Rabbani M. Babaei R. Shams Ying Da Wang Traiwit Chung AI4CE 40 72 0 03 May 2020