An overview of gradient descent optimization algorithms

15 September 2016

Papers citing "An overview of gradient descent optimization algorithms"

50 / 1,015 papers shown

Title
Learning Complex Spatial Behaviours in ABM: An Experimental Observational Study Sedar Olmez Daniel Birks A. Heppenstall AI4CE 13 3 0 04 Jan 2022
McXai: Local model-agnostic explanation as two games Yiran Huang Nicole Schaal Michael Hefenbrock Yexu Zhou T. Riedel Likun Fang Michael Beigl FAtt 25 4 0 04 Jan 2022
Recursive Least-Squares Estimator-Aided Online Learning for Visual Tracking Jin Gao Yan Lu Xiaojuan Qi Yutong Kou Bing Li Liang Li Shan Yu Weiming Hu 16 1 0 28 Dec 2021
To Supervise or Not: How to Effectively Learn Wireless Interference Management Models? Bingqing Song Haoran Sun Wenqiang Pu Sijia Liu Min-Fong Hong 20 0 0 28 Dec 2021
Artifact Reduction in Fundus Imaging using Cycle Consistent Adversarial Neural Networks S. Koushik Dr. K. G. Srinivasa GAN MedIm 16 0 0 25 Dec 2021
A machine learning analysis of the relationship between some underlying medical conditions and COVID-19 susceptibility Mostafa Rezapour Colin A. Varady 11 4 0 24 Dec 2021
Data driven design of optical resonators Joeri Lenaerts Hannah Pinson Vincent Ginis 14 0 0 21 Dec 2021
Efficient Visual Tracking with Exemplar Transformers Philippe Blatter Menelaos Kanakis Martin Danelljan Luc Van Gool ViT 21 80 0 17 Dec 2021
Visual Microfossil Identification via Deep Metric Learning Tayfun Karaderi T. Burghardt Allison Y. Hsiang Jacob Ramaer D. Schmidt 24 0 0 17 Dec 2021
Convergence proof for stochastic gradient descent in the training of deep neural networks with ReLU activation for constant target functions Martin Hutzenthaler Arnulf Jentzen Katharina Pohl Adrian Riekert Luca Scarpa MLT 34 6 0 13 Dec 2021
Radar Occupancy Prediction with Lidar Supervision while Preserving Long-Range Sensing and Penetrating Capabilities P. Kung Chieh-Chih Wang Wen-Chieh Lin 24 12 0 08 Dec 2021
A novel multi-view deep learning approach for BI-RADS and density assessment of mammograms Huyen T. X. Nguyen Sam B. Tran D. Nguyen Hieu H. Pham H. Nguyen 24 20 0 08 Dec 2021
Generative Modeling of Turbulence Claudia Drygala Benjamin Winhart F. Mare Hanno Gottschalk GAN AI4CE 19 38 0 05 Dec 2021
Toward Real-World Voice Disorder Classification Heng-Cheng Kuo Yu-Peng Hsieh Huan-Hsin Tseng Chi-Te Wang Shih-Hau Fang Yu Tsao 32 1 0 05 Dec 2021
Provably Valid and Diverse Mutations of Real-World Media Data for DNN Testing Yuanyuan Yuan Qi Pang Shuai Wang DiffM AAML MedIm 39 6 0 03 Dec 2021
Certified Adversarial Defenses Meet Out-of-Distribution Corruptions: Benchmarking Robustness and Simple Baselines Jiachen Sun Akshay Mehra B. Kailkhura Pin-Yu Chen Dan Hendrycks Jihun Hamm Z. Morley Mao AAML 41 21 0 01 Dec 2021
Convergence of GANs Training: A Game and Stochastic Control Methodology Othmane Mounjid Xin Guo GAN 30 2 0 01 Dec 2021
Predicting Poverty Level from Satellite Imagery using Deep Neural Networks Varun Chitturi Zaid Nabulsi 34 7 0 30 Nov 2021
Neuron with Steady Response Leads to Better Generalization Qiang Fu Lun Du Haitao Mao Xu Chen Wei Fang Shi Han Dongmei Zhang 33 5 0 30 Nov 2021
Buildings Classification using Very High Resolution Satellite Imagery Mohammad Dimassi A. Samhat Mohammad Zaraket Jamal Haydar Mustafa Shukor A. Ghandour 19 3 0 29 Nov 2021
Variational Gibbs Inference for Statistical Model Estimation from Incomplete Data Vaidotas Šimkus Benjamin Rhodes Michael U. Gutmann 20 9 0 25 Nov 2021
A Letter on Convergence of In-Parameter-Linear Nonlinear Neural Architectures with Gradient Learnings I. Bukovský G. Dohnal P. Benes K. Ichiji N. Homma 9 3 0 25 Nov 2021
COMET: A Novel Memory-Efficient Deep Learning Training Framework by Using Error-Bounded Lossy Compression Sian Jin Chengming Zhang Xintong Jiang Yunhe Feng Hui Guan Guanpeng Li Shuaiwen Leon Song Dingwen Tao 30 23 0 18 Nov 2021
Using Computational Intelligence for solving the Ornstein-Zernike equation Edwin Bedolla 21 0 0 17 Nov 2021
Learning Free-Surface Flow with Physics-Informed Neural Networks Raphael Leiteritz Marcel Hurler Dirk Pflüger PINN AI4CE 33 7 0 17 Nov 2021
Edge-Native Intelligence for 6G Communications Driven by Federated Learning: A Survey of Trends and Challenges Mohammad M. Al-Quraan Lina S. Mohjazi Lina Bariah A. Centeno A. Zoha Sami Muhaidat Mérouane Debbah Muhammad Ali Imran 22 62 0 14 Nov 2021
GraSSNet: Graph Soft Sensing Neural Networks Yu Huang Chao Zhang Jaswanth K. Yella Sergei Petrov Xiaoye Qian Yufei Tang Xingquan Zhu Sthitie Bom 47 21 0 12 Nov 2021
Learning to ignore: rethinking attention in CNNs Firas Laakom K. Chumachenko Jenni Raitoharju Alexandros Iosifidis Moncef Gabbouj 66 7 0 10 Nov 2021
GHRS: Graph-based Hybrid Recommendation System with Application to Movie Recommendation Zahra Zamanzadeh Darban Mohammad Hadi Valipour 34 103 0 06 Nov 2021
Finite-Time Consensus Learning for Decentralized Optimization with Nonlinear Gossiping Junya Chen Sijia Wang Lawrence Carin Chenyang Tao 8 3 0 04 Nov 2021
Human Attention in Fine-grained Classification Yao Rong Wenjia Xu Zeynep Akata Enkelejda Kasneci 45 35 0 02 Nov 2021
Large-Scale Deep Learning Optimizations: A Comprehensive Survey Xiaoxin He Fuzhao Xue Xiaozhe Ren Yang You 32 14 0 01 Nov 2021
Can we learn gradients by Hamiltonian Neural Networks? A. Timofeev A. Afonin Yehao Liu 22 0 0 31 Oct 2021
Smart(Sampling)Augment: Optimal and Efficient Data Augmentation for Semantic Segmentation Misgana Negassi Diane Wagner A. Reiterer 19 13 0 31 Oct 2021
Multi-Task Learning based Convolutional Models with Curriculum Learning for the Anisotropic Reynolds Stress Tensor in Turbulent Duct Flow Haitz Sáez de Ocáriz Borde David Sondak P. Protopapas AI4CE 20 3 0 30 Oct 2021
Parameter Prediction for Unseen Deep Architectures Boris Knyazev M. Drozdzal Graham W. Taylor Adriana Romero Soriano OOD 31 79 0 25 Oct 2021
CeyMo: See More on Roads -- A Novel Benchmark Dataset for Road Marking Detection Junhui Yin S. Hemachandra Damith Anhettigama Shenali Kariyawasam Zhanyu Ma Jun Guo ObjD 16 24 0 22 Oct 2021
Sinkformers: Transformers with Doubly Stochastic Attention Michael E. Sander Pierre Ablin Mathieu Blondel Gabriel Peyré 34 77 0 22 Oct 2021
Improving Face Recognition with Large Age Gaps by Learning to Distinguish Children Jungsoo Lee Jooyeol Yun Sunghyun Park Yonggyu Kim Jaegul Choo CVBM 21 6 0 22 Oct 2021
Repaint: Improving the Generalization of Down-Stream Visual Tasks by Generating Multiple Instances of Training Examples Amin Banitalebi-Dehkordi Yong Zhang 28 7 0 20 Oct 2021
EmbRace: Accelerating Sparse Communication for Distributed Training of NLP Neural Networks Shengwei Li Zhiquan Lai Dongsheng Li Yiming Zhang Xiangyu Ye Yabo Duan FedML 17 2 0 18 Oct 2021
S-Cyc: A Learning Rate Schedule for Iterative Pruning of ReLU-based Networks Shiyu Liu Chong Min John Tan Mehul Motani CLL 29 4 0 17 Oct 2021
GaussED: A Probabilistic Programming Language for Sequential Experimental Design Matthew A. Fisher Onur Teymur Chris J. Oates 40 1 0 15 Oct 2021
Federated learning and next generation wireless communications: A survey on bidirectional relationship Debaditya Shome Omer Waqar Wali Ullah Khan 46 31 0 14 Oct 2021
DeepOrder: Deep Learning for Test Case Prioritization in Continuous Integration Testing Aizaz Sharif D. Marijan Marius Liaaen 35 29 0 14 Oct 2021
Adaptive Elastic Training for Sparse Deep Learning on Heterogeneous Multi-GPU Servers Yujing Ma Florin Rusu Kesheng Wu A. Sim 46 3 0 13 Oct 2021
Trivial or impossible -- dichotomous data difficulty masks model differences (on ImageNet and beyond) Kristof Meding Luca M. Schulze Buschoff Robert Geirhos Felix Wichmann 36 41 0 12 Oct 2021
Learning to Coordinate in Multi-Agent Systems: A Coordinated Actor-Critic Algorithm and Finite-Time Guarantees Siliang Zeng Tianyi Chen Alfredo García Mingyi Hong 49 11 0 11 Oct 2021
Polygon Area Decomposition Using a Compactness Metric M. Wzorek Cyrille Berger Patrick Doherty 11 1 0 08 Oct 2021
Label Propagation across Graphs: Node Classification using Graph Neural Tangent Kernels Artun Bayer Arindam Chowdhury Santiago Segarra 21 5 0 07 Oct 2021