AngularGrad: A New Optimization Technique for Angular Convergence of Convolutional Neural Networks

21 May 2021

S. K. Roy

Mercedes Eugenia Paoletti

Papers citing "AngularGrad: A New Optimization Technique for Angular Convergence of Convolutional Neural Networks"

33 / 33 papers shown

Title
Generative Adversarial Networks Gilad Cohen Raja Giryes GAN 96 30,021 0 01 Mar 2022
On the Origin of Implicit Regularization in Stochastic Gradient Descent Samuel L. Smith Benoit Dherin David Barrett Soham De MLT 12 202 0 28 Jan 2021
AdaBelief Optimizer: Adapting Stepsizes by the Belief in Observed Gradients Juntang Zhuang Tommy M. Tang Yifan Ding S. Tatikonda Nicha Dvornek X. Papademetris James S. Duncan ODL 68 505 0 15 Oct 2020
Gradient Centralization: A New Optimization Technique for Deep Neural Networks Hongwei Yong Jianqiang Huang Xiansheng Hua Lei Zhang ODL 39 185 0 03 Apr 2020
Rethinking the Hyperparameters for Fine-tuning Hao Li Pratik Chaudhari Hao Yang Michael Lam Avinash Ravichandran Rahul Bhotika Stefano Soatto VLM 35 128 0 19 Feb 2020
diffGrad: An Optimization Method for Convolutional Neural Networks S. Dubey Soumendu Chakraborty Swalpa Kumar Roy Snehasis Mukherjee S. Singh B. B. Chaudhuri ODL 106 186 0 12 Sep 2019
On the Variance of the Adaptive Learning Rate and Beyond Liyuan Liu Haoming Jiang Pengcheng He Weizhu Chen Xiaodong Liu Jianfeng Gao Jiawei Han ODL 110 1,894 0 08 Aug 2019
Label Propagation for Deep Semi-supervised Learning Ahmet Iscen Giorgos Tolias Yannis Avrithis Ondřej Chum SSL 56 622 0 09 Apr 2019
Deep Feature Selection using a Teacher-Student Network A. Mirzaei V. Pourahmadi Mehran Soltani H. Sheikhzadeh 10 65 0 17 Mar 2019
Deeper and Wider Siamese Networks for Real-Time Visual Tracking Zhipeng Zhang Houwen Peng 64 843 0 07 Jan 2019
Closing the Generalization Gap of Adaptive Gradient Methods in Training Deep Neural Networks Jinghui Chen Dongruo Zhou Yiqi Tang Ziyan Yang Yuan Cao Quanquan Gu ODL 42 193 0 18 Jun 2018
Universality of Deep Convolutional Neural Networks Ding-Xuan Zhou HAI PINN 174 513 0 28 May 2018
Visualizing the Loss Landscape of Neural Nets Hao Li Zheng Xu Gavin Taylor Christoph Studer Tom Goldstein 222 1,873 0 28 Dec 2017
Dynamic Routing Between Capsules S. Sabour Nicholas Frosst Geoffrey E. Hinton 74 4,584 0 26 Oct 2017
Interactive Medical Image Segmentation using Deep Learning with Image-specific Fine-tuning Guotai Wang Wenqi Li Maria A. Zuluaga R. Pratt P. Patel ... T. Doel A. David Jan Deprest Sebastien Ourselin Tom Vercauteren 58 689 0 11 Oct 2017
Recent Trends in Deep Learning Based Natural Language Processing Tom Young Devamanyu Hazarika Soujanya Poria Min Zhang 58 2,832 0 09 Aug 2017
Deep Learning in Robotics: A Review of Recent Research H. A. Pierson Michael S. Gashler 3DV 41 267 0 22 Jul 2017
Deep Layer Aggregation Feng Yu Dequan Wang Evan Shelhamer Trevor Darrell AI4CE FAtt 56 1,317 0 20 Jul 2017
Dual Path Networks Yunpeng Chen Jianan Li Huaxin Xiao Xiaojie Jin Shuicheng Yan Jiashi Feng 73 828 0 06 Jul 2017
Residual Attention Network for Image Classification Fei Wang Mengqing Jiang Chao Qian Shuo Yang Cheng Li Honggang Zhang Xiaogang Wang Xiaoou Tang 88 3,299 0 23 Apr 2017
Online Learning Rate Adaptation with Hypergradient Descent A. G. Baydin R. Cornish David Martínez-Rubio Mark Schmidt Frank Wood ODL 44 245 0 14 Mar 2017
Aggregated Residual Transformations for Deep Neural Networks Saining Xie Ross B. Girshick Piotr Dollár Zhuowen Tu Kaiming He 407 10,281 0 16 Nov 2016
Understanding deep learning requires rethinking generalization Chiyuan Zhang Samy Bengio Moritz Hardt Benjamin Recht Oriol Vinyals HAI 238 4,612 0 10 Nov 2016
Densely Connected Convolutional Networks Gao Huang Zhuang Liu Laurens van der Maaten Kilian Q. Weinberger PINN 3DV 573 36,599 0 25 Aug 2016
Matching Networks for One Shot Learning Oriol Vinyals Charles Blundell Timothy Lillicrap Koray Kavukcuoglu Daan Wierstra VLM 259 7,286 0 13 Jun 2016
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 1.1K 192,638 0 10 Dec 2015
Rethinking the Inception Architecture for Computer Vision Christian Szegedy Vincent Vanhoucke Sergey Ioffe Jonathon Shlens Z. Wojna 3DV BDL 392 27,231 0 02 Dec 2015
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 535 149,474 0 22 Dec 2014
Very Deep Convolutional Networks for Large-Scale Image Recognition Karen Simonyan Andrew Zisserman FAtt MDE 713 99,991 0 04 Sep 2014
ImageNet Large Scale Visual Recognition Challenge Olga Russakovsky Jia Deng Hao Su J. Krause S. Satheesh ... A. Karpathy A. Khosla Michael S. Bernstein Alexander C. Berg Li Fei-Fei VLM ObjD 903 39,383 0 01 Sep 2014
Deep Learning in Neural Networks: An Overview Jürgen Schmidhuber HAI 142 16,311 0 30 Apr 2014
Fine-Grained Visual Classification of Aircraft Subhransu Maji Esa Rahtu Arno Solin Matthew Blaschko Andrea Vedaldi 55 2,227 0 21 Jun 2013
On the difficulty of training Recurrent Neural Networks Razvan Pascanu Tomas Mikolov Yoshua Bengio ODL 95 5,318 0 21 Nov 2012