AngularGrad: A New Optimization Technique for Angular Convergence of Convolutional Neural Networks

21 May 2021

S. K. Roy

Mercedes Eugenia Paoletti

Papers citing "AngularGrad: A New Optimization Technique for Angular Convergence of Convolutional Neural Networks"

33 / 33 papers shown

Title
Generative Adversarial Networks Gilad Cohen Raja Giryes GAN 74 30,021 0 01 Mar 2022
On the Origin of Implicit Regularization in Stochastic Gradient Descent Samuel L. Smith Benoit Dherin David Barrett Soham De MLT 10 202 0 28 Jan 2021
AdaBelief Optimizer: Adapting Stepsizes by the Belief in Observed Gradients Juntang Zhuang Tommy M. Tang Yifan Ding S. Tatikonda Nicha Dvornek X. Papademetris James S. Duncan ODL 44 505 0 15 Oct 2020
Gradient Centralization: A New Optimization Technique for Deep Neural Networks Hongwei Yong Jianqiang Huang Xiansheng Hua Lei Zhang ODL 34 185 0 03 Apr 2020
Rethinking the Hyperparameters for Fine-tuning Hao Li Pratik Chaudhari Hao Yang Michael Lam Avinash Ravichandran Rahul Bhotika Stefano Soatto VLM 33 128 0 19 Feb 2020
diffGrad: An Optimization Method for Convolutional Neural Networks S. Dubey Soumendu Chakraborty Swalpa Kumar Roy Snehasis Mukherjee S. Singh B. B. Chaudhuri ODL 104 186 0 12 Sep 2019
On the Variance of the Adaptive Learning Rate and Beyond Liyuan Liu Haoming Jiang Pengcheng He Weizhu Chen Xiaodong Liu Jianfeng Gao Jiawei Han ODL 84 1,894 0 08 Aug 2019
Label Propagation for Deep Semi-supervised Learning Ahmet Iscen Giorgos Tolias Yannis Avrithis Ondřej Chum SSL 52 622 0 09 Apr 2019
Deep Feature Selection using a Teacher-Student Network A. Mirzaei V. Pourahmadi Mehran Soltani H. Sheikhzadeh 6 65 0 17 Mar 2019
Deeper and Wider Siamese Networks for Real-Time Visual Tracking Zhipeng Zhang Houwen Peng 62 843 0 07 Jan 2019
Closing the Generalization Gap of Adaptive Gradient Methods in Training Deep Neural Networks Jinghui Chen Dongruo Zhou Yiqi Tang Ziyan Yang Yuan Cao Quanquan Gu ODL 37 193 0 18 Jun 2018
Universality of Deep Convolutional Neural Networks Ding-Xuan Zhou HAI PINN 104 513 0 28 May 2018
Visualizing the Loss Landscape of Neural Nets Hao Li Zheng Xu Gavin Taylor Christoph Studer Tom Goldstein 216 1,873 0 28 Dec 2017
Dynamic Routing Between Capsules S. Sabour Nicholas Frosst Geoffrey E. Hinton 42 4,584 0 26 Oct 2017
Interactive Medical Image Segmentation using Deep Learning with Image-specific Fine-tuning Guotai Wang Wenqi Li Maria A. Zuluaga R. Pratt P. Patel ... T. Doel A. David Jan Deprest Sebastien Ourselin Tom Vercauteren 58 689 0 11 Oct 2017
Recent Trends in Deep Learning Based Natural Language Processing Tom Young Devamanyu Hazarika Soujanya Poria Min Zhang 56 2,832 0 09 Aug 2017
Deep Learning in Robotics: A Review of Recent Research H. A. Pierson Michael S. Gashler 3DV 36 267 0 22 Jul 2017
Deep Layer Aggregation Feng Yu Dequan Wang Evan Shelhamer Trevor Darrell AI4CE FAtt 54 1,317 0 20 Jul 2017
Dual Path Networks Yunpeng Chen Jianan Li Huaxin Xiao Xiaojie Jin Shuicheng Yan Jiashi Feng 63 828 0 06 Jul 2017
Residual Attention Network for Image Classification Fei Wang Mengqing Jiang Chao Qian Shuo Yang Cheng Li Honggang Zhang Xiaogang Wang Xiaoou Tang 86 3,299 0 23 Apr 2017
Online Learning Rate Adaptation with Hypergradient Descent A. G. Baydin R. Cornish David Martínez-Rubio Mark Schmidt Frank Wood ODL 39 245 0 14 Mar 2017
Aggregated Residual Transformations for Deep Neural Networks Saining Xie Ross B. Girshick Piotr Dollár Zhuowen Tu Kaiming He 383 10,281 0 16 Nov 2016
Understanding deep learning requires rethinking generalization Chiyuan Zhang Samy Bengio Moritz Hardt Benjamin Recht Oriol Vinyals HAI 208 4,612 0 10 Nov 2016
Densely Connected Convolutional Networks Gao Huang Zhuang Liu Laurens van der Maaten Kilian Q. Weinberger PINN 3DV 510 36,599 0 25 Aug 2016
Matching Networks for One Shot Learning Oriol Vinyals Charles Blundell Timothy Lillicrap Koray Kavukcuoglu Daan Wierstra VLM 228 7,286 0 13 Jun 2016
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 866 192,638 0 10 Dec 2015
Rethinking the Inception Architecture for Computer Vision Christian Szegedy Vincent Vanhoucke Sergey Ioffe Jonathon Shlens Z. Wojna 3DV BDL 282 27,231 0 02 Dec 2015
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 288 149,474 0 22 Dec 2014
Very Deep Convolutional Networks for Large-Scale Image Recognition Karen Simonyan Andrew Zisserman FAtt MDE 533 99,991 0 04 Sep 2014
ImageNet Large Scale Visual Recognition Challenge Olga Russakovsky Jia Deng Hao Su J. Krause S. Satheesh ... A. Karpathy A. Khosla Michael S. Bernstein Alexander C. Berg Li Fei-Fei VLM ObjD 717 39,383 0 01 Sep 2014
Deep Learning in Neural Networks: An Overview Jürgen Schmidhuber HAI 112 16,311 0 30 Apr 2014
Fine-Grained Visual Classification of Aircraft Subhransu Maji Esa Rahtu Arno Solin Matthew Blaschko Andrea Vedaldi 45 2,227 0 21 Jun 2013
On the difficulty of training Recurrent Neural Networks Razvan Pascanu Tomas Mikolov Yoshua Bengio ODL 84 5,318 0 21 Nov 2012