SGDR: Stochastic Gradient Descent with Warm Restarts

13 August 2016

Papers citing "SGDR: Stochastic Gradient Descent with Warm Restarts"

50 / 4,280 papers shown

Title
ADAHESSIAN: An Adaptive Second Order Optimizer for Machine Learning Z. Yao A. Gholami Sheng Shen Mustafa Mustafa Kurt Keutzer Michael W. Mahoney ODL 39 275 0 01 Jun 2020
Transferring Inductive Biases through Knowledge Distillation Samira Abnar Mostafa Dehghani Willem H. Zuidema 33 57 0 31 May 2020
HAT: Hardware-Aware Transformers for Efficient Natural Language Processing Hanrui Wang Zhanghao Wu Zhijian Liu Han Cai Ligeng Zhu Chuang Gan Song Han 49 258 0 28 May 2020
NDD20: A large-scale few-shot dolphin dataset for coarse and fine-grained categorisation Cameron Trotter Georgia Atkinson Matt Sharpe Kirsten Richardson Stephen McGough Nick Wright Ben Burville Per Berggren 15 21 0 27 May 2020
Permutation Matters: Anisotropic Convolutional Layer for Learning on Point Clouds Zhongpai Gao Guangtao Zhai Junchi Yan Xiaokang Yang 3DPC 27 2 0 27 May 2020
Hierarchical Feature Embedding for Attribute Recognition Jie Yang Jiarou Fan Yiru Wang Yige Wang Weihao Gan Lin Liu Wei Wu CVBM 27 42 0 23 May 2020
RankPose: Learning Generalised Feature with Rank Supervision for Head Pose Estimation Donggen Dai Wangkit Wong Zhuojun Chen SSL 30 13 0 22 May 2020
SpotFast Networks with Memory Augmented Lateral Transformers for Lipreading Peratham Wiriyathammabhum 28 8 0 21 May 2020
AOWS: Adaptive and optimal network width search with latency constraints Maxim Berman Leonid Pischulin N. Xu Matthew B. Blaschko Gérard Medioni 41 29 0 21 May 2020
Optimizing Neural Architecture Search using Limited GPU Time in a Dynamic Search Space: A Gene Expression Programming Approach J. H. Alves L. F. Oliveira 22 5 0 15 May 2020
Contextualizing ASR Lattice Rescoring with Hybrid Pointer Network Language Model Da-Rong Liu Chunxi Liu Frank Zhang Gabriel Synnaeve Yatharth Saraf Geoffrey Zweig 33 19 0 15 May 2020
Neural Networks Versus Conventional Filters for Inertial-Sensor-based Attitude Estimation Daniel Weber C. Gühmann Thomas Seel 22 34 0 14 May 2020
Dense-Resolution Network for Point Cloud Classification and Segmentation Shi Qiu Saeed Anwar Nick Barnes 3DPC 24 94 0 14 May 2020
Deep-Learning-based Automated Palm Tree Counting and Geolocation in Large Farms from Aerial Geotagged Images Adel Ammar Anis Koubaa 19 58 0 11 May 2020
Data-Free Network Quantization With Adversarial Knowledge Distillation Yoojin Choi Jihwan P. Choi Mostafa El-Khamy Jungwon Lee MQ 27 119 0 08 May 2020
NTIRE 2020 Challenge on Real Image Denoising: Dataset, Methods and Results A. Abdelhamed Mahmoud Afifi Radu Timofte M. S. Brown Yue Cao ... Tingniao Wang C. Lei Bin Liu Rajat Gupta Vineet Kumar 27 85 0 08 May 2020
Effective Data Fusion with Generalized Vegetation Index: Evidence from Land Cover Segmentation in Agriculture Hao Sheng Xiao Chen Jingyi Su Ram Rajagopal Andrew Y. Ng 34 31 0 07 May 2020
AutoSpeech: Neural Architecture Search for Speaker Recognition Shaojin Ding Tianlong Chen Xinyu Gong Weiwei Zha Zhangyang Wang 28 57 0 07 May 2020
Exploring the Loss Landscape in Neural Architecture Search Colin White Sam Nolen Yash Savani 10 26 0 06 May 2020
NTIRE 2020 Challenge on Perceptual Extreme Super-Resolution: Methods and Results Kaixuan Zhang Shuhang Gu Radu Timofte Taizhang Shang Qiuju Dai ... Huanrong Zhang Jeongki Min S. HrishikeshP. Densen Puthussery V. JijiC. SupR 37 50 0 03 May 2020
memeBot: Towards Automatic Image Meme Generation Aadhavan Sadasivam K. Gunasekar H. Davulcu Yezhou Yang 14 9 0 30 Apr 2020
Exploring Self-attention for Image Recognition Hengshuang Zhao Jiaya Jia V. Koltun SSL 52 774 0 28 Apr 2020
Lite Transformer with Long-Short Range Attention Zhanghao Wu Zhijian Liu Ji Lin Chengyue Wu Song Han 23 318 0 24 Apr 2020
Ultra Fast Structure-aware Deep Lane Detection Zequn Qin Huanyu Wang Xi Li 9 415 0 24 Apr 2020
PipeNet: Selective Modal Pipeline of Fusion Network for Multi-Modal Face Anti-Spoofing Qing Yang Xia Zhu Jong-Kae Fwu Yun Ye Ganmei You Yuan Zhu CVBM 30 26 0 24 Apr 2020
Convolution-Weight-Distribution Assumption: Rethinking the Criteria of Channel Pruning Zhongzhan Huang Wenqi Shao Xinjiang Wang Liang Lin Ping Luo 27 52 0 24 Apr 2020
SIPA: A Simple Framework for Efficient Networks Gihun Lee Sangmin Bae Jaehoon Oh Seyoung Yun 19 1 0 24 Apr 2020
Stage-Wise Neural Architecture Search Artur Jordão Fernando Akio M. Lie William Robson Schwartz 21 0 0 23 Apr 2020
YOLOv4: Optimal Speed and Accuracy of Object Detection Alexey Bochkovskiy Chien-Yao Wang H. Liao VLM ObjD 73 12,069 0 23 Apr 2020
How to track your dragon: A Multi-Attentional Framework for real-time RGB-D 6-DOF Object Pose Tracking Isidoros Marougkas Petros Koutras Nikos Kardaris Georgios Retsinas Georgia Chalvatzaki Petros Maragos VOT 43 7 0 21 Apr 2020
AdaX: Adaptive Gradient Descent with Exponential Long Term Memory Wenjie Li Zhaoyang Zhang Xinjiang Wang Ping Luo ODL 28 28 0 21 Apr 2020
Shape-Oriented Convolution Neural Network for Point Cloud Analysis Chaoyi Zhang Yang Song Lina Yao Weidong (Tom) Cai 3DPC 22 14 0 20 Apr 2020
LSM: Learning Subspace Minimization for Low-level Vision Chengzhou Tang Lu Yuan P. Tan 28 14 0 20 Apr 2020
OSLNet: Deep Small-Sample Classification with an Orthogonal Softmax Layer Xiaoxu Li Dongliang Chang Zhanyu Ma Zheng-Hua Tan Jing-Hao Xue Jie Cao Jingyi Yu Jun Guo 28 32 0 20 Apr 2020
ktrain: A Low-Code Library for Augmented Machine Learning Arun S. Maiya 28 146 0 19 Apr 2020
Adaptive Attention Span in Computer Vision Jerrod Parker Shakti Kumar Joe Roussy ViT VLM 14 2 0 18 Apr 2020
Finding Berries: Segmentation and Counting of Cranberries using Point Supervision and Shape Priors Peri Akiva Kristin J. Dana Peter Oudemans Michael Mars 46 28 0 18 Apr 2020
Detailed 2D-3D Joint Representation for Human-Object Interaction Yong-Lu Li Xinpeng Liu Han Lu Shiyi Wang Junqi Liu Jiefeng Li Cewu Lu 3DH 24 135 0 17 Apr 2020
Quantization Guided JPEG Artifact Correction Max Ehrlich L. Davis Ser-Nam Lim Abhinav Shrivastava 30 95 0 17 Apr 2020
Spatially Attentive Output Layer for Image Classification Ildoo Kim Woonhyuk Baek Sungwoong Kim 13 25 0 16 Apr 2020
Training with Quantization Noise for Extreme Model Compression Angela Fan Pierre Stock Benjamin Graham Edouard Grave Remi Gribonval Hervé Jégou Armand Joulin MQ 24 243 0 15 Apr 2020
On Learning Rates and Schrödinger Operators Bin Shi Weijie J. Su Michael I. Jordan 34 60 0 15 Apr 2020
Self6D: Self-Supervised Monocular 6D Object Pose Estimation Gu Wang Fabian Manhardt Jianzhun Shao Xiangyang Ji Nassir Navab Federico Tombari SSL MDE 32 134 0 14 Apr 2020
kDecay: Just adding k-decay items on Learning-Rate Schedule to improve Neural Networks Tao Zhang Wei Li 24 5 0 13 Apr 2020
Learning Spatial Relationships between Samples of Patent Image Shapes Juan Castorena Manish Bhattarai Diane Oyen 6 0 0 12 Apr 2020
Probabilistic Oriented Object Detection in Automotive Radar Xu Dong Pengluo Wang Pengyue Zhang Langechuan Liu 24 52 0 11 Apr 2020
X3D: Expanding Architectures for Efficient Video Recognition Christoph Feichtenhofer 78 1,004 0 09 Apr 2020
DeepCOVIDExplainer: Explainable COVID-19 Diagnosis Based on Chest X-ray Images Md. Rezaul Karim Till Dohmen Dietrich-Rebholz Schuhmann Stefan Decker Michael Cochez Oya Beyan 35 89 0 09 Apr 2020
Hierarchical Opacity Propagation for Image Matting Yaoyi Li Qin Xu Hongtao Lu 29 13 0 07 Apr 2020
Evolving Normalization-Activation Layers Hanxiao Liu Andrew Brock Karen Simonyan Quoc V. Le 25 79 0 06 Apr 2020