SGDR: Stochastic Gradient Descent with Warm Restarts

13 August 2016

Papers citing "SGDR: Stochastic Gradient Descent with Warm Restarts"

50 / 4,280 papers shown

Title
AdaBits: Neural Network Quantization with Adaptive Bit-Widths Qing Jin Linjie Yang Zhenyu A. Liao MQ 24 123 0 20 Dec 2019
Making Better Mistakes: Leveraging Class Hierarchies with Deep Networks Luca Bertinetto Romain Mueller Konstantinos Tertikas Sina Samangooei Nicholas A. Lord OOD 34 132 0 19 Dec 2019
Optimization for deep learning: theory and algorithms Ruoyu Sun ODL 30 168 0 19 Dec 2019
Learning to Observe: Approximating Human Perceptual Thresholds for Detection of Suprathreshold Image Transformations Alan Dolhasz Carlo Harvey Ian Williams AAML 6 4 0 13 Dec 2019
End-to-End Learning of Geometrical Shaping Maximizing Generalized Mutual Information Kadir Gümüs A. Alvarado Bin Chen Christian Hager E. Agrell 11 49 0 11 Dec 2019
AugMix: A Simple Data Processing Method to Improve Robustness and Uncertainty Dan Hendrycks Norman Mu E. D. Cubuk Barret Zoph Justin Gilmer Balaji Lakshminarayanan OOD UQCV 50 1,280 0 05 Dec 2019
Why Should we Combine Training and Post-Training Methods for Out-of-Distribution Detection? Aristotelis-Angelos Papadopoulos N. Shaikh Mohammad Reza Rajati OODD 11 0 0 05 Dec 2019
Detecting Hardly Visible Roads in Low-Resolution Satellite Time Series Data Stefan Oehmcke Christoffer Thrysoe Andreas Borgstad M. V. Salles Martin Brandt Fabian Gieseke 6 11 0 04 Dec 2019
Self-Supervised Learning of Pretext-Invariant Representations Ishan Misra Laurens van der Maaten SSL VLM 39 1,447 0 04 Dec 2019
Multi-Objective Evolutionary Design of Deep Convolutional Neural Networks for Image Classification Zhichao Lu Ian Whalen Yashesh D. Dhebar Kalyanmoy Deb E. Goodman W. Banzhaf Vishnu Boddeti 14 10 0 03 Dec 2019
Neural Predictor for Neural Architecture Search W. Wen Hanxiao Liu H. Li Yiran Chen Gabriel Bender Pieter-Jan Kindermans 46 194 0 02 Dec 2019
Gate-Shift Networks for Video Action Recognition Swathikiran Sudhakaran Sergio Escalera Oswald Lanz 3DPC 19 155 0 01 Dec 2019
What's Hidden in a Randomly Weighted Neural Network? Vivek Ramanujan Mitchell Wortsman Aniruddha Kembhavi Ali Farhadi Mohammad Rastegari 25 351 0 29 Nov 2019
Unlocking the Full Potential of Small Data with Diverse Supervision Ziqi Pang Zhiyuan Hu P. Tokmakov Yu-xiong Wang M. Hebert 8 0 0 29 Nov 2019
Geometric Back-projection Network for Point Cloud Classification S. Qiu Saeed Anwar Nick Barnes 3DPC 36 3 0 28 Nov 2019
Augmented Random Search for Quadcopter Control: An alternative to Reinforcement Learning A. K. Tiwari Sandeep Varma Nadimpalli 20 2 0 28 Nov 2019
Learning Efficient Video Representation with Video Shuffle Networks Pingchuan Ma Yao Zhou Yu Lu Wayne Zhang 27 7 0 26 Nov 2019
Automatic Post-Stroke Lesion Segmentation on MR Images using 3D Residual Convolutional Neural Network Naofumi Tomita Steven Jiang M. Maeder Saeed Hassanpour 33 58 0 25 Nov 2019
Optimizing Data Usage via Differentiable Rewards Xinyi Wang Hieu H. Pham Paul Michel Antonios Anastasopoulos J. Carbonell Graham Neubig 23 60 0 22 Nov 2019
Learning Spatial Fusion for Single-Shot Object Detection Songtao Liu Di Huang Yunhong Wang ObjD 18 573 0 21 Nov 2019
EnAET: A Self-Trained framework for Semi-Supervised and Supervised Learning with Ensemble Transformations Tianlin Li Daisuke Kihara Jiebo Luo Guo-Jun Qi OOD 27 34 0 21 Nov 2019
AutoShrink: A Topology-aware NAS for Discovering Efficient Neural Architecture Tunhou Zhang Hsin-Pai Cheng Zhenwen Li Feng Yan Chengyu Huang H. Li Yiran Chen 16 9 0 21 Nov 2019
Dual Reconstruction with Densely Connected Residual Network for Single Image Super-Resolution Chih-Chung Hsu Chia-Hsiang Lin SupR 11 10 0 20 Nov 2019
Open Cross-Domain Visual Search William Thong Pascal Mettes Cees G. M. Snoek 30 13 0 19 Nov 2019
Rethinking deep active learning: Using unlabeled data at model training Oriane Siméoni Mateusz Budnik Yannis Avrithis G. Gravier HAI 30 79 0 19 Nov 2019
GraphTER: Unsupervised Learning of Graph Transformation Equivariant Representations via Auto-Encoding Node-wise Transformations Xiang Gao Wei Hu Guo-Jun Qi 3DPC 28 43 0 19 Nov 2019
Neural Network Pruning with Residual-Connections and Limited-Data Jian-Hao Luo Jianxin Wu 22 112 0 19 Nov 2019
ImmuNeCS: Neural Committee Search by an Artificial Immune System L. Frachon Wei Pang George Macleod Coghill 13 9 0 18 Nov 2019
Graph Neural Ordinary Differential Equations Michael Poli Stefano Massaroli Junyoung Park Atsushi Yamashita Hajime Asama Jinkyoo Park AI4CE 51 154 0 18 Nov 2019
Preparing Lessons: Improve Knowledge Distillation with Better Supervision Tiancheng Wen Shenqi Lai Xueming Qian 27 68 0 18 Nov 2019
Real-Time Semantic Segmentation via Multiply Spatial Fusion Network Haiyang Si Zhiqiang Zhang Feifan Lv Gang Yu Feng Lu SSeg 31 66 0 17 Nov 2019
A Subword Level Language Model for Bangla Language Aisha Khatun Anisur Rahman Hemayet Ahmed Chowdhury Md. Saiful Islam A. Tasnim 20 4 0 15 Nov 2019
Understanding the Disharmony between Weight Normalization Family and Weight Decay: $ε-$ shifted $L_2$ Regularizer Li Xiang Chen Shuo Xia Yan Yang Jian 34 2 0 14 Nov 2019
Accelerating cardiac cine MRI using a deep learning-based ESPIRiT reconstruction Christopher M. Sandino P. Lai S. Vasanawala Joseph Y. Cheng 16 3 0 13 Nov 2019
Detection of speech events and speaker characteristics through photo-plethysmographic signal neural processing Guillermo Cámbara Jordi Luque Mireia Farrús 11 3 0 12 Nov 2019
E.T.-RNN: Applying Deep Learning to Credit Loan Applications Dmitrii Babaev M. Savchenko Alexander Tuzhilin Dmitrii Umerenkov 27 87 0 06 Nov 2019
CANet: Cross-disease Attention Network for Joint Diabetic Retinopathy and Diabetic Macular Edema Grading Xuelong Li Xiaowei Hu Lequan Yu Lei Zhu Chi-Wing Fu Pheng-Ann Heng MedIm 16 297 0 04 Nov 2019
Self-Supervised Difference Detection for Weakly-Supervised Semantic Segmentation Wataru Shimoda Keiji Yanai 22 136 0 04 Nov 2019
The reliability of a deep learning model in clinical out-of-distribution MRI data: a multicohort study G. Mårtensson D. Ferreira T. Granberg L. Cavallin K. Oppedal ... H. Soininen S. Lovestone A. Simmons D. Aarsland E. Westman OOD 24 135 0 01 Nov 2019
ACE: Adaptive Confusion Energy for Natural World Data Distribution Yen-Chi Hsu Cheng-Yao Hong Ding-Jie Chen Ming-Sui Lee D. Geiger Tyng-Luh Liu 17 4 0 28 Oct 2019
Towards calibrated and scalable uncertainty representations for neural networks Nabeel Seedat Christopher Kanan UQCV 34 19 0 28 Oct 2019
Segmenting Ships in Satellite Imagery With Squeeze and Excitation U-Net R. Venkatesh Anand Metha SSeg 21 4 0 27 Oct 2019
Cross-Channel Intragroup Sparsity Neural Network Zhilin Yu Chao Wang Xin Wang Qing Wu Yong Zhao Xundong Wu 17 1 0 26 Oct 2019
Reducing Domain Gap by Reducing Style Bias Hyeonseob Nam HyunJae Lee Jongchan Park Wonjun Yoon Donggeun Yoo 28 61 0 25 Oct 2019
A Simple Dynamic Learning Rate Tuning Algorithm For Automated Training of DNNs Koyel Mukherjee Alind Khare Ashish Verma 22 15 0 25 Oct 2019
Torchreid: A Library for Deep Learning Person Re-Identification in Pytorch Kaiyang Zhou Tao Xiang 38 117 0 22 Oct 2019
Self-Correction for Human Parsing Peike Li Yunqiu Xu Yunchao Wei Yezhou Yang 27 326 0 22 Oct 2019
Decoupling Representation and Classifier for Long-Tailed Recognition Bingyi Kang Saining Xie Marcus Rohrbach Zhicheng Yan Albert Gordo Jiashi Feng Yannis Kalantidis OODD 100 1,190 0 21 Oct 2019
MARTHE: Scheduling the Learning Rate Via Online Hypergradients Michele Donini Luca Franceschi Massimiliano Pontil Orchid Majumder P. Frasconi 27 7 0 18 Oct 2019
Automatic Data Augmentation by Learning the Deterministic Policy Yinghuan Shi Tiexin Qin Yong Liu Jiwen Lu Yang Gao Dinggang Shen 31 4 0 18 Oct 2019