SGDR: Stochastic Gradient Descent with Warm Restarts

13 August 2016

Papers citing "SGDR: Stochastic Gradient Descent with Warm Restarts"

50 / 4,280 papers shown

Title
Weight-Sharing Neural Architecture Search: A Battle to Shrink the Optimization Gap Lingxi Xie Xin Chen Kaifeng Bi Longhui Wei Yuhui Xu ... Lanfei Wang Anxiang Xiao Jianlong Chang Xiaopeng Zhang Qi Tian ViT 48 109 0 04 Aug 2020
1st Place Solutions of Waymo Open Dataset Challenge 2020 -- 2D Object Detection Track Zehao Huang Zehui Chen Qiaofei Li Hongkai Zhang Naiyan Wang 31 13 0 04 Aug 2020
LoCo: Local Contrastive Representation Learning Yuwen Xiong Mengye Ren R. Urtasun SSL DRL 40 69 0 04 Aug 2020
Temporal Context Aggregation for Video Retrieval with Contrastive Learning Jie Shao Xin Wen Bingchen Zhao Xiangyang Xue AI4TS 38 4 0 04 Aug 2020
HAMLET: A Hierarchical Multimodal Attention-based Human Activity Recognition Algorithm Md. Mofijul Islam Tariq Iqbal 22 80 0 03 Aug 2020
Evolving Multi-Resolution Pooling CNN for Monaural Singing Voice Separation Weitao Yuan Bofei Dong Shengbei Wang M. Unoki Wenwu Wang 31 12 0 03 Aug 2020
Unsupervised Disentanglement GAN for Domain Adaptive Person Re-Identification Yacine Khraimeche Guillaume-Alexandre Bilodeau David Steele Harshad Mahadik OOD 24 3 0 30 Jul 2020
Learning Video Representations from Textual Web Supervision Jonathan C. Stroud Zhichao Lu Chen Sun Jia Deng Rahul Sukthankar Cordelia Schmid David A. Ross SSL 40 48 0 29 Jul 2020
MLR-SNet: Transferable LR Schedules for Heterogeneous Tasks Jun Shu Yanwen Zhu Qian Zhao Zongben Xu Deyu Meng 28 7 0 29 Jul 2020
Stochastic Normalized Gradient Descent with Momentum for Large-Batch Training Shen-Yi Zhao Chang-Wei Shi Yin-Peng Xie Wu-Jun Li ODL 31 8 0 28 Jul 2020
CSER: Communication-efficient SGD with Error Reset Cong Xie Shuai Zheng Oluwasanmi Koyejo Indranil Gupta Mu Li Yanghua Peng 27 41 0 26 Jul 2020
Video Super Resolution Based on Deep Learning: A Comprehensive Survey Hongying Liu Zhubo Ruan Peng Zhao Chao Dong Fanhua Shang Yuanyuan Liu Linlin Yang Radu Timofte SupR 41 168 0 25 Jul 2020
Neural networks with late-phase weights J. Oswald Seijin Kobayashi Alexander Meulemans Christian Henning Benjamin Grewe João Sacramento 37 34 0 25 Jul 2020
KPRNet: Improving projection-based LiDAR semantic segmentation Deyvid Kochanov F. Karimi Nejadasl Olaf Booij 3DPC 25 73 0 24 Jul 2020
What and Where: Learn to Plug Adapters via NAS for Multi-Domain Learning Hanbin Zhao Hao Zeng Xin Qin Yongjian Fu Haibo Wang Bourahla Omar Xi Li 32 18 0 24 Jul 2020
End-to-end Learning of Compressible Features Saurabh Singh Sami Abu-El-Haija Nick Johnston Johannes Ballé Abhinav Shrivastava G. Toderici SSL 99 71 0 23 Jul 2020
TinyTL: Reduce Activations, Not Trainable Parameters for Efficient On-Device Learning Han Cai Chuang Gan Ligeng Zhu Song Han 33 52 0 22 Jul 2020
A Computation-Efficient CNN System for High-Quality Brain Tumor Segmentation Yanming Sun Chunyan Wang 8 27 0 22 Jul 2020
MovieNet: A Holistic Dataset for Movie Understanding Qingqiu Huang Yu Xiong Anyi Rao Jiaze Wang Dahua Lin VGen 49 235 0 21 Jul 2020
Balanced Meta-Softmax for Long-Tailed Visual Recognition Jiawei Ren Cunjun Yu Shunan Sheng Xiao Ma Haiyu Zhao Shuai Yi Hongsheng Li 170 552 0 21 Jul 2020
Video Representation Learning by Recognizing Temporal Transformations Simon Jenni Givi Meishvili Paolo Favaro 133 133 0 21 Jul 2020
Regularizing Deep Networks with Semantic Data Augmentation Yulin Wang Gao Huang Shiji Song Xuran Pan Yitong Xia Cheng Wu 24 155 0 21 Jul 2020
Pillar-based Object Detection for Autonomous Driving Yue Wang Alireza Fathi Abhijit Kundu David A. Ross C. Pantofaru Thomas Funkhouser Justin Solomon 3DPC 23 216 0 20 Jul 2020
Hierarchical Contrastive Motion Learning for Video Action Recognition Xitong Yang Xiaodong Yang Sifei Liu Deqing Sun L. Davis Jan Kautz SSL 45 13 0 20 Jul 2020
MCUNet: Tiny Deep Learning on IoT Devices Ji Lin Wei-Ming Chen Chengyue Wu J. Cohn Chuang Gan Song Han 93 482 0 20 Jul 2020
DBQ: A Differentiable Branch Quantizer for Lightweight Deep Neural Networks Hassan Dbouk Hetul Sanghvi M. Mehendale Naresh R Shanbhag MQ 25 9 0 19 Jul 2020
Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Clues Yuyang Qian Guojun Yin Lu Sheng Zixuan Chen Jing Shao CVBM 49 662 0 18 Jul 2020
CSI: Novelty Detection via Contrastive Learning on Distributionally Shifted Instances Jihoon Tack Sangwoo Mo Jongheon Jeong Jinwoo Shin OODD 11 589 0 16 Jul 2020
Gradient-based Hyperparameter Optimization Over Long Horizons P. Micaelli Amos Storkey 16 15 0 15 Jul 2020
Learning with Privileged Information for Efficient Image Super-Resolution Wonkyung Lee Junghyup Lee Dohyung Kim Bumsub Ham 33 134 0 15 Jul 2020
Single-partition adaptive Q-learning J. Araújo Mário A. T. Figueiredo M. Botto OffRL 20 2 0 14 Jul 2020
Graph Structure of Neural Networks Jiaxuan You J. Leskovec Kaiming He Saining Xie GNN 32 137 0 13 Jul 2020
Towards Practical Lipreading with Distilled and Efficient Models Pingchuan Ma Brais Martínez Stavros Petridis Maja Pantic 26 95 0 13 Jul 2020
VINNAS: Variational Inference-based Neural Network Architecture Search Martin Ferianc Hongxiang Fan Miguel R. D. Rodrigues 3DPC 19 6 0 12 Jul 2020
Incorporating Learnable Membrane Time Constant to Enhance Learning of Spiking Neural Networks Wei Fang Zhaofei Yu Yanqing Chen T. Masquelier Tiejun Huang Yonghong Tian 77 508 0 11 Jul 2020
Contrastive Training for Improved Out-of-Distribution Detection Jim Winkens Rudy Bunel Abhijit Guha Roy Robert Stanforth Vivek Natarajan ... Alan Karthikesalingam Simon A. A. Kohl taylan. cemgil S. M. Ali Eslami Olaf Ronneberger OODD 19 236 0 10 Jul 2020
Sample-based Regularization: A Transfer Learning Strategy Toward Better Generalization Yunho Jeon Yongseok Choi Jaesun Park Subin Yi D.-Y. Cho Jiwon Kim 14 6 0 10 Jul 2020
DCANet: Learning Connected Attentions for Convolutional Neural Networks Xu Ma Jingda Guo Sihai Tang Zhinan Qiao Qi Chen Qing Yang Song Fu 22 14 0 09 Jul 2020
A Global Stochastic Optimization Particle Filter Algorithm Mathieu Gerber Randal Douc 14 2 0 09 Jul 2020
Capturing scattered discriminative information using a deep architecture in acoustic scene classification Hye-jin Shim Jee-weon Jung Ju-ho Kim Ha-Jin Yu 23 3 0 09 Jul 2020
Deep Multi-task Learning for Facial Expression Recognition and Synthesis Based on Selective Feature Sharing Rui Zhao Tianshan Liu Jun Xiao D. Lun K. Lam CVBM 35 18 0 09 Jul 2020
Diverse Ensembles Improve Calibration Asa Cooper Stickland Iain Murray UQCV FedML 32 26 0 08 Jul 2020
Meta-Semi: A Meta-learning Approach for Semi-supervised Learning Yulin Wang Jiayi Guo Shiji Song Gao Huang 24 26 0 05 Jul 2020
Descending through a Crowded Valley - Benchmarking Deep Learning Optimizers Robin M. Schmidt Frank Schneider Philipp Hennig ODL 50 162 0 03 Jul 2020
Learn Faster and Forget Slower via Fast and Stable Task Adaptation Farshid Varno Lucas May Petry Lisa Di-Jorio Stan Matwin CLL 29 2 0 02 Jul 2020
Semi-Supervised NMF-CNN For Sound Event Detection T. K. Chan C. Chin Ye Li 28 18 0 02 Jul 2020
On Convergence-Diagnostic based Step Sizes for Stochastic Gradient Descent Scott Pesme Aymeric Dieuleveut Nicolas Flammarion 25 15 0 01 Jul 2020
Early-Learning Regularization Prevents Memorization of Noisy Labels Sheng Liu Jonathan Niles-Weed N. Razavian C. Fernandez‐Granda NoLa 36 557 0 30 Jun 2020
Guided Learning of Nonconvex Models through Successive Functional Gradient Optimization Rie Johnson Tong Zhang 6 8 0 30 Jun 2020
Theory-Inspired Path-Regularized Differential Network Architecture Search Pan Zhou Caiming Xiong R. Socher Guosheng Lin 12 55 0 30 Jun 2020