SGDR: Stochastic Gradient Descent with Warm Restarts

13 August 2016

Papers citing "SGDR: Stochastic Gradient Descent with Warm Restarts"

50 / 4,280 papers shown

Title
Explaining Neural Scaling Laws Yasaman Bahri Ethan Dyer Jared Kaplan Jaehoon Lee Utkarsh Sharma 32 251 0 12 Feb 2021
ReRankMatch: Semi-Supervised Learning with Semantics-Oriented Similarity Representation T. Tran Mingu Kang Daeyoung Kim 24 1 0 12 Feb 2021
High-Performance Large-Scale Image Recognition Without Normalization Andrew Brock Soham De Samuel L. Smith Karen Simonyan VLM 226 513 0 11 Feb 2021
Distribution Adaptive INT8 Quantization for Training CNNs Kang Zhao Sida Huang Pan Pan Yinghan Li Yingya Zhang Zhenyu Gu Yinghui Xu MQ 32 63 0 09 Feb 2021
Deep Residual Learning in Spiking Neural Networks Wei Fang Zhaofei Yu Yanqing Chen Tiejun Huang T. Masquelier Yonghong Tian 126 481 0 08 Feb 2021
Efficient Certified Defenses Against Patch Attacks on Image Classifiers J. H. Metzen Maksym Yatsura AAML 31 40 0 08 Feb 2021
Zero Training Overhead Portfolios for Learning to Solve Combinatorial Problems Yiwei Bai Wenting Zhao Carla P. Gomes 16 0 0 05 Feb 2021
Multi-Stage Progressive Image Restoration Syed Waqas Zamir Aditya Arora Salman Khan Munawar Hayat Fahad Shahbaz Khan Ming-Hsuan Yang Ling Shao 128 1,461 0 04 Feb 2021
Zen-NAS: A Zero-Shot NAS for High-Performance Deep Image Recognition Ming Lin Pichao Wang Zhenhong Sun Hesen Chen Xiuyu Sun Qi Qian Hao Li Rong Jin 30 105 0 01 Feb 2021
Rescuing Deep Hashing from Dead Bits Problem Shu Zhao Dayan Wu Yucan Zhou Yue Liu Weiping Wang MQ 19 6 0 01 Feb 2021
Recurrent Localization Networks applied to the Lippmann-Schwinger Equation Conlain Kelly S. Kalidindi AI4CE 20 9 0 29 Jan 2021
Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNet Li-xin Yuan Yunpeng Chen Tao Wang Weihao Yu Yujun Shi Zihang Jiang Francis E. H. Tay Jiashi Feng Shuicheng Yan ViT 55 1,911 0 28 Jan 2021
Multilingual and cross-lingual document classification: A meta-learning approach Niels van der Heijden H. Yannakoudakis Pushkar Mishra Ekaterina Shutova VLM 16 24 0 27 Jan 2021
Supervised Momentum Contrastive Learning for Few-Shot Classification Orchid Majumder Avinash Ravichandran Subhransu Maji Alessandro Achille M. Polito Stefano Soatto SSL 21 12 0 26 Jan 2021
A Comparison of Approaches to Document-level Machine Translation Zhiyi Ma Sergey Edunov Michael Auli 23 13 0 26 Jan 2021
Joint Denoising and Demosaicking with Green Channel Prior for Real-world Burst Images Shi Guo Zhetong Liang Lei Zhang 19 36 0 25 Jan 2021
Supervision by Registration and Triangulation for Landmark Detection Xuanyi Dong Yi Yang S. Wei Xinshuo Weng Yaser Sheikh Shoou-I Yu 32 37 0 25 Jan 2021
Self-Adaptive Training: Bridging Supervised and Self-Supervised Learning Lang Huang Chaoning Zhang Hongyang R. Zhang SSL 36 24 0 21 Jan 2021
Characterizing signal propagation to close the performance gap in unnormalized ResNets Andrew Brock Soham De Samuel L. Smith 34 120 0 21 Jan 2021
GhostSR: Learning Ghost Features for Efficient Image Super-Resolution Ying Nie Kai Han Zhenhua Liu Chunjing Xu Yunhe Wang OOD 54 22 0 21 Jan 2021
A Survey on Ensemble Learning under the Era of Deep Learning Yongquan Yang Haijun Lv Ning Chen OOD 72 183 0 21 Jan 2021
Momentum^2 Teacher: Momentum Teacher with Momentum Statistics for Self-Supervised Learning Zeming Li Songtao Liu Jian Sun 51 16 0 19 Jan 2021
Self-Supervised Representation Learning from Flow Equivariance Yuwen Xiong Mengye Ren Wenyuan Zeng R. Urtasun SSL 29 28 0 16 Jan 2021
SelfMatch: Combining Contrastive Self-Supervision and Consistency for Semi-Supervised Learning Byoungjip Kim Jinho Choo Yeong-Dae Kwon Seongho Joe Seungjai Min Youngjune Gwon SSL 44 51 0 16 Jan 2021
Slot Machines: Discovering Winning Combinations of Random Weights in Neural Networks Maxwell Mbabilla Aladago Lorenzo Torresani 33 10 0 16 Jan 2021
In Defense of Pseudo-Labeling: An Uncertainty-Aware Pseudo-label Selection Framework for Semi-Supervised Learning Mamshad Nayeem Rizve Kevin Duarte Yogesh S Rawat M. Shah 250 510 0 15 Jan 2021
Automated Model Design and Benchmarking of 3D Deep Learning Models for COVID-19 Detection with Chest CT Scans Xin He Shihao Wang Xiaowen Chu Shaoshuai Shi J. Tang Xin Liu C. Yan Jiyong Zhang G. Ding 3DPC OOD 38 38 0 14 Jan 2021
Probabilistic Embeddings for Cross-Modal Retrieval Sanghyuk Chun Seong Joon Oh Rafael Sampaio de Rezende Yannis Kalantidis Diane Larlus UQCV 417 203 0 13 Jan 2021
Re-labeling ImageNet: from Single to Multi-Labels, from Global to Localized Labels Sangdoo Yun Seong Joon Oh Byeongho Heo Dongyoon Han Junsuk Choe Sanghyuk Chun 416 143 0 13 Jan 2021
Single-path Bit Sharing for Automatic Loss-aware Model Compression Jing Liu Bohan Zhuang Peng Chen Chunhua Shen Jianfei Cai Mingkui Tan MQ 22 7 0 13 Jan 2021
COVID-19 Prognosis via Self-Supervised Representation Learning and Multi-Image Prediction Anuroop Sriram Matthew Muckley Koustuv Sinha Farah E. Shamout Joelle Pineau Krzysztof J. Geras Lea Azour Y. Aphinyanaphongs N. Yakubova W. Moore MedIm 134 64 0 13 Jan 2021
Unlearnable Examples: Making Personal Data Unexploitable Hanxun Huang Xingjun Ma S. Erfani James Bailey Yisen Wang MIACV 158 191 0 13 Jan 2021
Take More Positives: An Empirical Study of Contrastive Learing in Unsupervised Person Re-Identification Xuanyu He Wei Emma Zhang Ran Song Qian Zhang X. Lan Lin Ma 41 1 0 12 Jan 2021
3D-ANAS: 3D Asymmetric Neural Architecture Search for Fast Hyperspectral Image Classification Haokui Zhang Chengrong Gong Yunpeng Bai Zongwen Bai Ying Li 19 27 0 12 Jan 2021
Self-Supervised Pretraining of 3D Features on any Point-Cloud Zaiwei Zhang Rohit Girdhar Armand Joulin Ishan Misra 3DPC 137 268 0 07 Jan 2021
Exploring Text-transformers in AAAI 2021 Shared Task: COVID-19 Fake News Detection in English Xiangyang Li Yu Xia Xiang Long Zheng Li Sujian Li 226 37 0 07 Jan 2021
AutoDropout: Learning Dropout Patterns to Regularize Deep Networks Hieu H. Pham Quoc V. Le 76 56 0 05 Jan 2021
Neural Architecture Search via Combinatorial Multi-Armed Bandit Hanxun Huang Xingjun Ma S. Erfani James Bailey 19 5 0 01 Jan 2021
Balance-Oriented Focal Loss with Linear Scheduling for Anchor Free Object Detection Hopyong Gil Sangwook Park Yusang Park Wongoo Han Juyean Hong Juneyoung Jung ObjD 35 1 0 26 Dec 2020
Variance Reduction on General Adaptive Stochastic Mirror Descent Wenjie Li Zhanyu Wang Yichen Zhang Guang Cheng 21 4 0 26 Dec 2020
Memory-Efficient Hierarchical Neural Architecture Search for Image Restoration Haokui Zhang Ying Li Hao Chen Chengrong Gong Zongwen Bai Chunhua Shen 33 14 0 24 Dec 2020
Adversarial Momentum-Contrastive Pre-Training Cong Xu Dan Li Min Yang SSL 27 15 0 24 Dec 2020
Learning with Retrospection Xiang Deng Zhongfei Zhang 35 17 0 24 Dec 2020
Exploring Data Augmentation for Multi-Modality 3D Object Detection Wenwei Zhang Zhe Wang Chen Change Loy 3DPC 30 24 0 23 Dec 2020
Knowledge Transfer Based Fine-grained Visual Classification Siqing Zhang Ruoyi Du Dongliang Chang Zhanyu Ma Jun Guo 28 3 0 21 Dec 2020
ResizeMix: Mixing Data with Preserved Object Information and True Labels Jie Qin Jiemin Fang Qian Zhang Wenyu Liu Xingang Wang Xinggang Wang 44 84 0 21 Dec 2020
Temporal LiDAR Frame Prediction for Autonomous Driving David Deng A. Zakhor 3DPC 19 14 0 17 Dec 2020
Distilling Optimal Neural Networks: Rapid Search in Diverse Spaces Bert Moons Parham Noorzad Andrii Skliar G. Mariani Dushyant Mehta Chris Lott Tijmen Blankevoort 158 43 0 16 Dec 2020
GTA: Global Temporal Attention for Video Action Understanding Bo He Xitong Yang Zuxuan Wu Hao Chen Ser-Nam Lim Abhinav Shrivastava ViT 33 27 0 15 Dec 2020
Attentional-Biased Stochastic Gradient Descent Q. Qi Yi Tian Xu Rong Jin W. Yin Tianbao Yang ODL 36 12 0 13 Dec 2020