SGDR: Stochastic Gradient Descent with Warm Restarts

13 August 2016

Papers citing "SGDR: Stochastic Gradient Descent with Warm Restarts"

50 / 4,280 papers shown

Title
Lip-reading with Densely Connected Temporal Convolutional Networks Pingchuan Ma Yujiang Wang Jie Shen Stavros Petridis Maja Pantic 22 56 0 29 Sep 2020
Apollo: An Adaptive Parameter-wise Diagonal Quasi-Newton Method for Nonconvex Stochastic Optimization Xuezhe Ma ODL 34 31 0 28 Sep 2020
Group Whitening: Balancing Learning Efficiency and Representational Capacity Lei Huang Yi Zhou Li Liu Fan Zhu Ling Shao 33 21 0 28 Sep 2020
PERF-Net: Pose Empowered RGB-Flow Net Yinxiao Li Zhichao Lu Xuehan Xiong Jonathan Huang 3DH 45 17 0 28 Sep 2020
Long-Tailed Classification by Keeping the Good and Removing the Bad Momentum Causal Effect Kaihua Tang Jianqiang Huang Hanwang Zhang CML 25 438 0 28 Sep 2020
Enhancing MRI Brain Tumor Segmentation with an Additional Classification Network Hieu T. Nguyen T. Le T. Nguyen N. T. Nguyen 18 20 0 25 Sep 2020
G-SimCLR : Self-Supervised Contrastive Learning with Guided Projection via Pseudo Labelling Souradip Chakraborty A. R. Gosthipaty Sayak Paul SSL 13 17 0 25 Sep 2020
Multi-Frame to Single-Frame: Knowledge Distillation for 3D Object Detection Yue Wang Alireza Fathi Jiajun Wu Thomas Funkhouser Justin Solomon 3DPC 21 19 0 24 Sep 2020
Tasks, stability, architecture, and compute: Training more effective learned optimizers, and using them to train themselves Luke Metz Niru Maheswaranathan C. Freeman Ben Poole Jascha Narain Sohl-Dickstein 37 62 0 23 Sep 2020
Detecting Sound Events Using Convolutional Macaron Net With Pseudo Strong Labels T. K. Chan C. Chin 18 2 0 21 Sep 2020
Recognizing Micro-Expression in Video Clip with Adaptive Key-Frame Mining Min Peng Chongyang Wang Yuan Gao Tao Bi Tong Chen Yu Shi Xiangdong Zhou 35 4 0 19 Sep 2020
BNAS-v2: Memory-efficient and Performance-collapse-prevented Broad Neural Architecture Search Zixiang Ding Yaran Chen Nannan Li Dongbin Zhao 24 0 0 18 Sep 2020
Searching for Low-Bit Weights in Quantized Neural Networks Zhaohui Yang Yunhe Wang Kai Han Chunjing Xu Chao Xu Dacheng Tao Chang Xu MQ 30 82 0 18 Sep 2020
AAG: Self-Supervised Representation Learning by Auxiliary Augmentation with GNT-Xent Loss Yanlun Tu Jianxing Feng Yang Yang SSL 18 1 0 17 Sep 2020
Understanding Deformable Alignment in Video Super-Resolution Kelvin C. K. Chan Xintao Wang K. Yu Chao Dong Chen Change Loy 36 154 0 15 Sep 2020
Contrastive Cross-site Learning with Redesigned Net for COVID-19 CT Classification Zhao Wang Quande Liu Qi Dou OOD 26 162 0 15 Sep 2020
Manifold attack K. Tran Fred-Maurice Ngole-Mboula Jean-Luc Starck AAML OOD 23 0 0 13 Sep 2020
Contrastive Self-supervised Learning for Graph Classification Jiaqi Zeng P. Xie SSL 48 153 0 13 Sep 2020
Stochastic-YOLO: Efficient Probabilistic Object Detection under Dataset Shifts Tiago Azevedo R. D. Jong Matthew Mattina Partha P. Maji UQCV 18 15 0 07 Sep 2020
The 2ST-UNet for Pneumothorax Segmentation in Chest X-Rays using ResNet34 as a Backbone for U-Net Ayat Abedalla Malak Abdullah M. Al-Ayyoub E. Benkhelifa 30 13 0 06 Sep 2020
S-SGD: Symmetrical Stochastic Gradient Descent with Weight Noise Injection for Reaching Flat Minima Wonyong Sung Iksoo Choi Jinhwan Park Seokhyun Choi Sungho Shin ODL 30 7 0 05 Sep 2020
LAVARNET: Neural Network Modeling of Causal Variable Relationships for Multivariate Time Series Forecasting C. Koutlis Symeon Papadopoulos Emmanouil Schinas Y. Kompatsiaris CML AI4TS 6 15 0 02 Sep 2020
RecSal : Deep Recursive Supervision for Visual Saliency Prediction Sandeep Mishra Oindrila Saha 22 3 0 31 Aug 2020
NATS-Bench: Benchmarking NAS Algorithms for Architecture Topology and Size Xuanyi Dong Lu Liu Katarzyna Musial Bogdan Gabrys 10 163 0 28 Aug 2020
Visual Concept Reasoning Networks Taesup Kim Sungwoong Kim Yoshua Bengio 39 7 0 26 Aug 2020
Delving into Inter-Image Invariance for Unsupervised Visual Representations Jiahao Xie Xiaohang Zhan Ziwei Liu Yew-Soon Ong Chen Change Loy SSL VLM 21 58 0 26 Aug 2020
DeepSOCIAL: Social Distancing Monitoring and Infection Risk Assessment in COVID-19 Pandemic Mahdi Rezaei Mohsen Azarmi 24 154 0 26 Aug 2020
Improving Semi-supervised Federated Learning by Reducing the Gradient Diversity of Models Zhengming Zhang Yaoqing Yang Z. Yao Yujun Yan Joseph E. Gonzalez Michael W. Mahoney FedML 46 36 0 26 Aug 2020
Bias-Awareness for Zero-Shot Learning the Seen and Unseen William Thong Cees G. M. Snoek 22 5 0 25 Aug 2020
On estimating gaze by self-attention augmented convolutions Gabriel Lefundes Luciano Oliveira 3DH 21 3 0 25 Aug 2020
Deep Variational Network Toward Blind Image Restoration Zongsheng Yue Hongwei Yong Qian Zhao Lei Zhang Deyu Meng Kwan-Yen K. Wong 30 11 0 25 Aug 2020
Seesaw Loss for Long-Tailed Instance Segmentation Jiaqi Wang Wenwei Zhang Yuhang Zang Yuhang Cao Jiangmiao Pang Tao Gong Kai-xiang Chen Ziwei Liu Chen Change Loy Dahua Lin 18 234 0 23 Aug 2020
Surrogate NAS Benchmarks: Going Beyond the Limited Search Spaces of Tabular NAS Benchmarks Arber Zela Julien N. Siems Lucas Zimmer Jovita Lukasik Margret Keuper Frank Hutter 42 76 0 22 Aug 2020
Training Sparse Neural Networks using Compressed Sensing Jonathan W. Siegel Jianhong Chen Pengchuan Zhang Jinchao Xu 28 5 0 21 Aug 2020
Privacy Preserving Recalibration under Domain Shift Rachel Luo Shengjia Zhao Jiaming Song Jonathan Kuck Stefano Ermon Silvio Savarese 14 3 0 21 Aug 2020
Automating the assessment of biofouling in images using expert agreement as a gold standard N. Bloomfield Susan Wei Bartholomew Woodham Peter Wilkinson Andrew Robinson 19 18 0 21 Aug 2020
Learning Connectivity of Neural Networks from a Topological Perspective Kun Yuan Quanquan Li Jing Shao Junjie Yan 22 3 0 19 Aug 2020
AssembleNet++: Assembling Modality Representations via Attention Connections Michael S. Ryoo A. Piergiovanni Juhana Kangaspunta A. Angelova 15 44 0 18 Aug 2020
Source Free Domain Adaptation with Image Translation Yunzhong Hou Liang Zheng 17 35 0 17 Aug 2020
AntiDote: Attention-based Dynamic Optimization for Neural Network Runtime Efficiency Fuxun Yu Chenchen Liu Di Wang Yanzhi Wang Xiang Chen 11 7 0 14 Aug 2020
Deep Atrous Guided Filter for Image Restoration in Under Display Cameras Varun Sundar Sumanth Hegde D. Kothandaraman Kaushik Mitra 27 28 0 14 Aug 2020
Can weight sharing outperform random architecture search? An investigation with TuNAS Gabriel Bender Hanxiao Liu Bo Chen Grace Chu Shuyang Cheng Pieter-Jan Kindermans Quoc V. Le OOD 26 121 0 13 Aug 2020
A community-powered search of machine learning strategy space to find NMR property prediction models Lars A. Bratholm W. Gerrard Brandon M. Anderson Shaojie Bai Sunghwan Choi ... A. Torrubia Devin Willmott C. Butts David R. Glowacki Kaggle participants 32 16 0 13 Aug 2020
Deep Networks with Fast Retraining Wandong Zhang Yimin Yang Q. M. J. Wu AI4CE 19 2 0 13 Aug 2020
An Ensemble of Knowledge Sharing Models for Dynamic Hand Gesture Recognition K. Lai Svetlana Yanushkevich SLR 14 9 0 13 Aug 2020
Learning Temporally Invariant and Localizable Features via Data Augmentation for Video Recognition Taeoh Kim Hyeongmin Lee Myeongah Cho Hankook Lee Dong Heon Cho Sangyoun Lee 40 24 0 13 Aug 2020
PROFIT: A Novel Training Method for sub-4-bit MobileNet Models Eunhyeok Park S. Yoo MQ 10 85 0 11 Aug 2020
Complete parameter inference for GW150914 using deep learning Stephen R. Green J. Gair BDL 9 89 0 07 Aug 2020
Data-driven Meta-set Based Fine-Grained Visual Classification Chuanyi Zhang Yazhou Yao Xiangbo Shu Zechao Li Zhenmin Tang Qi Wu NoLa 21 2 0 06 Aug 2020
Learning Long-term Visual Dynamics with Region Proposal Interaction Networks Haozhi Qi Xiaolong Wang Deepak Pathak Yi Ma Jitendra Malik 33 57 0 05 Aug 2020