SGDR: Stochastic Gradient Descent with Warm Restarts

13 August 2016

Papers citing "SGDR: Stochastic Gradient Descent with Warm Restarts"

50 / 4,294 papers shown

Title
AdvParams: An Active DNN Intellectual Property Protection Technique via Adversarial Perturbation Based Parameter Encryption Mingfu Xue Zhiyu Wu Jian Wang Yushu Zhang Weiqiang Liu AAML 11 27 0 28 May 2021
Drawing Multiple Augmentation Samples Per Image During Training Efficiently Decreases Test Error Stanislav Fort Andrew Brock Razvan Pascanu Soham De Samuel L. Smith 31 31 0 27 May 2021
A framework for data-driven solution and parameter estimation of PDEs using conditional generative adversarial networks T. Kadeethum Daniel O’Malley J. Fuhg Youngsoo Choi Jonghyun Lee Hari S. Viswanathan N. Bouklas AI4CE 35 88 0 27 May 2021
CogView: Mastering Text-to-Image Generation via Transformers Ming Ding Zhuoyi Yang Wenyi Hong Wendi Zheng Chang Zhou ... Junyang Lin Xu Zou Zhou Shao Hongxia Yang Jie Tang ViT VLM 54 772 0 26 May 2021
Estimating the Uncertainty of Neural Network Forecasts for Influenza Prevalence Using Web Search Activity Michael Morris Peter A. Hayes Ingemar J. Cox Vasileios Lampos 26 1 0 26 May 2021
Scaling Properties of Deep Residual Networks A. Cohen R. Cont Alain Rossier Renyuan Xu 30 18 0 25 May 2021
Density estimation on low-dimensional manifolds: an inflation-deflation approach Christian Horvat J. Pfister 35 14 0 25 May 2021
Large-Scale Attribute-Object Compositions Filip Radenovic Animesh Sinha Albert Gordo Tamara L. Berg D. Mahajan OCL 35 7 0 24 May 2021
Heterogeneous Graph Representation Learning with Relation Awareness Le Yu Leilei Sun Bowen Du Chuanren Liu Weifeng Lv Hui Xiong 35 54 0 24 May 2021
GOALS: Gradient-Only Approximations for Line Searches Towards Robust and Consistent Training of Deep Neural Networks Younghwan Chae D. Wilke D. Kafka ODL 37 2 0 23 May 2021
AutoLRS: Automatic Learning-Rate Schedule by Bayesian Optimization on the Fly Yuchen Jin Dinesh Manocha Liangyu Zhao Yibo Zhu Chuanxiong Guo Marco Canini Arvind Krishnamurthy 42 18 0 22 May 2021
Backdoor Attacks on Self-Supervised Learning Aniruddha Saha Ajinkya Tejankar Soroush Abbasi Koohpayegani Hamed Pirsiavash SSL AAML 27 103 0 21 May 2021
Efficient and Robust LiDAR-Based End-to-End Navigation Zhijian Liu Alexander Amini Sibo Zhu S. Karaman Song Han Daniela Rus 192 48 0 20 May 2021
DeepDarts: Modeling Keypoints as Objects for Automatic Scorekeeping in Darts using a Single Camera William J. McNally Pascale Walters Kanav Vats Alexander Wong J. McPhee 21 5 0 20 May 2021
Explainable Health Risk Predictor with Transformer-based Medicare Claim Encoder Chuhong Lahlou Ancil Crayton C. Trier E. Willett MedIm 34 5 0 19 May 2021
When Deep Classifiers Agree: Analyzing Correlations between Learning Order and Image Statistics Iuliia Pliushch Martin Mundt Nicolas Lupp Visvanathan Ramesh 15 12 0 19 May 2021
DACBench: A Benchmark Library for Dynamic Algorithm Configuration Theresa Eimer André Biedenkapp Maximilian V Reimer Steven Adriaensen Frank Hutter Marius Lindauer 33 29 0 18 May 2021
Itsy Bitsy SpiderNet: Fully Connected Residual Network for Fraud Detection S. Afanasiev A. Smirnova D. Kotereva 36 2 0 17 May 2021
Divide and Contrast: Self-supervised Learning from Uncurated Data Yonglong Tian Olivier J. Hénaff Aaron van den Oord SSL 69 96 0 17 May 2021
Leveraging EfficientNet and Contrastive Learning for Accurate Global-scale Location Estimation Giorgos Kordopatis-Zilos Panagiotis Galopoulos Symeon Papadopoulos Y. Kompatsiaris 29 14 0 17 May 2021
Layerwise Optimization by Gradient Decomposition for Continual Learning Shixiang Tang Dapeng Chen Jinguo Zhu Shijie Yu Wanli Ouyang CLL 29 63 0 17 May 2021
Advances in Multi-Variate Analysis Methods for New Physics Searches at the Large Hadron Collider A. Stakia T. Dorigo G. Banelli D. Bortoletto A. Casa ... G. Strong C. Tosciri J. Varela Pietro Vischia A. Weiler 22 3 0 16 May 2021
Dynamic Pooling Improves Nanopore Base Calling Accuracy V. Boža Peter Perešíni Broňa Brejová T. Vinař 38 4 0 16 May 2021
Aerial-PASS: Panoramic Annular Scene Segmentation in Drone Videos Lei Sun Jia Wang Kailun Yang Kaikai Wu Xiangdong Zhou Kaiwei Wang J. Bai 43 12 0 15 May 2021
FloorPlanCAD: A Large-Scale CAD Drawing Dataset for Panoptic Symbol Spotting Zhiwen Fan Lingjie Zhu Honghua Li Xiaohao Chen Siyu Zhu Ping Tan 3DPC 30 35 0 15 May 2021
Analyzing Images for Music Recommendation A. Baijal Vivek Agarwal Danny Hyun 14 4 0 15 May 2021
Not All Memories are Created Equal: Learning to Forget by Expiring Sainbayar Sukhbaatar Da Ju Spencer Poff Stephen Roller Arthur Szlam Jason Weston Angela Fan CLL 21 34 0 13 May 2021
HINet: Half Instance Normalization Network for Image Restoration Liangyu Chen Xin Lu Jie Zhang Xiaojie Chu Chengpeng Chen 35 471 0 13 May 2021
Compatibility-aware Heterogeneous Visual Search Rahul Duggal Hao Zhou Shuo Yang Yuanjun Xiong Wei Xia Zhuowen Tu Stefano Soatto 54 24 0 13 May 2021
Dynamical Isometry: The Missing Ingredient for Neural Network Pruning Huan Wang Can Qin Yue Bai Y. Fu 21 5 0 12 May 2021
When Does Contrastive Visual Representation Learning Work? Elijah Cole Xuan S. Yang Kimberly Wilber Oisin Mac Aodha Serge Belongie SSL 47 124 0 12 May 2021
VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learning Adrien Bardes Jean Ponce Yann LeCun SSL DML 86 913 0 11 May 2021
Multi-modal Conditional Bounding Box Regression for Music Score Following Florian Henkel Gerhard Widmer 14 4 0 10 May 2021
Adversarial examples attack based on random warm restart mechanism and improved Nesterov momentum Tian-zhou Li AAML 33 1 0 10 May 2021
Sampling-Frequency-Independent Audio Source Separation Using Convolution Layer Based on Impulse Invariant Method Koichi Saito Tomohiko Nakamura Kohei Yatabe Yuma Koizumi Hiroshi Saruwatari BDL VLM 31 7 0 10 May 2021
RBNN: Memory-Efficient Reconfigurable Deep Binary Neural Network with IP Protection for Internet of Things Huming Qiu Hua Ma Zhi-Li Zhang Yifeng Zheng Anmin Fu Pan Zhou Yansong Gao Derek Abbott S. Al-Sarawi MQ 24 9 0 09 May 2021
Certified Robustness to Text Adversarial Attacks by Randomized [MASK] Jiehang Zeng Xiaoqing Zheng Jianhan Xu Linyang Li Liping Yuan Xuanjing Huang AAML 31 67 0 08 May 2021
Visual Foresight Trees for Object Retrieval from Clutter with Nonprehensile Rearrangement Baichuan Huang Shuai D. Han Jingjin Yu Abdeslam Boularias 42 52 0 06 May 2021
Relative stability toward diffeomorphisms indicates performance in deep nets Leonardo Petrini Alessandro Favero Mario Geiger Matthieu Wyart OOD 43 15 0 06 May 2021
Non-Autoregressive vs Autoregressive Neural Networks for System Identification Daniel Weber C. Gühmann 32 7 0 05 May 2021
On Feature Decorrelation in Self-Supervised Learning Tianyu Hua Wenxiao Wang Zihui Xue Sucheng Ren Yue Wang Hang Zhao SSL OOD 144 189 0 02 May 2021
Self-supervised Augmentation Consistency for Adapting Semantic Segmentation Nikita Araslanov Stefan Roth 58 229 0 30 Apr 2021
Interpretable Semantic Photo Geolocation Jonas Theiner Eric Müller-Budack Ralph Ewerth 34 30 0 30 Apr 2021
A Large-Scale Study on Unsupervised Spatiotemporal Representation Learning Christoph Feichtenhofer Haoqi Fan Bo Xiong Ross B. Girshick Kaiming He SSL AI4TS 44 258 0 29 Apr 2021
COSCO: Container Orchestration using Co-Simulation and Gradient Based Optimization for Fog Computing Environments Shreshth Tuli Shivananda R. Poojara S. Srirama G. Casale N. Jennings 58 77 0 29 Apr 2021
Emerging Properties in Self-Supervised Vision Transformers Mathilde Caron Hugo Touvron Ishan Misra Hervé Jégou Julien Mairal Piotr Bojanowski Armand Joulin 401 5,870 0 29 Apr 2021
Semi-Supervised Learning of Visual Features by Non-Parametrically Predicting View Assignments with Support Samples Mahmoud Assran Mathilde Caron Ishan Misra Piotr Bojanowski Armand Joulin Nicolas Ballas Michael G. Rabbat SSL 29 147 0 28 Apr 2021
Dynamical prediction of two meteorological factors using the deep neural network and the long short-term memory $(2)$ Ki-Hong Shin Jae-Won Jung Ki-Ho Chang Dong-In Lee C. You Kyungsik Kim 28 2 0 28 Apr 2021
BasicVSR++: Improving Video Super-Resolution with Enhanced Propagation and Alignment Kelvin C. K. Chan Shangchen Zhou Xiangyu Xu Chen Change Loy 162 398 0 27 Apr 2021
Multimodal Self-Supervised Learning of General Audio Representations Luyu Wang Pauline Luc Adrià Recasens Jean-Baptiste Alayrac Aaron van den Oord SSL 78 41 0 26 Apr 2021