SGDR: Stochastic Gradient Descent with Warm Restarts

13 August 2016

Papers citing "SGDR: Stochastic Gradient Descent with Warm Restarts"

50 / 4,280 papers shown

Title
Learning and Evaluating Representations for Deep One-class Classification Kihyuk Sohn Chun-Liang Li Jinsung Yoon Minho Jin Tomas Pfister SSL 16 199 0 04 Nov 2020
Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understanding Mike Roberts Jason Ramapuram Anurag Ranjan Atulit Kumar Miguel Angel Bautista Nathan Paczan Russ Webb Joshua M. Susskind 60 370 0 04 Nov 2020
DAIS: Automatic Channel Pruning via Differentiable Annealing Indicator Search Yushuo Guan Ning Liu Pengyu Zhao Zhengping Che Kaigui Bian Yanzhi Wang Jian Tang 28 39 0 04 Nov 2020
Reverse engineering learned optimizers reveals known and novel mechanisms Niru Maheswaranathan David Sussillo Luke Metz Ruoxi Sun Jascha Narain Sohl-Dickstein 27 21 0 04 Nov 2020
Multi Projection Fusion for Real-time Semantic Segmentation of 3D LiDAR Point Clouds Yara Ali Alnaggar Mohamed Afifi K. Amer Mohamed ElHelw 3DPC 26 43 0 03 Nov 2020
Self-semi-supervised Learning to Learn from NoisyLabeled Data Jiacheng Wang Yue Ma Shuang Gao NoLa SSL 9 1 0 03 Nov 2020
A Survey on Contrastive Self-supervised Learning Ashish Jaiswal Ashwin Ramesh Babu Mohammad Zaki Zadeh Debapriya Banerjee F. Makedon SSL 57 1,366 0 31 Oct 2020
Self-paced and self-consistent co-training for semi-supervised image segmentation Ping Wang Jizong Peng M. Pedersoli Yuanfeng Zhou Caiming Zhang Christian Desrosiers 14 53 0 31 Oct 2020
Self-supervised Representation Learning for Evolutionary Neural Architecture Search Chen Wei Yiping Tang Chuang Niu Haihong Hu Yue Wang Jimin Liang 24 21 0 31 Oct 2020
Why Do Better Loss Functions Lead to Less Transferable Features? Simon Kornblith Ting-Li Chen Honglak Lee Mohammad Norouzi FaML 45 90 0 30 Oct 2020
Greedy Optimization Provably Wins the Lottery: Logarithmic Number of Winning Tickets is Enough Mao Ye Lemeng Wu Qiang Liu 23 17 0 29 Oct 2020
Permute, Quantize, and Fine-tune: Efficient Compression of Neural Networks Julieta Martinez Jashan Shewakramani Ting Liu Ioan Andrei Bârsan Wenyuan Zeng R. Urtasun MQ 31 30 0 29 Oct 2020
Simplifying Hamiltonian and Lagrangian Neural Networks via Explicit Constraints Marc Finzi Ke Alexander Wang A. Wilson AI4CE 34 126 0 26 Oct 2020
TPLinker: Single-stage Joint Extraction of Entities and Relations Through Token Pair Linking Yucheng Wang Yu Bowen Yueyang Zhang Tingwen Liu Hongsong Zhu Limin Sun 22 339 0 26 Oct 2020
A Comparison of Discrete Latent Variable Models for Speech Representation Learning Henry Zhou Alexei Baevski Michael Auli DRL 27 10 0 24 Oct 2020
A Simple Approach for Handling Out-of-Vocabulary Identifiers in Deep Learning for Source Code Nadezhda Chirkova Sergey Troshin 61 12 0 23 Oct 2020
Neural Audio Fingerprint for High-specific Audio Retrieval based on Contrastive Learning Sungkyun Chang Donmoon Lee Jeongsoon Park Hyungui Lim Kyogu Lee Karam Ko Yoonchang Han 25 34 0 22 Oct 2020
ConVEx: Data-Efficient and Few-Shot Slot Labeling Matthew Henderson Ivan Vulić CLIP VLM 28 38 0 22 Oct 2020
Graph Attention Networks for Speaker Verification Jee-weon Jung Hee-Soo Heo Ha-Jin Yu Joon Son Chung 25 26 0 22 Oct 2020
Mood Classification Using Listening Data Filip Korzeniowski Oriol Nieto Matthew C. McCallum Minz Won Sergio Oramas Erik M. Schmidt 28 12 0 22 Oct 2020
Learning Loss for Test-Time Augmentation Ildoo Kim Younghoon Kim Sungwoong Kim OOD 26 91 0 22 Oct 2020
One Model to Reconstruct Them All: A Novel Way to Use the Stochastic Noise in StyleGAN Christian Bartz Joseph Bethge Haojin Yang Christoph Meinel 24 16 0 21 Oct 2020
CLAR: Contrastive Learning of Auditory Representations Haider Al-Tahan Y. Mohsenzadeh SSL 125 56 0 19 Oct 2020
Improving Transformation Invariance in Contrastive Representation Learning Adam Foster Rattana Pukdee Tom Rainforth 62 23 0 19 Oct 2020
Multi-hop Question Generation with Graph Convolutional Network Dan Su Yan Xu Wenliang Dai Ziwei Ji Tiezheng Yu Pascale Fung 28 40 0 19 Oct 2020
i-Mix: A Domain-Agnostic Strategy for Contrastive Representation Learning Kibok Lee Yian Zhu Kihyuk Sohn Chun-Liang Li Jinwoo Shin Honglak Lee SSL 33 26 0 17 Oct 2020
Maximum-Entropy Adversarial Data Augmentation for Improved Generalization and Robustness Long Zhao Ting Liu Xi Peng Dimitris N. Metaxas OOD AAML 27 165 0 15 Oct 2020
Representation Learning via Invariant Causal Mechanisms Jovana Mitrović Brian McWilliams Jacob Walker Lars Buesing Charles Blundell CML OOD SSL 31 248 0 15 Oct 2020
Unsupervised Video Anomaly Detection via Normalizing Flows with Implicit Latent Features Myeongah Cho Taeoh Kim Woojin Kim Suhwan Cho Sangyoun Lee 22 92 0 15 Oct 2020
A New Distributional Ranking Loss With Uncertainty: Illustrated in Relative Depth Estimation Alican Mertan Y. Sahin D. Duff Gözde B. Ünal OOD UQCV 27 10 0 14 Oct 2020
Just Pick a Sign: Optimizing Deep Multitask Models with Gradient Sign Dropout Zhao Chen Jiquan Ngiam Yanping Huang Thang Luong Henrik Kretzschmar Yuning Chai Dragomir Anguelov 41 207 0 14 Oct 2020
Ensemble Distillation for Structured Prediction: Calibrated, Accurate, Fast-Choose Three Steven Reich David Mueller Nicholas Andrews BDL OOD UQCV 30 13 0 13 Oct 2020
Making Every Label Count: Handling Semantic Imprecision by Integrating Domain Knowledge C. Brust Björn Barz Joachim Denzler NoLa 24 5 0 13 Oct 2020
Self-Supervised Multi-View Synchronization Learning for 3D Pose Estimation Simon Jenni Paolo Favaro 3DH 18 11 0 13 Oct 2020
Towards Theoretically Understanding Why SGD Generalizes Better Than ADAM in Deep Learning Pan Zhou Jiashi Feng Chao Ma Caiming Xiong Guosheng Lin E. Weinan 33 229 0 12 Oct 2020
Identifying Melanoma Images using EfficientNet Ensemble: Winning Solution to the SIIM-ISIC Melanoma Classification Challenge Qishen Ha Bo Liu Fuxu Liu 28 65 0 11 Oct 2020
H2O-Net: Self-Supervised Flood Segmentation via Adversarial Domain Adaptation and Label Refinement Peri Akiva Matthew Purri Kristin J. Dana B. Tellman Tyler Anderson 25 25 0 11 Oct 2020
An Empirical Investigation of Beam-Aware Training in Supertagging Renato M. P. Negrinho Matthew R. Gormley Geoffrey J. Gordon 47 3 0 10 Oct 2020
Be Your Own Best Competitor! Multi-Branched Adversarial Knowledge Transfer Mahdi Ghorbani Fahimeh Fooladgar S. Kasaei AAML 39 0 0 09 Oct 2020
Population Based Training for Data Augmentation and Regularization in Speech Recognition Daniel Haziza Jérémy Rapin Gabriel Synnaeve 28 1 0 08 Oct 2020
Energy-based Out-of-distribution Detection Weitang Liu Xiaoyun Wang John Douglas Owens Yixuan Li OODD 119 1,310 0 08 Oct 2020
Uncovering the Limits of Adversarial Training against Norm-Bounded Adversarial Examples Sven Gowal Chongli Qin J. Uesato Timothy A. Mann Pushmeet Kohli AAML 22 325 0 07 Oct 2020
Unsupervised Representation Learning by InvariancePropagation Feng Wang Huaping Liu Di Guo F. Sun SSL 41 33 0 07 Oct 2020
A Contrastive Learning Approach for Training Variational Autoencoder Priors J. Aneja Alex Schwing Jan Kautz Arash Vahdat DRL 21 81 0 06 Oct 2020
Learnable Uncertainty under Laplace Approximations Agustinus Kristiadi Matthias Hein Philipp Hennig UQCV BDL 22 30 0 06 Oct 2020
CO2: Consistent Contrast for Unsupervised Visual Representation Learning Chen Wei Huiyu Wang Wei Shen Alan Yuille SSL 36 62 0 05 Oct 2020
Unsupervised Point Cloud Pre-Training via Occlusion Completion Hanchen Wang Qi Liu Xiangyu Yue Joan Lasenby Matt J. Kusner 3DPC 15 244 0 02 Oct 2020
Group Equivariant Stand-Alone Self-Attention For Vision David W. Romero Jean-Baptiste Cordonnier MDE 26 58 0 02 Oct 2020
Deep Group-wise Variational Diffeomorphic Image Registration Tycho F. A. van der Ouderaa Ivana Išgum W. Veldhuis B. D. de Vos 16 8 0 01 Oct 2020
Joint Contrastive Learning with Infinite Possibilities Qi Cai Yu Wang Yingwei Pan Ting Yao Tao Mei VLM 22 60 0 30 Sep 2020