On the adequacy of untuned warmup for adaptive optimization

9 October 2019

Papers citing "On the adequacy of untuned warmup for adaptive optimization"

13 / 13 papers shown

Title
Hierarchical Mixture of Experts: Generalizable Learning for High-Level Synthesis Weikai Li Ding Wang Zijian Ding Atefeh Sohrabizadeh Zongyue Qin Jason Cong Yizhou Sun 40 2 0 25 Oct 2024
Sampling Foundational Transformer: A Theoretical Perspective Viet Anh Nguyen Minh Lenhat Khoa Nguyen Duong Duc Hieu Dao Huu Hung Truong Son-Hy 44 0 0 11 Aug 2024
Resource Efficient Perception for Vision Systems M. I. A V Subramanyam Niyati Singal Vinay K. Verma 46 0 0 12 May 2024
Stochastic Subnetwork Annealing: A Regularization Technique for Fine Tuning Pruned Subnetworks Tim Whitaker Darrell Whitley 33 0 0 16 Jan 2024
A ground-based dataset and a diffusion model for on-orbit low-light image enhancement Yiman Zhu Lu Wang Jin Yuan Yu Guo 13 4 0 25 Jun 2023
Synaptic Stripping: How Pruning Can Bring Dead Neurons Back To Life Tim Whitaker L. D. Whitley CVBM 30 2 0 11 Feb 2023
A Distance-Geometric Method for Recovering Robot Joint Angles From an RGB Image Ivan Bilić Filip Marić Ivan Marković Ivan Petrović 25 1 0 05 Jan 2023
A DNN Framework for Learning Lagrangian Drift With Uncertainty J. Jenkins A. Paiement Y. Ourmières Julien Le Sommer J. Verron C. Ubelmann H. Glotin 24 5 0 12 Apr 2022
Ranger21: a synergistic deep learning optimizer Less Wright Nestor Demeure ODL AI4CE 30 85 0 25 Jun 2021
Semantic Scene Completion using Local Deep Implicit Functions on LiDAR Data Christoph B. Rist David Emmerichs Markus Enzweiler D. Gavrila 3DPC 3DV 20 84 0 18 Nov 2020
MaxVA: Fast Adaptation of Step Sizes by Maximizing Observed Variance of Gradients Chenfei Zhu Yu Cheng Zhe Gan Furong Huang Jingjing Liu Tom Goldstein ODL 29 2 0 21 Jun 2020
The Hateful Memes Challenge: Detecting Hate Speech in Multimodal Memes Douwe Kiela Hamed Firooz Aravind Mohan Vedanuj Goswami Amanpreet Singh Pratik Ringshia Davide Testuggine 37 580 0 10 May 2020
Quasi-hyperbolic momentum and Adam for deep learning Jerry Ma Denis Yarats ODL 84 129 0 16 Oct 2018