On the Variance of the Adaptive Learning Rate and Beyond

8 August 2019

Xiaodong Liu

Papers citing "On the Variance of the Adaptive Learning Rate and Beyond"

50 / 373 papers shown

Title
Deepfake Forensics via An Adversarial Game Zhi Wang Yiwen Guo W. Zuo AAML 21 36 0 25 Mar 2021
Hierarchical Attention-based Age Estimation and Bias Estimation Shakediel Hiba Y. Keller CVBM 37 10 0 17 Mar 2021
Towards Indirect Top-Down Road Transport Emissions Estimation R. Mukherjee Derek M. Rollend Gordon A. Christie Armin Hadzic Sally Matson Anshu Saksena Marisa Hughes 25 7 0 16 Mar 2021
Enhanced 3D Human Pose Estimation from Videos by using Attention-Based Neural Network with Dilated Convolutions Ruixu Liu Ju Shen He Wang Chong Chen S. Cheung V. Asari 3DH 30 30 0 04 Mar 2021
RotoGrad: Gradient Homogenization in Multitask Learning Adrián Javaloy Isabel Valera 43 86 0 03 Mar 2021
Probabilistic Spatial Analysis in Quantitative Microscopy with Uncertainty-Aware Cell Detection using Deep Bayesian Regression of Density Maps Alvaro Gomariz Tiziano Portenier C. Nombela-Arrieta O. Goksel UQCV 37 6 0 23 Feb 2021
ISCL: Interdependent Self-Cooperative Learning for Unpaired Image Denoising Kanggeun Lee Won-Ki Jeong 25 35 0 19 Feb 2021
GradInit: Learning to Initialize Neural Networks for Stable and Efficient Training Chen Zhu Renkun Ni Zheng Xu Kezhi Kong Wenjie Huang Tom Goldstein ODL 48 54 0 16 Feb 2021
Hierarchical Transformer-based Large-Context End-to-end ASR with Large-Context Knowledge Distillation Ryo Masumura Naoki Makishima Mana Ihori Akihiko Takashima Tomohiro Tanaka Shota Orihashi 38 29 0 16 Feb 2021
OmniDet: Surround View Cameras based Multi-task Visual Perception Network for Autonomous Driving Varun Ravi Kumar S. Yogamani Hazem Rashed Ganesh Sitsu Christian Witt Isabelle Leang Stefan Milz Patrick Mäder 52 90 0 15 Feb 2021
Only a Matter of Style: Age Transformation Using a Style-Based Regression Model Yuval Alaluf Or Patashnik Daniel Cohen-Or 22 137 0 04 Feb 2021
Gaze-based dual resolution deep imitation learning for high-precision dexterous robot manipulation Heecheol Kim Yoshiyuki Ohmura Yasuo Kuniyoshi 26 24 0 02 Feb 2021
Automated Deep Learning Analysis of Angiography Video Sequences for Coronary Artery Disease Chengyang Zhou Thao Vy Dinh Heyi Kong J. Yap K. Yeo H. Lee Kaicheng Liang 53 12 0 29 Jan 2021
Density Compensated Unrolled Networks for Non-Cartesian MRI Reconstruction Zaccharie Ramzi Jean-Luc Starck P. Ciuciu 42 18 0 05 Jan 2021
Advances in Electron Microscopy with Deep Learning Jeffrey M. Ede 45 2 0 04 Jan 2021
Optimizing Deeper Transformers on Small Datasets Peng Xu Dhruv Kumar Wei Yang Wenjie Zi Keyi Tang Chenyang Huang Jackie C.K. Cheung S. Prince Yanshuai Cao AI4CE 29 69 0 30 Dec 2020
Time-Travel Rephotography Xuan Luo X. Zhang Paul D. Yoo Ricardo Martín Brualla Jason Lawrence S. M. Seitz 43 32 0 22 Dec 2020
Dynamic Traffic Modeling From Overhead Imagery Scott Workman Nathan Jacobs 32 17 0 18 Dec 2020
Intrinsic Temporal Regularization for High-resolution Human Video Synthesis Lingbo Yang Zhanning Gao Peiran Ren Siwei Ma Wen Gao 3DH 24 1 0 11 Dec 2020
Noise2Kernel: Adaptive Self-Supervised Blind Denoising using a Dilated Convolutional Kernel Architecture Kanggeun Lee Won-Ki Jeong 32 18 0 07 Dec 2020
MaX-DeepLab: End-to-End Panoptic Segmentation with Mask Transformers Huiyu Wang Yukun Zhu Hartwig Adam Alan Yuille Liang-Chieh Chen ViT 60 528 0 01 Dec 2020
A Random Matrix Theory Approach to Damping in Deep Learning Diego Granziol Nicholas P. Baskerville AI4CE ODL 49 2 0 15 Nov 2020
Low-activity supervised convolutional spiking neural networks applied to speech commands recognition Thomas Pellegrini Romain Zimmer T. Masquelier 44 34 0 13 Nov 2020
Generalization to New Actions in Reinforcement Learning Ayush Jain Andrew Szot Joseph J. Lim AI4CE 44 34 0 03 Nov 2020
Generalized Wasserstein Dice Score, Distributionally Robust Deep Learning, and Ranger for brain tumor segmentation: BraTS 2020 challenge Lucas Fidon Sebastien Ourselin Tom Vercauteren OOD MedIm 34 41 0 03 Nov 2020
Point Transformer Nico Engel Vasileios Belagiannis Klaus C. J. Dietmayer 3DPC 99 1,952 0 02 Nov 2020
COOT: Cooperative Hierarchical Transformer for Video-Text Representation Learning Simon Ging Mohammadreza Zolfaghari Hamed Pirsiavash Thomas Brox ViT CLIP 40 169 0 01 Nov 2020
Parallel waveform synthesis based on generative adversarial networks with voicing-aware conditional discriminators Ryuichi Yamamoto Eunwoo Song Min-Jae Hwang Jae-Min Kim 39 18 0 27 Oct 2020
Learning Contextualized Knowledge Structures for Commonsense Reasoning Jun Yan Mrigank Raman Aaron Chan Tianyu Zhang Ryan Rossi Handong Zhao Sungchul Kim Nedim Lipka Xiang Ren 231 36 0 24 Oct 2020
On the Transformer Growth for Progressive BERT Training Xiaotao Gu Liyuan Liu Hongkun Yu Jing Li Chong Chen Jiawei Han VLM 69 51 0 23 Oct 2020
Towards an Automatic Analysis of CHO-K1 Suspension Growth in Microfluidic Single-cell Cultivation Dominik Stallmann Jan Philip Göpfert Julian Schmitz A. Grünberger Barbara Hammer 59 6 0 20 Oct 2020
Self-attention aggregation network for video face representation and recognition Ihor Protsenko Taras Lehinevych Dmytro Voitekh Ihor Kroosh Nick Hasty Anthony Johnson CVBM 24 2 0 11 Oct 2020
AEGD: Adaptive Gradient Descent with Energy Hailiang Liu Xuping Tian ODL 32 11 0 10 Oct 2020
A Transformer-based Framework for Multivariate Time Series Representation Learning George Zerveas Srideepika Jayaraman Dhaval Patel A. Bhamidipaty Carsten Eickhoff AI4TS 31 894 0 06 Oct 2020
Remembering for the Right Reasons: Explanations Reduce Catastrophic Forgetting Sayna Ebrahimi Suzanne Petryk Akash Gokul William Gan Joseph E. Gonzalez Marcus Rohrbach Trevor Darrell CLL 42 45 0 04 Oct 2020
A straightforward line search approach on the expected empirical loss for stochastic deep learning problems Max Mutschler A. Zell 56 0 0 02 Oct 2020
Learning an optimal PSF-pair for ultra-dense 3D localization microscopy E. Nehme Boris Ferdman Lucien E. Weiss Tal Naor Daniel Freedman T. Michaeli Y. Shechtman 18 5 0 29 Sep 2020
Towards General Purpose Geometry-Preserving Single-View Depth Estimation Mikhail Romanov Nikolay Patatkin Anna Vorontsova Sergey Nikolenko Anton Konushin Dmitry Senyushkin MDE 29 3 0 25 Sep 2020
Predicting galaxy spectra from images with hybrid convolutional neural networks John F. Wu J. E. G. Peek 16 9 0 25 Sep 2020
2D-3D Geometric Fusion Network using Multi-Neighbourhood Graph Convolution for RGB-D Indoor Scene Classification Albert Mosella-Montoro Javier Ruiz-Hidalgo 3DPC MDE 31 25 0 23 Sep 2020
Multi-Modal Reasoning Graph for Scene-Text Based Fine-Grained Image Classification and Retrieval Andrés Mafla S. Dey Ali Furkan Biten Lluís Gómez Dimosthenis Karatzas 32 25 0 21 Sep 2020
Review: Deep Learning in Electron Microscopy Jeffrey M. Ede 48 79 0 17 Sep 2020
UPB at SemEval-2020 Task 11: Propaganda Detection with Domain-Specific Trained BERT Andrei Paraschiv Dumitru-Clementin Cercel M. Dascalu 19 17 0 11 Sep 2020
Learning from Multiple Datasets with Heterogeneous and Partial Labels for Universal Lesion Detection in CT K. Yan Jinzheng Cai Youjing Zheng Adam P. Harrison D. Jin Youbao Tang Yuxing Tang Lingyun Huang Jing Xiao Le Lu 47 84 0 05 Sep 2020
HiFiSinger: Towards High-Fidelity Neural Singing Voice Synthesis Jiawei Chen Xu Tan Jian Luan Tao Qin Tie-Yan Liu VLM 26 92 0 03 Sep 2020
Lymph Node Gross Tumor Volume Detection and Segmentation via Distance-based Gating using 3D CT/PET Imaging in Radiotherapy Zhuotun Zhu D. Jin K. Yan T. Ho X. Ye Dazhou Guo Chun-Hung Chao Jing Xiao Alan Yuille Le Lu 46 30 0 27 Aug 2020
CRNNs for Urban Sound Tagging with spatiotemporal context Augustin Arnault Nicolas Riche 30 7 0 24 Aug 2020
Automating the assessment of biofouling in images using expert agreement as a gold standard N. Bloomfield Susan Wei Bartholomew Woodham Peter Wilkinson Andrew Robinson 19 18 0 21 Aug 2020
Deep Volumetric Ambient Occlusion Dominik Engel Timo Ropinski 26 22 0 19 Aug 2020
Very Deep Transformers for Neural Machine Translation Xiaodong Liu Kevin Duh Liyuan Liu Jianfeng Gao 27 102 0 18 Aug 2020