v1v2 (latest)

Lookahead Optimizer: k steps forward, 1 step back

19 July 2019

Jimmy Ba

Papers citing "Lookahead Optimizer: k steps forward, 1 step back"

50 / 357 papers shown

Title
Personalized Federated Learning using Hypernetworks Aviv Shamsian Aviv Navon Ethan Fetaya Gal Chechik FedML 118 339 0 08 Mar 2021
Enhanced 3D Human Pose Estimation from Videos by using Attention-Based Neural Network with Dilated Convolutions Ruixu Liu Ju Shen He Wang Chong Chen S. Cheung V. Asari 3DH 70 31 0 04 Mar 2021
Improved Techniques for Quantizing Deep Networks with Adaptive Bit-Widths Ximeng Sun Yikang Shen Chun-Fu Chen Naigang Wang Bowen Pan Bowen Pan Kailash Gopalakrishnan A. Oliva Rogerio Feris Kate Saenko MQ 78 4 0 02 Mar 2021
Searching for Robustness: Loss Learning for Noisy Classification Tasks Boyan Gao Henry Gouk Timothy M. Hospedales OOD NoLa 81 18 0 27 Feb 2021
Surgical Visual Domain Adaptation: Results from the MICCAI 2020 SurgVisDom Challenge Aneeq Zia Kiran D. Bhattacharyya Xi Liu Ziheng Wang S. Kondo ... Raabid Hussain Lena Maier-Hein Danail Stoyanov Stefanie Speidel A. Jarc 86 20 0 26 Feb 2021
ISCL: Interdependent Self-Cooperative Learning for Unpaired Image Denoising Kanggeun Lee Won-Ki Jeong 56 36 0 19 Feb 2021
Complex Momentum for Optimization in Games Jonathan Lorraine David Acuna Paul Vicol David Duvenaud 75 9 0 16 Feb 2021
OmniDet: Surround View Cameras based Multi-task Visual Perception Network for Autonomous Driving Varun Ravi Kumar S. Yogamani Hazem Rashed Ganesh Sitsu Christian Witt Isabelle Leang Stefan Milz Patrick Mäder 106 92 0 15 Feb 2021
Self-supervised driven consistency training for annotation efficient histopathology image analysis C. Srinidhi Seung Wook Kim Fu-Der Chen Anne L. Martel SSL 101 111 0 07 Feb 2021
Only a Matter of Style: Age Transformation Using a Style-Based Regression Model Yuval Alaluf Or Patashnik Daniel Cohen-Or 75 141 0 04 Feb 2021
IWA: Integrated Gradient based White-box Attacks for Fooling Deep Neural Networks Yixiang Wang Jiqiang Liu Xiaolin Chang J. Misic Vojislav B. Mišić AAML 69 12 0 03 Feb 2021
Automated Deep Learning Analysis of Angiography Video Sequences for Coronary Artery Disease Chengyang Zhou Thao Vy Dinh Heyi Kong J. Yap K. Yeo H. Lee Kaicheng Liang 84 13 0 29 Jan 2021
Multilingual and cross-lingual document classification: A meta-learning approach Niels van der Heijden H. Yannakoudakis Pushkar Mishra Ekaterina Shutova VLM 70 24 0 27 Jan 2021
Knowledge Generation -- Variational Bayes on Knowledge Graphs Florian Wolf BDL 27 0 0 21 Jan 2021
Advances in Electron Microscopy with Deep Learning Jeffrey M. Ede 107 3 0 04 Jan 2021
Dynamic Traffic Modeling From Overhead Imagery Scott Workman Nathan Jacobs 68 17 0 18 Dec 2020
FedADC: Accelerated Federated Learning with Drift Control Emre Ozfatura Kerem Ozfatura Deniz Gunduz FedML 109 38 0 16 Dec 2020
Sparse encoding for more-interpretable feature-selecting representations in probabilistic matrix factorization Joshua C. Chang P. Fletcher Ju Han Ted L.Chang Shashaank Vattikuti Bart Desmet Ayah Zirikly Carson C. Chow 39 4 0 08 Dec 2020
Phonetic Posteriorgrams based Many-to-Many Singing Voice Conversion via Adversarial Training Haohan Guo Heng Lu Na Hu Chunlei Zhang Shan Yang Lei Xie Jane Polak Scowcroft Dong Yu AAML 68 12 0 03 Dec 2020
Lookahead optimizer improves the performance of Convolutional Autoencoders for reconstruction of natural images Sayan Nag DRL 31 2 0 03 Dec 2020
MaX-DeepLab: End-to-End Panoptic Segmentation with Mask Transformers Huiyu Wang Yukun Zhu Hartwig Adam Alan Yuille Liang-Chieh Chen ViT 154 531 0 01 Dec 2020
Deep learning in magnetic resonance prostate segmentation: A review and a new perspective David Gillespie Connah Kendrick I. Boon C. Boon T. Rattay Moi Hoon Yap 35 12 0 16 Nov 2020
Conflicting Bundles: Adapting Architectures Towards the Improved Training of Deep Neural Networks David Peer Sebastian Stabinger A. Rodríguez-Sánchez 21 6 0 05 Nov 2020
Generalized Wasserstein Dice Score, Distributionally Robust Deep Learning, and Ranger for brain tumor segmentation: BraTS 2020 challenge Lucas Fidon Sebastien Ourselin Tom Vercauteren OOD MedIm 74 43 0 03 Nov 2020
Brain tumor segmentation with self-ensembled, deeply-supervised 3D U-net neural networks: a BraTS 2020 challenge solution T. Henry Alexandre Carré Marvin Lerousseau Théo Estienne C. Robert Nikos Paragios Eric Deutsch 45 80 0 30 Oct 2020
Genetic U-Net: Automatically Designed Deep Networks for Retinal Vessel Segmentation Using a Genetic Algorithm Jiahong Wei Zhun Fan 68 78 0 29 Oct 2020
Measuring and Harnessing Transference in Multi-Task Learning Christopher Fifty Ehsan Amid Zhe Zhao Tianhe Yu Rohan Anil Chelsea Finn 104 15 0 29 Oct 2020
Learning Transferrable Parameters for Long-tailed Sequential User Behavior Modeling Jianwen Yin Chenghao Liu Weiqing Wang Jianling Sun Guosheng Lin 58 30 0 22 Oct 2020
Learning Curves for Analysis of Deep Networks Derek Hoiem Tanmay Gupta Zhizhong Li Michal Shlapentokh-Rothman 82 26 0 21 Oct 2020
How much progress have we made in neural network training? A New Evaluation Protocol for Benchmarking Optimizers Yuanhao Xiong Xuanqing Liu Li-Cheng Lan Yang You Si Si Cho-Jui Hsieh OOD 97 1 0 19 Oct 2020
Training Stronger Baselines for Learning to Optimize Tianlong Chen Weiyi Zhang Jingyang Zhou Shiyu Chang Sijia Liu Lisa Amini Zhangyang Wang OffRL 86 52 0 18 Oct 2020
AdaBelief Optimizer: Adapting Stepsizes by the Belief in Observed Gradients Juntang Zhuang Tommy M. Tang Yifan Ding S. Tatikonda Nicha Dvornek X. Papademetris James S. Duncan ODL 232 526 0 15 Oct 2020
A method for escaping limit cycles in training GANs Li Keke Xinmin Yang 75 0 0 07 Oct 2020
BAMSProd: A Step towards Generalizing the Adaptive Optimization Methods to Deep Binary Model Junjie Liu Dongchao Wen Deyu Wang Wei Tao Tse-Wei Chen Kinya Osa Masami Kato MQ 44 1 0 29 Sep 2020
Towards General Purpose Geometry-Preserving Single-View Depth Estimation Mikhail Romanov Nikolay Patatkin Anna Vorontsova Sergey Nikolenko Anton Konushin Dmitry Senyushkin MDE 38 3 0 25 Sep 2020
Predicting galaxy spectra from images with hybrid convolutional neural networks John F. Wu J. E. G. Peek 27 9 0 25 Sep 2020
Multi-Modal Reasoning Graph for Scene-Text Based Fine-Grained Image Classification and Retrieval Andrés Mafla S. Dey Ali Furkan Biten Lluís Gómez Dimosthenis Karatzas 80 25 0 21 Sep 2020
Detecting Sound Events Using Convolutional Macaron Net With Pseudo Strong Labels T. K. Chan C. Chin 33 2 0 21 Sep 2020
Review: Deep Learning in Electron Microscopy Jeffrey M. Ede 197 80 0 17 Sep 2020
CRNNs for Urban Sound Tagging with spatiotemporal context Augustin Arnault Nicolas Riche 58 7 0 24 Aug 2020
Deep Volumetric Ambient Occlusion Dominik Engel Timo Ropinski 77 22 0 19 Aug 2020
Adaptive Hierarchical Hyper-gradient Descent Renlong Jie Junbin Gao A. Vasnev Minh-Ngoc Tran 54 5 0 17 Aug 2020
Obtaining Adjustable Regularization for Free via Iterate Averaging Jingfeng Wu Vladimir Braverman Lin F. Yang 63 2 0 15 Aug 2020
SynDistNet: Self-Supervised Monocular Fisheye Camera Distance Estimation Synergized with Semantic Segmentation for Autonomous Driving V. Kumar Marvin Klingner S. Yogamani Stefan Milz Tim Fingscheidt Patrick Mäder MDE 128 81 0 10 Aug 2020
Improving End-to-End Speech-to-Intent Classification with Reptile Yusheng Tian P. Gorinski VLM 81 24 0 05 Aug 2020
Two-Stage Deep Learning for Accelerated 3D Time-of-Flight MRA without Matched Training Data Hyungjin Chung Eunju Cha Leonard Sunwoo J. C. Ye MedIm 89 26 0 04 Aug 2020
Encoding in Style: a StyleGAN Encoder for Image-to-Image Translation Elad Richardson Yuval Alaluf Or Patashnik Yotam Nitzan Yaniv Azar Stav Shapiro Daniel Cohen-Or 282 1,114 0 03 Aug 2020
Bilevel Continual Learning Quang Pham Doyen Sahoo Chenghao Liu Guosheng Lin CLL 83 11 0 30 Jul 2020
Single Image Cloud Detection via Multi-Image Fusion Scott Workman M. U. Rafique Hunter Blanton Connor Greenwell Nathan Jacobs 24 5 0 29 Jul 2020
Comparative study of deep learning methods for the automatic segmentation of lung, lesion and lesion type in CT scans of COVID-19 patients Sofie Tilborghs Ine Dirks Lucas Fidon S. Willems Tom Eelbode ... D. Robben D. Smeets F. Maes Jef Vandemeulebroucke P. Suetens OOD 87 28 0 29 Jul 2020