Lookahead Optimizer: k steps forward, 1 step back

19 July 2019

Jimmy Ba

Papers citing "Lookahead Optimizer: k steps forward, 1 step back"

50 / 347 papers shown

Title
1st Place Solution for ICDAR 2021 Competition on Mathematical Formula Detection Yuxiang Zhong Xianbiao Qi Shanjun Li Dengyi Gu Yihao Chen Peiyang Ning Rong Xiao 13 5 0 12 Jul 2021
Delta Sampling R-BERT for limited data and low-light action recognition Sanchit Hira Ritwik Das Abhinav Modi D. Pakhomov 75 17 0 12 Jul 2021
BEV-MODNet: Monocular Camera based Bird's Eye View Moving Object Detection for Autonomous Driving Hazem Rashed Mariam Essam M. Mohamed Ahmad El-Sallab S. Yogamani 27 11 0 11 Jul 2021
KOALA: A Kalman Optimization Algorithm with Loss Adaptivity A. Davtyan Sepehr Sameni L. Cerkezi Givi Meishvili Adam Bielski Paolo Favaro ODL 53 2 0 07 Jul 2021
Ranger21: a synergistic deep learning optimizer Less Wright Nestor Demeure ODL AI4CE 30 85 0 25 Jun 2021
Adaptive Learning Rate and Momentum for Training Deep Neural Networks Zhiyong Hao Yixuan Jiang Huihua Yu H. Chiang ODL 21 9 0 22 Jun 2021
Well-tuned Simple Nets Excel on Tabular Datasets Arlind Kadra Marius Lindauer Frank Hutter Josif Grabocka 23 185 0 21 Jun 2021
Drum-Aware Ensemble Architecture for Improved Joint Musical Beat and Downbeat Tracking Ching-Yu Chiu A. Su Yi-Hsuan Yang 36 10 0 16 Jun 2021
Modeling Hierarchical Structures with Continuous Recursive Neural Networks Jishnu Ray Chowdhury Cornelia Caragea 24 15 0 10 Jun 2021
Highlighting the Importance of Reducing Research Bias and Carbon Emissions in CNNs A. Badar Arnav Varma Adrian Staniec Mahmoud Gamal Omar Magdy Haris Iqbal Elahe Arani Bahram Zonooz 25 6 0 06 Jun 2021
Self-Attention Between Datapoints: Going Beyond Individual Input-Output Pairs in Deep Learning Jannik Kossen Neil Band Clare Lyle Aidan Gomez Tom Rainforth Y. Gal OOD 3DPC 33 137 0 04 Jun 2021
TransMIL: Transformer based Correlated Multiple Instance Learning for Whole Slide Image Classification Zhucheng Shao Hao Bian Yang Chen Yifeng Wang Jian Zhang Xiangyang Ji Yongbing Zhang ViT MedIm 37 635 0 02 Jun 2021
VidFace: A Full-Transformer Solver for Video FaceHallucination with Unaligned Tiny Snapshots Y. Gan Yawei Luo Xin Yu Bang Zhang Yi Yang ViT CVBM 25 3 0 31 May 2021
ICDAR 2021 Competition on Scientific Table Image Recognition to LaTeX Pratik Kayal Mrinal Anand Harsh Desai M. Singh LMTD 12 12 0 30 May 2021
AutoSampling: Search for Effective Data Sampling Schedules Ming Sun Hao Dou Baopu Li Lei Cui Junjie Yan Wanli Ouyang 39 6 0 28 May 2021
Training With Data Dependent Dynamic Learning Rates Shreyas Saxena Nidhi Vyas D. DeCoste ODL 6 1 0 27 May 2021
An Online Learning System for Wireless Charging Alignment using Surround-view Fisheye Cameras Ashok Dahal V. Kumar S. Yogamani Ciarán Eising 24 12 0 26 May 2021
Learning to Detect Fortified Areas A. Jørgensen Jonas Tranberg 19 0 0 26 May 2021
Denoising Noisy Neural Networks: A Bayesian Approach with Compensation Yulin Shao Soung Chang Liew Deniz Gunduz 56 14 0 22 May 2021
Sampling-Frequency-Independent Audio Source Separation Using Convolution Layer Based on Impulse Invariant Method Koichi Saito Tomohiko Nakamura Kohei Yatabe Yuma Koizumi Hiroshi Saruwatari BDL VLM 23 7 0 10 May 2021
Audio Retrieval with Natural Language Queries Andreea-Maria Oncescu A. Sophia Koepke João F. Henriques Zeynep Akata Samuel Albanie 21 77 0 05 May 2021
Non-Autoregressive vs Autoregressive Neural Networks for System Identification Daniel Weber C. Gühmann 21 7 0 05 May 2021
PingAn-VCGroup's Solution for ICDAR 2021 Competition on Scientific Literature Parsing Task B: Table Recognition to HTML Jiaquan Ye Xianbiao Qi Yelin He Yihao Chen Dengyi Gu Peng Gao Rong Xiao LMTD 34 48 0 05 May 2021
PingAn-VCGroup's Solution for ICDAR 2021 Competition on Scientific Table Image Recognition to Latex Yelin He Xianbiao Qi Jiaquan Ye Peng Gao Yihao Chen Bingcong Li Xin Tang Rong Xiao LMTD 13 10 0 05 May 2021
Post-training deep neural network pruning via layer-wise calibration Ivan Lazarevich Alexander Kozlov Nikita Malinin 3DPC 18 25 0 30 Apr 2021
VM-MODNet: Vehicle Motion aware Moving Object Detection for Autonomous Driving Hazem Rashed Ahmad El-Sallab S. Yogamani 30 4 0 22 Apr 2021
Higher Order Recurrent Space-Time Transformer for Video Action Prediction Tsung-Ming Tai G. Fiameni Cheng-Kuang Lee Oswald Lanz 33 9 0 17 Apr 2021
TEACHTEXT: CrossModal Generalized Distillation for Text-Video Retrieval Ioana Croitoru Simion-Vlad Bogolin Marius Leordeanu Hailin Jin Andrew Zisserman Samuel Albanie Yang Liu VGen 21 124 0 16 Apr 2021
E2Style: Improve the Efficiency and Effectiveness of StyleGAN Inversion Tianyi Wei Dongdong Chen Wenbo Zhou Jing Liao Weiming Zhang Lu Yuan Gang Hua Nenghai Yu 39 60 0 15 Apr 2021
RIANN -- A Robust Neural Network Outperforms Attitude Estimation Filters Daniel Weber C. Gühmann Thomas Seel 12 35 0 15 Apr 2021
Targeted Adversarial Training for Natural Language Understanding L. Pereira Xiaodong Liu Hao Cheng Hoifung Poon Jianfeng Gao Ichiro Kobayashi 17 12 0 12 Apr 2021
Semantic Segmentation with Generative Models: Semi-Supervised Learning and Strong Out-of-Domain Generalization Daiqing Li Junlin Yang Karsten Kreis Antonio Torralba Sanja Fidler GAN MedIm 34 179 0 12 Apr 2021
SVDistNet: Self-Supervised Near-Field Distance Estimation on Surround View Fisheye Cameras Varun Ravi Kumar Marvin Klingner S. Yogamani Markus Bach Stefan Milz Tim Fingscheidt Patrick Mäder MDE 50 37 0 09 Apr 2021
Back to Square One: Superhuman Performance in Chutes and Ladders Through Deep Neural Networks and Tree Search Dylan R. Ashley Anssi Kanervisto Brendan Bennett 19 2 0 01 Apr 2021
Physics-informed neural networks for the shallow-water equations on the sphere Alexander Bihlo R. Popovych 14 77 0 01 Apr 2021
MIcro-Surgical Anastomose Workflow recognition challenge report Arnaud Huaulmé Duygu Sarikaya Kévin Le Mut Fabien Despinoy Yonghao Long ... Pablo Arbelaez Wolfgang Reiter M. Mitsuishi K. Harada Pierre Jannin 19 34 0 24 Mar 2021
Hierarchical Attention-based Age Estimation and Bias Estimation Shakediel Hiba Y. Keller CVBM 32 10 0 17 Mar 2021
Hierarchical forecasting with a top-down alignment of independent level forecasts Matthias Anderer Feng Li AI4TS 19 13 0 15 Mar 2021
Learning spectro-temporal representations of complex sounds with parameterized neural networks Rachid Riad Julien Karadayi Anne-Catherine Bachoud-Lévi Emmanuel Dupoux 29 7 0 12 Mar 2021
Convergence and Accuracy Trade-Offs in Federated Learning and Meta-Learning Zachary B. Charles Jakub Konecný FedML 26 63 0 08 Mar 2021
Personalized Federated Learning using Hypernetworks Aviv Shamsian Aviv Navon Ethan Fetaya Gal Chechik FedML 41 324 0 08 Mar 2021
Enhanced 3D Human Pose Estimation from Videos by using Attention-Based Neural Network with Dilated Convolutions Ruixu Liu Ju Shen He Wang Chong Chen S. Cheung V. Asari 3DH 25 29 0 04 Mar 2021
Improved Techniques for Quantizing Deep Networks with Adaptive Bit-Widths Ximeng Sun Yikang Shen Chun-Fu Chen Naigang Wang Bowen Pan Bowen Pan Kailash Gopalakrishnan A. Oliva Rogerio Feris Kate Saenko MQ 24 4 0 02 Mar 2021
Searching for Robustness: Loss Learning for Noisy Classification Tasks Boyan Gao Henry Gouk Timothy M. Hospedales OOD NoLa 36 18 0 27 Feb 2021
Surgical Visual Domain Adaptation: Results from the MICCAI 2020 SurgVisDom Challenge Aneeq Zia Kiran D. Bhattacharyya Xi Liu Ziheng Wang S. Kondo ... Raabid Hussain Lena Maier-Hein Danail Stoyanov Stefanie Speidel A. Jarc 46 20 0 26 Feb 2021
ISCL: Interdependent Self-Cooperative Learning for Unpaired Image Denoising Kanggeun Lee Won-Ki Jeong 20 35 0 19 Feb 2021
Complex Momentum for Optimization in Games Jonathan Lorraine David Acuna Paul Vicol David Duvenaud 20 9 0 16 Feb 2021
OmniDet: Surround View Cameras based Multi-task Visual Perception Network for Autonomous Driving Varun Ravi Kumar S. Yogamani Hazem Rashed Ganesh Sitsu Christian Witt Isabelle Leang Stefan Milz Patrick Mäder 39 90 0 15 Feb 2021
Self-supervised driven consistency training for annotation efficient histopathology image analysis C. Srinidhi Seung Wook Kim Fu-Der Chen Anne L. Martel SSL 21 109 0 07 Feb 2021
Only a Matter of Style: Age Transformation Using a Style-Based Regression Model Yuval Alaluf Or Patashnik Daniel Cohen-Or 17 137 0 04 Feb 2021