v1v2 (latest)

Lookahead Optimizer: k steps forward, 1 step back

19 July 2019

Jimmy Ba

Papers citing "Lookahead Optimizer: k steps forward, 1 step back"

50 / 357 papers shown

Title
Generative Probabilistic Image Colorization Chie Furusawa S. Kitaoka Michael Li Yuri Odagiri DiffM 215 4 0 29 Sep 2021
High-Fidelity GAN Inversion for Image Attribute Editing Tengfei Wang Yong Zhang Yanbo Fan Jue Wang Qifeng Chen DiffM 304 252 0 14 Sep 2021
Efficiently Identifying Task Groupings for Multi-Task Learning Christopher Fifty Ehsan Amid Zhe Zhao Tianhe Yu Rohan Anil Chelsea Finn 301 258 1 10 Sep 2021
Sequential Attention Module for Natural Language Processing Mengyuan Zhou Jian Ma Haiqing Yang Lian-Xin Jiang Yang Mo AI4TS 39 2 0 07 Sep 2021
Robust fine-tuning of zero-shot models Mitchell Wortsman Gabriel Ilharco Jong Wook Kim Mike Li Simon Kornblith ... Raphael Gontijo-Lopes Hannaneh Hajishirzi Ali Farhadi Hongseok Namkoong Ludwig Schmidt VLM 231 742 0 04 Sep 2021
TrouSPI-Net: Spatio-temporal attention on parallel atrous convolutions and U-GRUs for skeletal pedestrian crossing prediction Joseph Gesnouin Steve Pechberti B. Stanciulescu Fabien Moutarde 92 24 0 02 Sep 2021
On Accelerating Distributed Convex Optimizations Kushal Chakrabarti Nirupam Gupta Nikhil Chopra 67 7 0 19 Aug 2021
SO-Pose: Exploiting Self-Occlusion for Direct 6D Pose Estimation Yan Di Fabian Manhardt Gu Wang Xiangyang Ji Nassir Navab Federico Tombari 58 135 0 18 Aug 2021
Learning to Elect Cem Anil Xuchan Bao 27 8 0 05 Aug 2021
Real-time Streaming Perception System for Autonomous Driving Yongxiang Gu Qianlei Wang Xiaolin Qin 36 6 0 30 Jul 2021
1st Place Solution for ICDAR 2021 Competition on Mathematical Formula Detection Yuxiang Zhong Xianbiao Qi Shanjun Li Dengyi Gu Yihao Chen Peiyang Ning Rong Xiao 27 6 0 12 Jul 2021
Delta Sampling R-BERT for limited data and low-light action recognition Sanchit Hira Ritwik Das Abhinav Modi D. Pakhomov 109 17 0 12 Jul 2021
BEV-MODNet: Monocular Camera based Bird's Eye View Moving Object Detection for Autonomous Driving Hazem Rashed Mariam Essam M. Mohamed Ahmad El-Sallab S. Yogamani 50 12 0 11 Jul 2021
KOALA: A Kalman Optimization Algorithm with Loss Adaptivity A. Davtyan Sepehr Sameni L. Cerkezi Givi Meishvili Adam Bielski Paolo Favaro ODL 174 3 0 07 Jul 2021
Ranger21: a synergistic deep learning optimizer Less Wright Nestor Demeure ODL AI4CE 104 88 0 25 Jun 2021
Adaptive Learning Rate and Momentum for Training Deep Neural Networks Zhiyong Hao Yixuan Jiang Huihua Yu H. Chiang ODL 40 10 0 22 Jun 2021
Well-tuned Simple Nets Excel on Tabular Datasets Arlind Kadra Marius Lindauer Frank Hutter Josif Grabocka 68 202 0 21 Jun 2021
Drum-Aware Ensemble Architecture for Improved Joint Musical Beat and Downbeat Tracking Ching-Yu Chiu A. Su Yi-Hsuan Yang 58 11 0 16 Jun 2021
Modeling Hierarchical Structures with Continuous Recursive Neural Networks Jishnu Ray Chowdhury Cornelia Caragea 76 15 0 10 Jun 2021
Highlighting the Importance of Reducing Research Bias and Carbon Emissions in CNNs A. Badar Arnav Varma Adrian Staniec Mahmoud Gamal Omar Magdy Haris Iqbal Elahe Arani Bahram Zonooz 95 7 0 06 Jun 2021
Self-Attention Between Datapoints: Going Beyond Individual Input-Output Pairs in Deep Learning Jannik Kossen Neil Band Clare Lyle Aidan Gomez Tom Rainforth Y. Gal OOD 3DPC 124 142 0 04 Jun 2021
TransMIL: Transformer based Correlated Multiple Instance Learning for Whole Slide Image Classification Zhucheng Shao Hao Bian Yang Chen Yifeng Wang Jian Zhang Xiangyang Ji Yongbing Zhang ViT MedIm 144 691 0 02 Jun 2021
VidFace: A Full-Transformer Solver for Video FaceHallucination with Unaligned Tiny Snapshots Y. Gan Yawei Luo Xin Yu Bang Zhang Yi Yang ViT CVBM 59 3 0 31 May 2021
ICDAR 2021 Competition on Scientific Table Image Recognition to LaTeX Pratik Kayal Mrinal Anand Harsh Desai M. Singh LMTD 82 12 0 30 May 2021
AutoSampling: Search for Effective Data Sampling Schedules Ming Sun Hao Dou Baopu Li Lei Cui Junjie Yan Wanli Ouyang 70 6 0 28 May 2021
Training With Data Dependent Dynamic Learning Rates Shreyas Saxena Nidhi Vyas D. DeCoste ODL 21 1 0 27 May 2021
An Online Learning System for Wireless Charging Alignment using Surround-view Fisheye Cameras Ashok Dahal V. Kumar S. Yogamani Ciarán Eising 139 12 0 26 May 2021
Learning to Detect Fortified Areas A. Jørgensen Jonas Tranberg 56 0 0 26 May 2021
Denoising Noisy Neural Networks: A Bayesian Approach with Compensation Yulin Shao Soung Chang Liew Deniz Gunduz 94 14 0 22 May 2021
Sampling-Frequency-Independent Audio Source Separation Using Convolution Layer Based on Impulse Invariant Method Koichi Saito Tomohiko Nakamura Kohei Yatabe Yuma Koizumi Hiroshi Saruwatari BDL VLM 46 7 0 10 May 2021
Audio Retrieval with Natural Language Queries Andreea-Maria Oncescu A. Sophia Koepke João F. Henriques Zeynep Akata Samuel Albanie 63 79 0 05 May 2021
Non-Autoregressive vs Autoregressive Neural Networks for System Identification Daniel Weber C. Gühmann 54 7 0 05 May 2021
PingAn-VCGroup's Solution for ICDAR 2021 Competition on Scientific Literature Parsing Task B: Table Recognition to HTML Jiaquan Ye Xianbiao Qi Yelin He Yihao Chen Dengyi Gu Peng Gao Rong Xiao LMTD 90 50 0 05 May 2021
PingAn-VCGroup's Solution for ICDAR 2021 Competition on Scientific Table Image Recognition to Latex Yelin He Xianbiao Qi Jiaquan Ye Peng Gao Yihao Chen Bingcong Li Xin Tang Rong Xiao LMTD 60 11 0 05 May 2021
Post-training deep neural network pruning via layer-wise calibration Ivan Lazarevich Alexander Kozlov Nikita Malinin 3DPC 80 27 0 30 Apr 2021
VM-MODNet: Vehicle Motion aware Moving Object Detection for Autonomous Driving Hazem Rashed Ahmad El-Sallab S. Yogamani 43 4 0 22 Apr 2021
Higher Order Recurrent Space-Time Transformer for Video Action Prediction Tsung-Ming Tai G. Fiameni Cheng-Kuang Lee Oswald Lanz 66 9 0 17 Apr 2021
TEACHTEXT: CrossModal Generalized Distillation for Text-Video Retrieval Ioana Croitoru Simion-Vlad Bogolin Marius Leordeanu Hailin Jin Andrew Zisserman Samuel Albanie Yang Liu VGen 67 125 0 16 Apr 2021
E2Style: Improve the Efficiency and Effectiveness of StyleGAN Inversion Tianyi Wei Dongdong Chen Wenbo Zhou Jing Liao Weiming Zhang Lu Yuan Gang Hua Nenghai Yu 107 64 0 15 Apr 2021
RIANN -- A Robust Neural Network Outperforms Attitude Estimation Filters Daniel Weber C. Gühmann Thomas Seel 69 37 0 15 Apr 2021
Targeted Adversarial Training for Natural Language Understanding L. Pereira Xiaodong Liu Hao Cheng Hoifung Poon Jianfeng Gao Ichiro Kobayashi 65 12 0 12 Apr 2021
Semantic Segmentation with Generative Models: Semi-Supervised Learning and Strong Out-of-Domain Generalization Daiqing Li Junlin Yang Karsten Kreis Antonio Torralba Sanja Fidler GAN MedIm 110 189 0 12 Apr 2021
SVDistNet: Self-Supervised Near-Field Distance Estimation on Surround View Fisheye Cameras Varun Ravi Kumar Marvin Klingner S. Yogamani Markus Bach Stefan Milz Tim Fingscheidt Patrick Mäder MDE 101 38 0 09 Apr 2021
Back to Square One: Superhuman Performance in Chutes and Ladders Through Deep Neural Networks and Tree Search Dylan R. Ashley Anssi Kanervisto Brendan Bennett 77 2 0 01 Apr 2021
Physics-informed neural networks for the shallow-water equations on the sphere Alexander Bihlo R. Popovych 79 79 0 01 Apr 2021
MIcro-Surgical Anastomose Workflow recognition challenge report Arnaud Huaulmé Duygu Sarikaya Kévin Le Mut Fabien Despinoy Yonghao Long ... Pablo Arbelaez Wolfgang Reiter M. Mitsuishi K. Harada Pierre Jannin 59 36 0 24 Mar 2021
Hierarchical Attention-based Age Estimation and Bias Estimation Shakediel Hiba Y. Keller CVBM 75 11 0 17 Mar 2021
Hierarchical forecasting with a top-down alignment of independent level forecasts Matthias Anderer Feng Li AI4TS 57 14 0 15 Mar 2021
Learning spectro-temporal representations of complex sounds with parameterized neural networks Rachid Riad Julien Karadayi Anne-Catherine Bachoud-Lévi Emmanuel Dupoux 49 7 0 12 Mar 2021
Convergence and Accuracy Trade-Offs in Federated Learning and Meta-Learning Zachary B. Charles Jakub Konecný FedML 103 64 0 08 Mar 2021