ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 1907.08610
  4. Cited By
Lookahead Optimizer: k steps forward, 1 step back
v1v2 (latest)

Lookahead Optimizer: k steps forward, 1 step back

19 July 2019
Michael Ruogu Zhang
James Lucas
Geoffrey E. Hinton
Jimmy Ba
    ODL
ArXiv (abs)PDFHTML

Papers citing "Lookahead Optimizer: k steps forward, 1 step back"

50 / 357 papers shown
Title
Generative Probabilistic Image Colorization
Generative Probabilistic Image Colorization
Chie Furusawa
S. Kitaoka
Michael Li
Yuri Odagiri
DiffM
215
4
0
29 Sep 2021
High-Fidelity GAN Inversion for Image Attribute Editing
High-Fidelity GAN Inversion for Image Attribute Editing
Tengfei Wang
Yong Zhang
Yanbo Fan
Jue Wang
Qifeng Chen
DiffM
304
252
0
14 Sep 2021
Efficiently Identifying Task Groupings for Multi-Task Learning
Efficiently Identifying Task Groupings for Multi-Task Learning
Christopher Fifty
Ehsan Amid
Zhe Zhao
Tianhe Yu
Rohan Anil
Chelsea Finn
301
258
1
10 Sep 2021
Sequential Attention Module for Natural Language Processing
Sequential Attention Module for Natural Language Processing
Mengyuan Zhou
Jian Ma
Haiqing Yang
Lian-Xin Jiang
Yang Mo
AI4TS
39
2
0
07 Sep 2021
Robust fine-tuning of zero-shot models
Robust fine-tuning of zero-shot models
Mitchell Wortsman
Gabriel Ilharco
Jong Wook Kim
Mike Li
Simon Kornblith
...
Raphael Gontijo-Lopes
Hannaneh Hajishirzi
Ali Farhadi
Hongseok Namkoong
Ludwig Schmidt
VLM
231
742
0
04 Sep 2021
TrouSPI-Net: Spatio-temporal attention on parallel atrous convolutions
  and U-GRUs for skeletal pedestrian crossing prediction
TrouSPI-Net: Spatio-temporal attention on parallel atrous convolutions and U-GRUs for skeletal pedestrian crossing prediction
Joseph Gesnouin
Steve Pechberti
B. Stanciulescu
Fabien Moutarde
92
24
0
02 Sep 2021
On Accelerating Distributed Convex Optimizations
On Accelerating Distributed Convex Optimizations
Kushal Chakrabarti
Nirupam Gupta
Nikhil Chopra
67
7
0
19 Aug 2021
SO-Pose: Exploiting Self-Occlusion for Direct 6D Pose Estimation
SO-Pose: Exploiting Self-Occlusion for Direct 6D Pose Estimation
Yan Di
Fabian Manhardt
Gu Wang
Xiangyang Ji
Nassir Navab
Federico Tombari
58
135
0
18 Aug 2021
Learning to Elect
Learning to Elect
Cem Anil
Xuchan Bao
27
8
0
05 Aug 2021
Real-time Streaming Perception System for Autonomous Driving
Real-time Streaming Perception System for Autonomous Driving
Yongxiang Gu
Qianlei Wang
Xiaolin Qin
36
6
0
30 Jul 2021
1st Place Solution for ICDAR 2021 Competition on Mathematical Formula
  Detection
1st Place Solution for ICDAR 2021 Competition on Mathematical Formula Detection
Yuxiang Zhong
Xianbiao Qi
Shanjun Li
Dengyi Gu
Yihao Chen
Peiyang Ning
Rong Xiao
27
6
0
12 Jul 2021
Delta Sampling R-BERT for limited data and low-light action recognition
Delta Sampling R-BERT for limited data and low-light action recognition
Sanchit Hira
Ritwik Das
Abhinav Modi
D. Pakhomov
109
17
0
12 Jul 2021
BEV-MODNet: Monocular Camera based Bird's Eye View Moving Object
  Detection for Autonomous Driving
BEV-MODNet: Monocular Camera based Bird's Eye View Moving Object Detection for Autonomous Driving
Hazem Rashed
Mariam Essam
M. Mohamed
Ahmad El-Sallab
S. Yogamani
50
12
0
11 Jul 2021
KOALA: A Kalman Optimization Algorithm with Loss Adaptivity
KOALA: A Kalman Optimization Algorithm with Loss Adaptivity
A. Davtyan
Sepehr Sameni
L. Cerkezi
Givi Meishvili
Adam Bielski
Paolo Favaro
ODL
174
3
0
07 Jul 2021
Ranger21: a synergistic deep learning optimizer
Ranger21: a synergistic deep learning optimizer
Less Wright
Nestor Demeure
ODLAI4CE
104
88
0
25 Jun 2021
Adaptive Learning Rate and Momentum for Training Deep Neural Networks
Adaptive Learning Rate and Momentum for Training Deep Neural Networks
Zhiyong Hao
Yixuan Jiang
Huihua Yu
H. Chiang
ODL
40
10
0
22 Jun 2021
Well-tuned Simple Nets Excel on Tabular Datasets
Well-tuned Simple Nets Excel on Tabular Datasets
Arlind Kadra
Marius Lindauer
Frank Hutter
Josif Grabocka
68
202
0
21 Jun 2021
Drum-Aware Ensemble Architecture for Improved Joint Musical Beat and
  Downbeat Tracking
Drum-Aware Ensemble Architecture for Improved Joint Musical Beat and Downbeat Tracking
Ching-Yu Chiu
A. Su
Yi-Hsuan Yang
58
11
0
16 Jun 2021
Modeling Hierarchical Structures with Continuous Recursive Neural
  Networks
Modeling Hierarchical Structures with Continuous Recursive Neural Networks
Jishnu Ray Chowdhury
Cornelia Caragea
76
15
0
10 Jun 2021
Highlighting the Importance of Reducing Research Bias and Carbon
  Emissions in CNNs
Highlighting the Importance of Reducing Research Bias and Carbon Emissions in CNNs
A. Badar
Arnav Varma
Adrian Staniec
Mahmoud Gamal
Omar Magdy
Haris Iqbal
Elahe Arani
Bahram Zonooz
95
7
0
06 Jun 2021
Self-Attention Between Datapoints: Going Beyond Individual Input-Output
  Pairs in Deep Learning
Self-Attention Between Datapoints: Going Beyond Individual Input-Output Pairs in Deep Learning
Jannik Kossen
Neil Band
Clare Lyle
Aidan Gomez
Tom Rainforth
Y. Gal
OOD3DPC
124
142
0
04 Jun 2021
TransMIL: Transformer based Correlated Multiple Instance Learning for
  Whole Slide Image Classification
TransMIL: Transformer based Correlated Multiple Instance Learning for Whole Slide Image Classification
Zhucheng Shao
Hao Bian
Yang Chen
Yifeng Wang
Jian Zhang
Xiangyang Ji
Yongbing Zhang
ViTMedIm
144
691
0
02 Jun 2021
VidFace: A Full-Transformer Solver for Video FaceHallucination with
  Unaligned Tiny Snapshots
VidFace: A Full-Transformer Solver for Video FaceHallucination with Unaligned Tiny Snapshots
Y. Gan
Yawei Luo
Xin Yu
Bang Zhang
Yi Yang
ViTCVBM
59
3
0
31 May 2021
ICDAR 2021 Competition on Scientific Table Image Recognition to LaTeX
ICDAR 2021 Competition on Scientific Table Image Recognition to LaTeX
Pratik Kayal
Mrinal Anand
Harsh Desai
M. Singh
LMTD
76
12
0
30 May 2021
AutoSampling: Search for Effective Data Sampling Schedules
AutoSampling: Search for Effective Data Sampling Schedules
Ming Sun
Hao Dou
Baopu Li
Lei Cui
Junjie Yan
Wanli Ouyang
70
6
0
28 May 2021
Training With Data Dependent Dynamic Learning Rates
Training With Data Dependent Dynamic Learning Rates
Shreyas Saxena
Nidhi Vyas
D. DeCoste
ODL
21
1
0
27 May 2021
An Online Learning System for Wireless Charging Alignment using
  Surround-view Fisheye Cameras
An Online Learning System for Wireless Charging Alignment using Surround-view Fisheye Cameras
Ashok Dahal
V. Kumar
S. Yogamani
Ciarán Eising
139
12
0
26 May 2021
Learning to Detect Fortified Areas
Learning to Detect Fortified Areas
A. Jørgensen
Jonas Tranberg
53
0
0
26 May 2021
Denoising Noisy Neural Networks: A Bayesian Approach with Compensation
Denoising Noisy Neural Networks: A Bayesian Approach with Compensation
Yulin Shao
Soung Chang Liew
Deniz Gunduz
94
14
0
22 May 2021
Sampling-Frequency-Independent Audio Source Separation Using Convolution
  Layer Based on Impulse Invariant Method
Sampling-Frequency-Independent Audio Source Separation Using Convolution Layer Based on Impulse Invariant Method
Koichi Saito
Tomohiko Nakamura
Kohei Yatabe
Yuma Koizumi
Hiroshi Saruwatari
BDLVLM
43
7
0
10 May 2021
Audio Retrieval with Natural Language Queries
Audio Retrieval with Natural Language Queries
Andreea-Maria Oncescu
A. Sophia Koepke
João F. Henriques
Zeynep Akata
Samuel Albanie
63
79
0
05 May 2021
Non-Autoregressive vs Autoregressive Neural Networks for System
  Identification
Non-Autoregressive vs Autoregressive Neural Networks for System Identification
Daniel Weber
C. Gühmann
54
7
0
05 May 2021
PingAn-VCGroup's Solution for ICDAR 2021 Competition on Scientific
  Literature Parsing Task B: Table Recognition to HTML
PingAn-VCGroup's Solution for ICDAR 2021 Competition on Scientific Literature Parsing Task B: Table Recognition to HTML
Jiaquan Ye
Xianbiao Qi
Yelin He
Yihao Chen
Dengyi Gu
Peng Gao
Rong Xiao
LMTD
90
50
0
05 May 2021
PingAn-VCGroup's Solution for ICDAR 2021 Competition on Scientific Table
  Image Recognition to Latex
PingAn-VCGroup's Solution for ICDAR 2021 Competition on Scientific Table Image Recognition to Latex
Yelin He
Xianbiao Qi
Jiaquan Ye
Peng Gao
Yihao Chen
Bingcong Li
Xin Tang
Rong Xiao
LMTD
57
11
0
05 May 2021
Post-training deep neural network pruning via layer-wise calibration
Post-training deep neural network pruning via layer-wise calibration
Ivan Lazarevich
Alexander Kozlov
Nikita Malinin
3DPC
80
27
0
30 Apr 2021
VM-MODNet: Vehicle Motion aware Moving Object Detection for Autonomous
  Driving
VM-MODNet: Vehicle Motion aware Moving Object Detection for Autonomous Driving
Hazem Rashed
Ahmad El-Sallab
S. Yogamani
43
4
0
22 Apr 2021
Higher Order Recurrent Space-Time Transformer for Video Action
  Prediction
Higher Order Recurrent Space-Time Transformer for Video Action Prediction
Tsung-Ming Tai
G. Fiameni
Cheng-Kuang Lee
Oswald Lanz
66
9
0
17 Apr 2021
TEACHTEXT: CrossModal Generalized Distillation for Text-Video Retrieval
TEACHTEXT: CrossModal Generalized Distillation for Text-Video Retrieval
Ioana Croitoru
Simion-Vlad Bogolin
Marius Leordeanu
Hailin Jin
Andrew Zisserman
Samuel Albanie
Yang Liu
VGen
67
125
0
16 Apr 2021
E2Style: Improve the Efficiency and Effectiveness of StyleGAN Inversion
E2Style: Improve the Efficiency and Effectiveness of StyleGAN Inversion
Tianyi Wei
Dongdong Chen
Wenbo Zhou
Jing Liao
Weiming Zhang
Lu Yuan
Gang Hua
Nenghai Yu
107
64
0
15 Apr 2021
RIANN -- A Robust Neural Network Outperforms Attitude Estimation Filters
RIANN -- A Robust Neural Network Outperforms Attitude Estimation Filters
Daniel Weber
C. Gühmann
Thomas Seel
69
37
0
15 Apr 2021
Targeted Adversarial Training for Natural Language Understanding
Targeted Adversarial Training for Natural Language Understanding
L. Pereira
Xiaodong Liu
Hao Cheng
Hoifung Poon
Jianfeng Gao
Ichiro Kobayashi
65
12
0
12 Apr 2021
Semantic Segmentation with Generative Models: Semi-Supervised Learning
  and Strong Out-of-Domain Generalization
Semantic Segmentation with Generative Models: Semi-Supervised Learning and Strong Out-of-Domain Generalization
Daiqing Li
Junlin Yang
Karsten Kreis
Antonio Torralba
Sanja Fidler
GANMedIm
110
189
0
12 Apr 2021
SVDistNet: Self-Supervised Near-Field Distance Estimation on Surround
  View Fisheye Cameras
SVDistNet: Self-Supervised Near-Field Distance Estimation on Surround View Fisheye Cameras
Varun Ravi Kumar
Marvin Klingner
S. Yogamani
Markus Bach
Stefan Milz
Tim Fingscheidt
Patrick Mäder
MDE
101
38
0
09 Apr 2021
Back to Square One: Superhuman Performance in Chutes and Ladders Through
  Deep Neural Networks and Tree Search
Back to Square One: Superhuman Performance in Chutes and Ladders Through Deep Neural Networks and Tree Search
Dylan R. Ashley
Anssi Kanervisto
Brendan Bennett
77
2
0
01 Apr 2021
Physics-informed neural networks for the shallow-water equations on the
  sphere
Physics-informed neural networks for the shallow-water equations on the sphere
Alexander Bihlo
R. Popovych
77
79
0
01 Apr 2021
MIcro-Surgical Anastomose Workflow recognition challenge report
MIcro-Surgical Anastomose Workflow recognition challenge report
Arnaud Huaulmé
Duygu Sarikaya
Kévin Le Mut
Fabien Despinoy
Yonghao Long
...
Pablo Arbelaez
Wolfgang Reiter
M. Mitsuishi
K. Harada
Pierre Jannin
59
36
0
24 Mar 2021
Hierarchical Attention-based Age Estimation and Bias Estimation
Hierarchical Attention-based Age Estimation and Bias Estimation
Shakediel Hiba
Y. Keller
CVBM
75
11
0
17 Mar 2021
Hierarchical forecasting with a top-down alignment of independent level
  forecasts
Hierarchical forecasting with a top-down alignment of independent level forecasts
Matthias Anderer
Feng Li
AI4TS
57
14
0
15 Mar 2021
Learning spectro-temporal representations of complex sounds with
  parameterized neural networks
Learning spectro-temporal representations of complex sounds with parameterized neural networks
Rachid Riad
Julien Karadayi
Anne-Catherine Bachoud-Lévi
Emmanuel Dupoux
49
7
0
12 Mar 2021
Convergence and Accuracy Trade-Offs in Federated Learning and
  Meta-Learning
Convergence and Accuracy Trade-Offs in Federated Learning and Meta-Learning
Zachary B. Charles
Jakub Konecný
FedML
103
64
0
08 Mar 2021
Previous
12345678
Next