ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 1907.08610
  4. Cited By
Lookahead Optimizer: k steps forward, 1 step back
v1v2 (latest)

Lookahead Optimizer: k steps forward, 1 step back

19 July 2019
Michael Ruogu Zhang
James Lucas
Geoffrey E. Hinton
Jimmy Ba
    ODL
ArXiv (abs)PDFHTML

Papers citing "Lookahead Optimizer: k steps forward, 1 step back"

50 / 357 papers shown
Title
Personalized Federated Learning using Hypernetworks
Personalized Federated Learning using Hypernetworks
Aviv Shamsian
Aviv Navon
Ethan Fetaya
Gal Chechik
FedML
118
339
0
08 Mar 2021
Enhanced 3D Human Pose Estimation from Videos by using Attention-Based
  Neural Network with Dilated Convolutions
Enhanced 3D Human Pose Estimation from Videos by using Attention-Based Neural Network with Dilated Convolutions
Ruixu Liu
Ju Shen
He Wang
Chong Chen
S. Cheung
V. Asari
3DH
70
31
0
04 Mar 2021
Improved Techniques for Quantizing Deep Networks with Adaptive
  Bit-Widths
Improved Techniques for Quantizing Deep Networks with Adaptive Bit-Widths
Ximeng Sun
Yikang Shen
Chun-Fu Chen
Naigang Wang
Bowen Pan
Bowen Pan Kailash Gopalakrishnan
A. Oliva
Rogerio Feris
Kate Saenko
MQ
78
4
0
02 Mar 2021
Searching for Robustness: Loss Learning for Noisy Classification Tasks
Searching for Robustness: Loss Learning for Noisy Classification Tasks
Boyan Gao
Henry Gouk
Timothy M. Hospedales
OODNoLa
81
18
0
27 Feb 2021
Surgical Visual Domain Adaptation: Results from the MICCAI 2020
  SurgVisDom Challenge
Surgical Visual Domain Adaptation: Results from the MICCAI 2020 SurgVisDom Challenge
Aneeq Zia
Kiran D. Bhattacharyya
Xi Liu
Ziheng Wang
S. Kondo
...
Raabid Hussain
Lena Maier-Hein
Danail Stoyanov
Stefanie Speidel
A. Jarc
86
20
0
26 Feb 2021
ISCL: Interdependent Self-Cooperative Learning for Unpaired Image
  Denoising
ISCL: Interdependent Self-Cooperative Learning for Unpaired Image Denoising
Kanggeun Lee
Won-Ki Jeong
56
36
0
19 Feb 2021
Complex Momentum for Optimization in Games
Complex Momentum for Optimization in Games
Jonathan Lorraine
David Acuna
Paul Vicol
David Duvenaud
75
9
0
16 Feb 2021
OmniDet: Surround View Cameras based Multi-task Visual Perception
  Network for Autonomous Driving
OmniDet: Surround View Cameras based Multi-task Visual Perception Network for Autonomous Driving
Varun Ravi Kumar
S. Yogamani
Hazem Rashed
Ganesh Sitsu
Christian Witt
Isabelle Leang
Stefan Milz
Patrick Mäder
106
92
0
15 Feb 2021
Self-supervised driven consistency training for annotation efficient
  histopathology image analysis
Self-supervised driven consistency training for annotation efficient histopathology image analysis
C. Srinidhi
Seung Wook Kim
Fu-Der Chen
Anne L. Martel
SSL
101
111
0
07 Feb 2021
Only a Matter of Style: Age Transformation Using a Style-Based
  Regression Model
Only a Matter of Style: Age Transformation Using a Style-Based Regression Model
Yuval Alaluf
Or Patashnik
Daniel Cohen-Or
75
141
0
04 Feb 2021
IWA: Integrated Gradient based White-box Attacks for Fooling Deep Neural
  Networks
IWA: Integrated Gradient based White-box Attacks for Fooling Deep Neural Networks
Yixiang Wang
Jiqiang Liu
Xiaolin Chang
J. Misic
Vojislav B. Mišić
AAML
69
12
0
03 Feb 2021
Automated Deep Learning Analysis of Angiography Video Sequences for
  Coronary Artery Disease
Automated Deep Learning Analysis of Angiography Video Sequences for Coronary Artery Disease
Chengyang Zhou
Thao Vy Dinh
Heyi Kong
J. Yap
K. Yeo
H. Lee
Kaicheng Liang
84
13
0
29 Jan 2021
Multilingual and cross-lingual document classification: A meta-learning
  approach
Multilingual and cross-lingual document classification: A meta-learning approach
Niels van der Heijden
H. Yannakoudakis
Pushkar Mishra
Ekaterina Shutova
VLM
70
24
0
27 Jan 2021
Knowledge Generation -- Variational Bayes on Knowledge Graphs
Knowledge Generation -- Variational Bayes on Knowledge Graphs
Florian Wolf
BDL
27
0
0
21 Jan 2021
Advances in Electron Microscopy with Deep Learning
Advances in Electron Microscopy with Deep Learning
Jeffrey M. Ede
107
3
0
04 Jan 2021
Dynamic Traffic Modeling From Overhead Imagery
Dynamic Traffic Modeling From Overhead Imagery
Scott Workman
Nathan Jacobs
68
17
0
18 Dec 2020
FedADC: Accelerated Federated Learning with Drift Control
FedADC: Accelerated Federated Learning with Drift Control
Emre Ozfatura
Kerem Ozfatura
Deniz Gunduz
FedML
109
38
0
16 Dec 2020
Sparse encoding for more-interpretable feature-selecting representations
  in probabilistic matrix factorization
Sparse encoding for more-interpretable feature-selecting representations in probabilistic matrix factorization
Joshua C. Chang
P. Fletcher
Ju Han
Ted L.Chang
Shashaank Vattikuti
Bart Desmet
Ayah Zirikly
Carson C. Chow
39
4
0
08 Dec 2020
Phonetic Posteriorgrams based Many-to-Many Singing Voice Conversion via
  Adversarial Training
Phonetic Posteriorgrams based Many-to-Many Singing Voice Conversion via Adversarial Training
Haohan Guo
Heng Lu
Na Hu
Chunlei Zhang
Shan Yang
Lei Xie
Jane Polak Scowcroft
Dong Yu
AAML
68
12
0
03 Dec 2020
Lookahead optimizer improves the performance of Convolutional
  Autoencoders for reconstruction of natural images
Lookahead optimizer improves the performance of Convolutional Autoencoders for reconstruction of natural images
Sayan Nag
DRL
31
2
0
03 Dec 2020
MaX-DeepLab: End-to-End Panoptic Segmentation with Mask Transformers
MaX-DeepLab: End-to-End Panoptic Segmentation with Mask Transformers
Huiyu Wang
Yukun Zhu
Hartwig Adam
Alan Yuille
Liang-Chieh Chen
ViT
154
531
0
01 Dec 2020
Deep learning in magnetic resonance prostate segmentation: A review and
  a new perspective
Deep learning in magnetic resonance prostate segmentation: A review and a new perspective
David Gillespie
Connah Kendrick
I. Boon
C. Boon
T. Rattay
Moi Hoon Yap
35
12
0
16 Nov 2020
Conflicting Bundles: Adapting Architectures Towards the Improved
  Training of Deep Neural Networks
Conflicting Bundles: Adapting Architectures Towards the Improved Training of Deep Neural Networks
David Peer
Sebastian Stabinger
A. Rodríguez-Sánchez
21
6
0
05 Nov 2020
Generalized Wasserstein Dice Score, Distributionally Robust Deep
  Learning, and Ranger for brain tumor segmentation: BraTS 2020 challenge
Generalized Wasserstein Dice Score, Distributionally Robust Deep Learning, and Ranger for brain tumor segmentation: BraTS 2020 challenge
Lucas Fidon
Sebastien Ourselin
Tom Vercauteren
OODMedIm
74
43
0
03 Nov 2020
Brain tumor segmentation with self-ensembled, deeply-supervised 3D U-net
  neural networks: a BraTS 2020 challenge solution
Brain tumor segmentation with self-ensembled, deeply-supervised 3D U-net neural networks: a BraTS 2020 challenge solution
T. Henry
Alexandre Carré
Marvin Lerousseau
Théo Estienne
C. Robert
Nikos Paragios
Eric Deutsch
45
80
0
30 Oct 2020
Genetic U-Net: Automatically Designed Deep Networks for Retinal Vessel
  Segmentation Using a Genetic Algorithm
Genetic U-Net: Automatically Designed Deep Networks for Retinal Vessel Segmentation Using a Genetic Algorithm
Jiahong Wei
Zhun Fan
68
78
0
29 Oct 2020
Measuring and Harnessing Transference in Multi-Task Learning
Measuring and Harnessing Transference in Multi-Task Learning
Christopher Fifty
Ehsan Amid
Zhe Zhao
Tianhe Yu
Rohan Anil
Chelsea Finn
104
15
0
29 Oct 2020
Learning Transferrable Parameters for Long-tailed Sequential User
  Behavior Modeling
Learning Transferrable Parameters for Long-tailed Sequential User Behavior Modeling
Jianwen Yin
Chenghao Liu
Weiqing Wang
Jianling Sun
Guosheng Lin
58
30
0
22 Oct 2020
Learning Curves for Analysis of Deep Networks
Learning Curves for Analysis of Deep Networks
Derek Hoiem
Tanmay Gupta
Zhizhong Li
Michal Shlapentokh-Rothman
82
26
0
21 Oct 2020
How much progress have we made in neural network training? A New
  Evaluation Protocol for Benchmarking Optimizers
How much progress have we made in neural network training? A New Evaluation Protocol for Benchmarking Optimizers
Yuanhao Xiong
Xuanqing Liu
Li-Cheng Lan
Yang You
Si Si
Cho-Jui Hsieh
OOD
97
1
0
19 Oct 2020
Training Stronger Baselines for Learning to Optimize
Training Stronger Baselines for Learning to Optimize
Tianlong Chen
Weiyi Zhang
Jingyang Zhou
Shiyu Chang
Sijia Liu
Lisa Amini
Zhangyang Wang
OffRL
86
52
0
18 Oct 2020
AdaBelief Optimizer: Adapting Stepsizes by the Belief in Observed
  Gradients
AdaBelief Optimizer: Adapting Stepsizes by the Belief in Observed Gradients
Juntang Zhuang
Tommy M. Tang
Yifan Ding
S. Tatikonda
Nicha Dvornek
X. Papademetris
James S. Duncan
ODL
232
526
0
15 Oct 2020
A method for escaping limit cycles in training GANs
A method for escaping limit cycles in training GANs
Li Keke
Xinmin Yang
75
0
0
07 Oct 2020
BAMSProd: A Step towards Generalizing the Adaptive Optimization Methods
  to Deep Binary Model
BAMSProd: A Step towards Generalizing the Adaptive Optimization Methods to Deep Binary Model
Junjie Liu
Dongchao Wen
Deyu Wang
Wei Tao
Tse-Wei Chen
Kinya Osa
Masami Kato
MQ
44
1
0
29 Sep 2020
Towards General Purpose Geometry-Preserving Single-View Depth Estimation
Towards General Purpose Geometry-Preserving Single-View Depth Estimation
Mikhail Romanov
Nikolay Patatkin
Anna Vorontsova
Sergey Nikolenko
Anton Konushin
Dmitry Senyushkin
MDE
38
3
0
25 Sep 2020
Predicting galaxy spectra from images with hybrid convolutional neural
  networks
Predicting galaxy spectra from images with hybrid convolutional neural networks
John F. Wu
J. E. G. Peek
27
9
0
25 Sep 2020
Multi-Modal Reasoning Graph for Scene-Text Based Fine-Grained Image
  Classification and Retrieval
Multi-Modal Reasoning Graph for Scene-Text Based Fine-Grained Image Classification and Retrieval
Andrés Mafla
S. Dey
Ali Furkan Biten
Lluís Gómez
Dimosthenis Karatzas
80
25
0
21 Sep 2020
Detecting Sound Events Using Convolutional Macaron Net With Pseudo
  Strong Labels
Detecting Sound Events Using Convolutional Macaron Net With Pseudo Strong Labels
T. K. Chan
C. Chin
35
2
0
21 Sep 2020
Review: Deep Learning in Electron Microscopy
Review: Deep Learning in Electron Microscopy
Jeffrey M. Ede
197
80
0
17 Sep 2020
CRNNs for Urban Sound Tagging with spatiotemporal context
CRNNs for Urban Sound Tagging with spatiotemporal context
Augustin Arnault
Nicolas Riche
58
7
0
24 Aug 2020
Deep Volumetric Ambient Occlusion
Deep Volumetric Ambient Occlusion
Dominik Engel
Timo Ropinski
77
22
0
19 Aug 2020
Adaptive Hierarchical Hyper-gradient Descent
Adaptive Hierarchical Hyper-gradient Descent
Renlong Jie
Junbin Gao
A. Vasnev
Minh-Ngoc Tran
54
5
0
17 Aug 2020
Obtaining Adjustable Regularization for Free via Iterate Averaging
Obtaining Adjustable Regularization for Free via Iterate Averaging
Jingfeng Wu
Vladimir Braverman
Lin F. Yang
63
2
0
15 Aug 2020
SynDistNet: Self-Supervised Monocular Fisheye Camera Distance Estimation
  Synergized with Semantic Segmentation for Autonomous Driving
SynDistNet: Self-Supervised Monocular Fisheye Camera Distance Estimation Synergized with Semantic Segmentation for Autonomous Driving
V. Kumar
Marvin Klingner
S. Yogamani
Stefan Milz
Tim Fingscheidt
Patrick Mäder
MDE
128
81
0
10 Aug 2020
Improving End-to-End Speech-to-Intent Classification with Reptile
Improving End-to-End Speech-to-Intent Classification with Reptile
Yusheng Tian
P. Gorinski
VLM
81
24
0
05 Aug 2020
Two-Stage Deep Learning for Accelerated 3D Time-of-Flight MRA without
  Matched Training Data
Two-Stage Deep Learning for Accelerated 3D Time-of-Flight MRA without Matched Training Data
Hyungjin Chung
Eunju Cha
Leonard Sunwoo
J. C. Ye
MedIm
89
26
0
04 Aug 2020
Encoding in Style: a StyleGAN Encoder for Image-to-Image Translation
Encoding in Style: a StyleGAN Encoder for Image-to-Image Translation
Elad Richardson
Yuval Alaluf
Or Patashnik
Yotam Nitzan
Yaniv Azar
Stav Shapiro
Daniel Cohen-Or
282
1,114
0
03 Aug 2020
Bilevel Continual Learning
Bilevel Continual Learning
Quang Pham
Doyen Sahoo
Chenghao Liu
Guosheng Lin
CLL
83
11
0
30 Jul 2020
Single Image Cloud Detection via Multi-Image Fusion
Single Image Cloud Detection via Multi-Image Fusion
Scott Workman
M. U. Rafique
Hunter Blanton
Connor Greenwell
Nathan Jacobs
24
5
0
29 Jul 2020
Comparative study of deep learning methods for the automatic
  segmentation of lung, lesion and lesion type in CT scans of COVID-19 patients
Comparative study of deep learning methods for the automatic segmentation of lung, lesion and lesion type in CT scans of COVID-19 patients
Sofie Tilborghs
Ine Dirks
Lucas Fidon
S. Willems
Tom Eelbode
...
D. Robben
D. Smeets
F. Maes
Jef Vandemeulebroucke
P. Suetens
OOD
87
28
0
29 Jul 2020
Previous
12345678
Next