Learned Optimizers that Scale and Generalize

14 March 2017

Olga Wichrowska

Niru Maheswaranathan

Matthew W. Hoffman

Sergio Gomez Colmenarejo

Misha Denil

Nando de Freitas

Jascha Narain Sohl-Dickstein

AI4CE

ArXiv PDF HTML

Papers citing "Learned Optimizers that Scale and Generalize"

33 / 83 papers shown

Title
Contextualizing Enhances Gradient Based Meta Learning Evan Vogelbaum Rumen Dangovski L. Jing Marin Soljacic 34 3 0 17 Jul 2020
Automated Synthetic-to-Real Generalization Wuyang Chen Zhiding Yu Zhangyang Wang Anima Anandkumar 17 68 0 14 Jul 2020
A Comprehensive Overview and Survey of Recent Advances in Meta-Learning Huimin Peng VLM OffRL 24 35 0 17 Apr 2020
Meta-Learning in Neural Networks: A Survey Timothy M. Hospedales Antreas Antoniou P. Micaelli Amos Storkey OOD 93 1,939 0 11 Apr 2020
AutoML-Zero: Evolving Machine Learning Algorithms From Scratch Esteban Real Chen Liang David R. So Quoc V. Le 41 220 0 06 Mar 2020
From Learning to Meta-Learning: Reduced Training Overhead and Complexity for Communication Systems Osvaldo Simeone Sangwoo Park Joonhyuk Kang AI4CE 31 62 0 05 Jan 2020
MetalGAN: Multi-Domain Label-Less Image Synthesis Using cGANs and Meta-Learning Tomaso Fontanini Eleonora Iotti Luca Donati Andrea Prati GAN AI4CE 47 23 0 05 Dec 2019
Learning to Optimize in Swarms Yue Cao Tianlong Chen Zhangyang Wang Yang Shen 25 55 0 09 Nov 2019
Learning to Learn by Zeroth-Order Oracle Yangjun Ruan Yuanhao Xiong Sashank J. Reddi Sanjiv Kumar Cho-Jui Hsieh 22 17 0 21 Oct 2019
MetalGAN: a Cluster-based Adaptive Training for Few-Shot Adversarial Colorization Tomaso Fontanini Eleonora Iotti Andrea Prati GAN 39 4 0 17 Sep 2019
Discovery of Useful Questions as Auxiliary Tasks Vivek Veeriah Matteo Hessel Zhongwen Xu Richard L. Lewis Janarthanan Rajendran Junhyuk Oh H. V. Hasselt David Silver Satinder Singh LLMAG 22 86 0 10 Sep 2019
Optimizing quantum heuristics with meta-learning M. Wilson Rachel Stromswold Filip Wudarski Stuart Hadfield N. Tubman E. Rieffel 17 75 0 08 Aug 2019
Scalable Neural Architecture Search for 3D Medical Image Segmentation Sungwoong Kim Ildoo Kim Sungbin Lim Woonhyuk Baek Chiheon Kim Hyungjoon Cho Boogeon Yoon Taesup Kim 27 74 0 13 Jun 2019
Using learned optimizers to make models robust to input noise Luke Metz Niru Maheswaranathan Jonathon Shlens Jascha Narain Sohl-Dickstein E. D. Cubuk VLM OOD 23 26 0 08 Jun 2019
Instruction-Level Design of Local Optimisers using Push GP M. Lones 6 11 0 24 May 2019
Addressing the Loss-Metric Mismatch with Adaptive Loss Alignment Chen Huang Shuangfei Zhai Walter A. Talbott Miguel Angel Bautista Shi Sun Carlos Guestrin J. Susskind 29 75 0 15 May 2019
Meta-learning of Sequential Strategies Pedro A. Ortega Jane X. Wang Mark Rowland Tim Genewein Z. Kurth-Nelson ... Yee Whye Teh H. V. Hasselt Nando de Freitas M. Botvinick Shane Legg OffRL 27 97 0 08 May 2019
Mitigating Metaphors: A Comprehensible Guide to Recent Nature-Inspired Algorithms M. Lones 6 67 0 21 Feb 2019
Deep Frank-Wolfe For Neural Network Optimization Leonard Berrada Andrew Zisserman M. P. Kumar ODL 21 40 0 19 Nov 2018
Machine Learning for Combinatorial Optimization: a Methodological Tour d'Horizon Yoshua Bengio Andrea Lodi Antoine Prouvost 89 1,356 0 15 Nov 2018
M $^3$ RL: Mind-aware Multi-agent Management Reinforcement Learning Tianmin Shu Yuandong Tian 25 53 0 29 Sep 2018
Small Sample Learning in Big Data Era Jun Shu Zongben Xu Deyu Meng 29 71 0 14 Aug 2018
Decouple Learning for Parameterized Image Operators Qingnan Fan Dongdong Chen Lu Yuan G. Hua Nenghai Yu Baoquan Chen OOD 30 63 0 21 Jul 2018
Far-HO: A Bilevel Programming Package for Hyperparameter Optimization and Meta-Learning Luca Franceschi Riccardo Grazzi Massimiliano Pontil Saverio Salzo P. Frasconi 17 2 0 13 Jun 2018
Meta-Learning for Stochastic Gradient MCMC Wenbo Gong Yingzhen Li José Miguel Hernández-Lobato BDL 38 44 0 12 Jun 2018
Meta-Gradient Reinforcement Learning Zhongwen Xu H. V. Hasselt David Silver 53 324 0 24 May 2018
Meta-Learning with Hessian-Free Approach in Deep Neural Nets Training Boyu Chen Wenlian Lu Ernest Fokoue 21 1 0 22 May 2018
Reinforced Co-Training Jiawei Wu Lei Li William Yang Wang OffRL 25 51 0 17 Apr 2018
Neural Conditional Gradients P. Schramowski Christian Bauckhage Kristian Kersting 14 2 0 12 Mar 2018
Recasting Gradient-Based Meta-Learning as Hierarchical Bayes Erin Grant Chelsea Finn Sergey Levine Trevor Darrell Thomas Griffiths BDL 26 505 0 26 Jan 2018
A Bridge Between Hyperparameter Optimization and Learning-to-learn Luca Franceschi Michele Donini P. Frasconi Massimiliano Pontil 35 20 0 18 Dec 2017
Neural Optimizer Search with Reinforcement Learning Irwan Bello Barret Zoph Vijay Vasudevan Quoc V. Le ODL 29 383 0 21 Sep 2017
Neural Architecture Search with Reinforcement Learning Barret Zoph Quoc V. Le 274 5,331 0 05 Nov 2016