Using a thousand optimization tasks to learn hyperparameter search strategies

27 February 2020

Jascha Narain Sohl-Dickstein

ArXiv PDF HTML

Papers citing "Using a thousand optimization tasks to learn hyperparameter search strategies"

29 / 79 papers shown

Title
Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real World Joshua Tobin Rachel Fong Alex Ray Jonas Schneider Wojciech Zaremba Pieter Abbeel 166 2,948 0 20 Mar 2017
Learned Optimizers that Scale and Generalize Olga Wichrowska Niru Maheswaranathan Matthew W. Hoffman Sergio Gomez Colmenarejo Misha Denil Nando de Freitas Jascha Narain Sohl-Dickstein AI4CE 46 284 0 14 Mar 2017
Learning Gradient Descent: Better Generalization and Longer Horizons Kaifeng Lyu Shunhua Jiang Jian Li 59 114 0 10 Mar 2017
Learning to Optimize Neural Nets Ke Li Jitendra Malik 38 131 0 01 Mar 2017
DeepMind Lab Charlie Beattie Joel Z Leibo Denis Teplyashin Tom Ward Marcus Wainwright ... Stephen Gaffney Helen King Demis Hassabis Shane Legg Stig Petersen 43 241 0 12 Dec 2016
Neural Architecture Search with Reinforcement Learning Barret Zoph Quoc V. Le 375 5,346 0 05 Nov 2016
Deep Information Propagation S. Schoenholz Justin Gilmer Surya Ganguli Jascha Narain Sohl-Dickstein 48 363 0 04 Nov 2016
Using Fast Weights to Attend to the Recent Past Jimmy Ba Geoffrey E. Hinton Volodymyr Mnih Joel Z Leibo Catalin Ionescu 42 263 0 20 Oct 2016
Learning to learn by gradient descent by gradient descent Marcin Andrychowicz Misha Denil Sergio Gomez Colmenarejo Matthew W. Hoffman David Pfau Tom Schaul Brendan Shillingford Nando de Freitas 77 2,000 0 14 Jun 2016
Matching Networks for One Shot Learning Oriol Vinyals Charles Blundell Timothy Lillicrap Koray Kavukcuoglu Daan Wierstra VLM 284 7,286 0 13 Jun 2016
TensorFlow: A system for large-scale machine learning Martín Abadi P. Barham Jianmin Chen Zhiwen Chen Andy Davis ... Vijay Vasudevan Pete Warden Martin Wicke Yuan Yu Xiaoqiang Zhang GNN AI4CE 324 18,300 0 27 May 2016
Faster Eigenvector Computation via Shift-and-Invert Preconditioning Dan Garber Laurent Dinh Chi Jin Jascha Narain Sohl-Dickstein Samy Bengio Praneeth Netrapalli Aaron Sidford 176 3,670 0 26 May 2016
A Stratified Analysis of Bayesian Optimization Methods Ian Dewancker M. McCourt Scott C. Clark Patrick Hayes A. Johnson George Ke 36 39 0 31 Mar 2016
COCO: A Platform for Comparing Continuous Optimizers in a Black-Box Setting N. Hansen A. Auger Raymond Ros Olaf Mersmann Tea Tušar D. Brockhoff 24 421 0 29 Mar 2016
Hyperband: A Novel Bandit-Based Approach to Hyperparameter Optimization Lisha Li Kevin Jamieson Giulia DeSalvo Afshin Rostamizadeh Ameet Talwalkar 160 2,307 0 21 Mar 2016
Deep Reinforcement Learning with Double Q-learning H. V. Hasselt A. Guez David Silver OffRL 125 7,590 0 22 Sep 2015
Neural Machine Translation of Rare Words with Subword Units Rico Sennrich Barry Haddow Alexandra Birch 151 7,683 0 31 Aug 2015
Scalable Bayesian Optimization Using Deep Neural Networks Jasper Snoek Oren Rippel Kevin Swersky Ryan Kiros N. Satish N. Sundaram Md. Mostofa Ali Patwary P. Prabhat Ryan P. Adams BDL UQCV 64 1,039 0 19 Feb 2015
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification Kaiming He Xinming Zhang Shaoqing Ren Jian Sun VLM 156 18,534 0 06 Feb 2015
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 736 149,474 0 22 Dec 2014
Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling Junyoung Chung Çağlar Gülçehre Kyunghyun Cho Yoshua Bengio 250 12,632 0 11 Dec 2014
ImageNet Large Scale Visual Recognition Challenge Olga Russakovsky Jia Deng Hao Su J. Krause S. Satheesh ... A. Karpathy A. Khosla Michael S. Bernstein Alexander C. Berg Li Fei-Fei VLM ObjD 1.0K 39,383 0 01 Sep 2014
OpenML: networked science in machine learning Joaquin Vanschoren Jan N. van Rijn B. Bischl Luís Torgo FedML AI4CE 93 1,310 0 29 Jul 2014
Freeze-Thaw Bayesian Optimization Kevin Swersky Jasper Snoek Ryan P. Adams 64 268 0 16 Jun 2014
Unit Tests for Stochastic Optimization Tom Schaul Ioannis Antonoglou David Silver 40 91 0 20 Dec 2013
One Billion Word Benchmark for Measuring Progress in Statistical Language Modeling Ciprian Chelba Tomas Mikolov M. Schuster Qi Ge T. Brants P. Koehn T. Robinson 110 1,099 0 11 Dec 2013
Generating Sequences With Recurrent Neural Networks Alex Graves GAN 99 4,025 0 04 Aug 2013
The Arcade Learning Environment: An Evaluation Platform for General Agents Marc G. Bellemare Yavar Naddaf J. Veness Michael Bowling 70 2,992 0 19 Jul 2012
Practical Bayesian Optimization of Machine Learning Algorithms Jasper Snoek Hugo Larochelle Ryan P. Adams 275 7,883 0 13 Jun 2012