Automated Deep Learning: Neural Architecture Search Is Not the End

16 December 2021

Bogdan Gabrys

Papers citing "Automated Deep Learning: Neural Architecture Search Is Not the End"

50 / 182 papers shown

Title
NAS-Bench-1Shot1: Benchmarking and Dissecting One-shot Neural Architecture Search Arber Zela Julien N. Siems Frank Hutter 116 147 0 28 Jan 2020
NAS-Bench-201: Extending the Scope of Reproducible Neural Architecture Search Xuanyi Dong Yi Yang 118 703 0 02 Jan 2020
Generative Teaching Networks: Accelerating Neural Architecture Search by Learning to Generate Synthetic Training Data F. Such Aditya Rawal Joel Lehman Kenneth O. Stanley Jeff Clune DD 35 156 0 17 Dec 2019
Neural Predictor for Neural Architecture Search W. Wen Hanxiao Liu H. Li Yiran Chen Gabriel Bender Pieter-Jan Kindermans 63 196 0 02 Dec 2019
Periodic Spectral Ergodicity: A Complexity Measure for Deep Neural Networks and Neural Architecture Search Mehmet Süzen J. Cerdà C. Weber 27 1 0 10 Nov 2019
Optimizing Millions of Hyperparameters by Implicit Differentiation Jonathan Lorraine Paul Vicol David Duvenaud DD 98 409 0 06 Nov 2019
BANANAS: Bayesian Optimization with Neural Architectures for Neural Architecture Search Colin White Willie Neiswanger Yash Savani BDL 78 317 0 25 Oct 2019
One-Shot Neural Architecture Search via Self-Evaluated Template Network Xuanyi Dong Yezhou Yang ViT 36 184 0 13 Oct 2019
Searching for A Robust Neural Architecture in Four GPU Hours Xuanyi Dong Yezhou Yang 95 649 0 10 Oct 2019
Improving Generalization in Meta Reinforcement Learning using Learned Objectives Louis Kirsch Sjoerd van Steenkiste Jürgen Schmidhuber OffRL 49 118 0 09 Oct 2019
RandAugment: Practical automated data augmentation with a reduced search space E. D. Cubuk Barret Zoph Jonathon Shlens Quoc V. Le MQ 183 3,458 0 30 Sep 2019
Automatically Learning Data Augmentation Policies for Dialogue Tasks Tong Niu Joey Tianyi Zhou 42 39 0 27 Sep 2019
Understanding and Robustifying Differentiable Architecture Search Arber Zela T. Elsken Tonmoy Saikia Yassine Marrakchi Thomas Brox Frank Hutter OOD AAML 120 369 0 20 Sep 2019
Learning to Propagate for Graph Meta-Learning Lu Liu Dinesh Manocha Guodong Long Jing Jiang Chengqi Zhang 60 96 0 11 Sep 2019
Discovery of Useful Questions as Auxiliary Tasks Vivek Veeriah Matteo Hessel Zhongwen Xu Richard L. Lewis Janarthanan Rajendran Junhyuk Oh H. V. Hasselt David Silver Satinder Singh LLMAG 53 85 0 10 Sep 2019
Best Practices for Scientific Research on Neural Architecture Search Marius Lindauer Frank Hutter 38 143 0 05 Sep 2019
Once-for-All: Train One Network and Specialize it for Efficient Deployment Han Cai Chuang Gan Tianzhe Wang Zhekai Zhang Song Han OOD 75 1,267 0 26 Aug 2019
Teacher Supervises Students How to Learn From Partially Labeled Images for Facial Landmark Detection Xuanyi Dong Yezhou Yang CVBM 83 66 0 06 Aug 2019
Optuna: A Next-generation Hyperparameter Optimization Framework Takuya Akiba Shotaro Sano Toshihiko Yanase Takeru Ohta Masanori Koyama 300 5,664 0 25 Jul 2019
Towards AutoML in the presence of Drift: first results Jorge G. Madrid Hugo Jair Escalante E. Morales Wei-Wei Tu Yang Yu Lisheng Sun-Hosoya Isabelle M Guyon Michele Sebag 21 25 0 24 Jul 2019
PC-DARTS: Partial Channel Connections for Memory-Efficient Architecture Search Yuhui Xu Lingxi Xie Xiaopeng Zhang Xin Chen Guo-Jun Qi Qi Tian H. Xiong 67 605 0 12 Jul 2019
Hardware/Software Co-Exploration of Neural Architectures Weiwen Jiang Lei Yang E. Sha Qingfeng Zhuge Shouzhen Gu Sakyasingha Dasgupta Yiyu Shi Jiaxi Hu 45 131 0 06 Jul 2019
Mixed-Variable Bayesian Optimization Erik A. Daxberger Anastasia Makarova M. Turchetta Andreas Krause 48 51 0 02 Jul 2019
Hyp-RL : Hyperparameter Optimization by Reinforcement Learning H. Jomaa Josif Grabocka Lars Schmidt-Thieme 35 65 0 27 Jun 2019
Learning Data Augmentation Strategies for Object Detection Barret Zoph E. D. Cubuk Golnaz Ghiasi Nayeon Lee Jonathon Shlens Quoc V. Le 68 529 0 26 Jun 2019
Densely Connected Search Space for More Flexible Neural Architecture Search Jiemin Fang Yuzhu Sun Qian Zhang Yuan Li Wenyu Liu Xinggang Wang 52 123 0 23 Jun 2019
Placeto: Learning Generalizable Device Placement Algorithms for Distributed Machine Learning Ravichandra Addanki S. Venkatakrishnan Shreyan Gupta Hongzi Mao Mohammad Alizadeh OOD OffRL 39 67 0 20 Jun 2019
Bayesian Optimisation over Multiple Continuous and Categorical Inputs Binxin Ru A. Alvi Vu Nguyen Michael A. Osborne Stephen J. Roberts 78 96 0 20 Jun 2019
PABO: Pseudo Agent-Based Multi-Objective Bayesian Hyperparameter Optimization for Efficient Neural Accelerator Design Maryam Parsa Aayush Ankit A. Ziabari Kaushik Roy 23 28 0 11 Jun 2019
Energy and Policy Considerations for Deep Learning in NLP Emma Strubell Ananya Ganesh Andrew McCallum 46 2,633 0 05 Jun 2019
Bayesian Optimization of Composite Functions Raul Astudillo P. Frazier LLMAG 34 77 0 04 Jun 2019
Sequential Scenario-Specific Meta Learner for Online Recommendation Zhengxiao Du Xiaowei Wang Hongxia Yang Jingren Zhou Jie Tang OffRL LRM CLL 49 116 0 02 Jun 2019
Network Pruning via Transformable Architecture Search Xuanyi Dong Yi Yang 3DPC 44 241 0 23 May 2019
Tabular Benchmarks for Joint Architecture and Hyperparameter Optimization Aaron Klein Frank Hutter 24 92 0 13 May 2019
BayesNAS: A Bayesian Approach for Neural Architecture Search Hongpeng Zhou Minghao Yang Jun Wang Wei Pan BDL 44 197 0 13 May 2019
A Survey on Neural Architecture Search Martin Wistuba Ambrish Rawat Tejaswini Pedapati AI4CE 44 258 0 04 May 2019
Fast AutoAugment Sungbin Lim Ildoo Kim Taesup Kim Chiheon Kim Sungwoong Kim 62 593 0 01 May 2019
HARK Side of Deep Learning -- From Grad Student Descent to Automated Machine Learning O. Gencoglu M. Gils E. Guldogan Chamin Morikawa Mehmet Süzen M. Gruber J. Leinonen H. Huttunen 74 36 0 16 Apr 2019
NAS-FPN: Learning Scalable Feature Pyramid Architecture for Object Detection Golnaz Ghiasi Nayeon Lee Ruoming Pang Quoc V. Le ObjD 55 1,389 0 16 Apr 2019
Resource Constrained Neural Network Architecture Search: Will a Submodularity Assumption Help? Yunyang Xiong Ronak R. Mehta Vikas Singh 55 33 0 08 Apr 2019
Exploring Randomly Wired Neural Networks for Image Recognition Saining Xie Alexander Kirillov Ross B. Girshick Kaiming He 54 365 0 02 Apr 2019
Single Path One-Shot Neural Architecture Search with Uniform Sampling Zichao Guo Xiangyu Zhang Haoyuan Mu Wen Heng Zechun Liu Yichen Wei Jian Sun 54 933 0 31 Mar 2019
DetNAS: Backbone Search for Object Detection Yukang Chen Tong Yang Xinming Zhang Gaofeng Meng Xinyu Xiao Jian Sun 55 265 0 26 Mar 2019
Self-Tuning Networks: Bilevel Optimization of Hyperparameters using Structured Best-Response Functions M. Mackay Paul Vicol Jonathan Lorraine David Duvenaud Roger C. Grosse 69 164 0 07 Mar 2019
NAS-Bench-101: Towards Reproducible Neural Architecture Search Chris Ying Aaron Klein Esteban Real Eric Christiansen Kevin Patrick Murphy Frank Hutter 41 678 0 25 Feb 2019
Evaluating the Search Phase of Neural Architecture Search Kaicheng Yu C. Sciuto Martin Jaggi C. Musat Mathieu Salzmann 34 343 0 21 Feb 2019
Random Search and Reproducibility for Neural Architecture Search Liam Li Ameet Talwalkar OOD 51 719 0 20 Feb 2019
A Generalized Framework for Population Based Training Ang Li Ola Spyra Sagi Perel Valentin Dalibard Max Jaderberg Chenjie Gu David Budden Tim Harley Pramod Gupta 41 68 0 05 Feb 2019
The Evolved Transformer David R. So Chen Liang Quoc V. Le ViT 74 461 0 30 Jan 2019
Bayesian Learning of Neural Network Architectures G. Dikov Patrick van der Smagt Justin Bayer BDL 89 30 0 14 Jan 2019