Automated Deep Learning: Neural Architecture Search Is Not the End

16 December 2021

Bogdan Gabrys

Papers citing "Automated Deep Learning: Neural Architecture Search Is Not the End"

50 / 182 papers shown

Title
Evolution Meets Diffusion: Efficient Neural Architecture Generation Bingye Zhou Caiyang Yu DiffM 114 0 0 24 Apr 2025
Generative Adversarial Networks Gilad Cohen Raja Giryes GAN 103 30,021 0 01 Mar 2022
Searching the Search Space of Vision Transformer Minghao Chen Kan Wu Bolin Ni Houwen Peng Bei Liu Jianlong Fu Hongyang Chao Haibin Ling ViT 50 52 0 29 Nov 2021
NAS-Bench-x11 and the Power of Learning Curves Shen Yan Colin White Yash Savani Frank Hutter 45 28 0 05 Nov 2021
Primer: Searching for Efficient Transformers for Language Modeling David R. So Wojciech Mañke Hanxiao Liu Zihang Dai Noam M. Shazeer Quoc V. Le VLM 186 154 0 17 Sep 2021
HPOBench: A Collection of Reproducible Multi-Fidelity Benchmark Problems for HPO Katharina Eggensperger Philip Muller Neeratyoy Mallik Matthias Feurer René Sass Aaron Klein Noor H. Awad Marius Lindauer Frank Hutter 121 101 0 14 Sep 2021
Full-Cycle Energy Consumption Benchmark for Low-Carbon Computer Vision Yue Liu Xinyang Jiang Donglin Bai Yuge Zhang Ningxin Zheng Xuanyi Dong Lu Liu Yuqing Yang Dongsheng Li 19 10 0 30 Aug 2021
Automated Machine Learning Techniques for Data Streams Alexandru-Ionut Imbrea AIFin AI4TS 35 8 0 14 Jun 2021
DACBench: A Benchmark Library for Dynamic Algorithm Configuration Theresa Eimer André Biedenkapp Maximilian V Reimer Steven Adriaensen Frank Hutter Marius Lindauer 48 29 0 18 May 2021
Exploring Opportunistic Meta-knowledge to Reduce Search Spaces for Automated Machine Learning Tien-Dung Nguyen D. Kedziora Katarzyna Musial Bogdan Gabrys 35 5 0 01 May 2021
Carbon Emissions and Large Neural Network Training David A. Patterson Joseph E. Gonzalez Quoc V. Le Chen Liang Lluís-Miquel Munguía D. Rothchild David R. So Maud Texier J. Dean AI4CE 311 653 0 21 Apr 2021
EfficientNetV2: Smaller Models and Faster Training Mingxing Tan Quoc V. Le EgoV 69 2,662 0 01 Apr 2021
HW-NAS-Bench:Hardware-Aware Neural Architecture Search Benchmark Chaojian Li Zhongzhi Yu Yonggan Fu Yongan Zhang Yang Zhao Haoran You Qixuan Yu Yue Wang Yingyan Lin 87 109 0 19 Mar 2021
Generalizing to Unseen Domains: A Survey on Domain Generalization Jindong Wang Cuiling Lan Chang-Shu Liu Yidong Ouyang Tao Qin Wang Lu Yiqiang Chen Wenjun Zeng Philip S. Yu OOD 148 1,198 0 02 Mar 2021
Neural Architecture Search on ImageNet in Four GPU Hours: A Theoretically Inspired Perspective Wuyang Chen Xinyu Gong Zhangyang Wang OOD 63 233 0 23 Feb 2021
Rethinking Co-design of Neural Architectures and Hardware Accelerators Yanqi Zhou Xuanyi Dong Berkin Akin Mingxing Tan Daiyi Peng Tianjian Meng Amir Yazdanbakhsh Da Huang Ravi Narayanaswami James Laudon 110 26 0 17 Feb 2021
Dynamic Neural Networks: A Survey Yizeng Han Gao Huang Shiji Song Le Yang Honghui Wang Yulin Wang 3DH AI4TS AI4CE 51 638 0 09 Feb 2021
Isometric Propagation Network for Generalized Zero-shot Learning Lu Liu Dinesh Manocha Guodong Long Jing Jiang Xuanyi Dong Chengqi Zhang 54 36 0 03 Feb 2021
PyGlove: Symbolic Programming for Automated Machine Learning Daiyi Peng Xuanyi Dong Esteban Real Mingxing Tan Yifeng Lu Hanxiao Liu Gabriel Bender Adam Kraft Chen Liang Quoc V. Le 33 31 0 21 Jan 2021
Zero-Cost Proxies for Lightweight NAS Mohamed S. Abdelfattah Abhinav Mehrotra Łukasz Dudziak Nicholas D. Lane 51 253 0 20 Jan 2021
AutonoML: Towards an Integrated Framework for Autonomous Machine Learning D. Kedziora Katarzyna Musial Bogdan Gabrys 52 16 0 23 Dec 2020
Meta-Learning with Adaptive Hyperparameters Sungyong Baik Myungsub Choi Janghoon Choi Heewon Kim Kyoung Mu Lee 35 123 0 31 Oct 2020
Qlib: An AI-oriented Quantitative Investment Platform Xiao Yang Weiqing Liu Dong-ping Zhou Jiang Bian Tie-Yan Liu AIFin 6 59 0 22 Sep 2020
Searching for Low-Bit Weights in Quantized Neural Networks Zhaohui Yang Yunhe Wang Kai Han Chunjing Xu Chao Xu Dacheng Tao Chang Xu MQ 41 82 0 18 Sep 2020
DANCE: Differentiable Accelerator/Network Co-Exploration Kanghyun Choi Deokki Hong Hojae Yoon Joonsang Yu Youngsok Kim Jinho Lee 38 45 0 14 Sep 2020
NATS-Bench: Benchmarking NAS Algorithms for Architecture Topology and Size Xuanyi Dong Lu Liu Katarzyna Musial Bogdan Gabrys 22 162 0 28 Aug 2020
Can weight sharing outperform random architecture search? An investigation with TuNAS Gabriel Bender Hanxiao Liu Bo Chen Grace Chu Shuyang Cheng Pieter-Jan Kindermans Quoc V. Le OOD 53 121 0 13 Aug 2020
On Hyperparameter Optimization of Machine Learning Algorithms: Theory and Practice Li Yang Abdallah Shami AI4CE 101 2,067 0 30 Jul 2020
Meta-Gradient Reinforcement Learning with an Objective Discovered Online Zhongwen Xu H. V. Hasselt Matteo Hessel Junhyuk Oh Satinder Singh David Silver 45 76 0 16 Jul 2020
Auto-PyTorch Tabular: Multi-Fidelity MetaLearning for Efficient and Robust AutoDL Lucas Zimmer Marius Lindauer Frank Hutter MU 82 90 0 24 Jun 2020
APQ: Joint Search for Network Architecture, Pruning and Quantization Policy Tianzhe Wang Kuan-Chieh Wang Han Cai Ji Lin Zhijian Liu Song Han MQ 46 174 0 15 Jun 2020
Equivalence in Deep Neural Networks via Conjugate Matrix Ensembles Mehmet Süzen 13 1 0 14 Jun 2020
Adaptation Strategies for Automated Machine Learning on Evolving Data B. Celik Joaquin Vanschoren 34 54 0 09 Jun 2020
Neural Architecture Search without Training J. Mellor Jack Turner Amos Storkey Elliot J. Crowley 30 377 0 08 Jun 2020
FBNetV3: Joint Architecture-Recipe Search using Predictor Pretraining Xiaoliang Dai Alvin Wan Peizhao Zhang Bichen Wu Zijian He ... Kan Chen Yuandong Tian Matthew Yu Peter Vajda Joseph E. Gonzalez 34 72 0 03 Jun 2020
On the Number of Linear Regions of Convolutional Neural Networks Huan Xiong Lei Huang Mengyang Yu Li Liu Fan Zhu Ling Shao MLT 37 68 0 01 Jun 2020
A Comprehensive Survey of Neural Architecture Search: Challenges and Solutions Pengzhen Ren Yun Xiao Xiaojun Chang Po-Yao (Bernie) Huang Zhihui Li Xiaojiang Chen Xin Wang AI4CE 90 665 0 01 Jun 2020
Language Models are Few-Shot Learners Tom B. Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared Kaplan ... Christopher Berner Sam McCandlish Alec Radford Ilya Sutskever Dario Amodei BDL 432 41,106 0 28 May 2020
FBNetV2: Differentiable Neural Architecture Search for Spatial and Channel Dimensions Alvin Wan Xiaoliang Dai Peizhao Zhang Zijian He Yuandong Tian ... Matthew Yu Tao Xu Kan Chen Peter Vajda Joseph E. Gonzalez 50 289 0 12 Apr 2020
Evolving Normalization-Activation Layers Hanxiao Liu Andrew Brock Karen Simonyan Quoc V. Le 80 80 0 06 Apr 2020
Neural Architecture Generator Optimization Binxin Ru P. Esperança Fabio Maria Carlucci 34 40 0 03 Apr 2020
Designing Network Design Spaces Ilija Radosavovic Raj Prateek Kosaraju Ross B. Girshick Kaiming He Piotr Dollár GNN 77 1,672 0 30 Mar 2020
Improving Reproducibility in Machine Learning Research (A Report from the NeurIPS 2019 Reproducibility Program) Joelle Pineau Philippe Vincent-Lamarre Koustuv Sinha V. Larivière A. Beygelzimer Florence dÁlché-Buc E. Fox Hugo Larochelle 65 358 0 27 Mar 2020
BigNAS: Scaling Up Neural Architecture Search with Big Single-Stage Models Jiahui Yu Pengchong Jin Hanxiao Liu Gabriel Bender Pieter-Jan Kindermans Mingxing Tan Thomas Huang Xiaodan Song Ruoming Pang Quoc V. Le 49 302 0 24 Mar 2020
AutoGluon-Tabular: Robust and Accurate AutoML for Structured Data Nick Erickson Jonas W. Mueller Alexander Shirkov Hang Zhang Pedro Larroy Mu Li Alex Smola LMTD 144 617 0 13 Mar 2020
Hyper-Parameter Optimization: A Review of Algorithms and Applications Tong Yu Hong Zhu AAML 27 529 0 12 Mar 2020
DADA: Differentiable Automatic Data Augmentation Yonggang Li Guosheng Hu Yongtao Wang Timothy M. Hospedales N. Robertson Yongxin Yang 44 109 0 08 Mar 2020
AutoML-Zero: Evolving Machine Learning Algorithms From Scratch Esteban Real Chen Liang David R. So Quoc V. Le 52 225 0 06 Mar 2020
BATS: Binary ArchitecTure Search Adrian Bulat Brais Martínez Georgios Tzimiropoulos MQ 57 68 0 03 Mar 2020
Co-Exploration of Neural Architectures and Heterogeneous ASIC Accelerator Designs Targeting Multiple Tasks Lei Yang Zheyu Yan Meng Li Hyoukjun Kwon Liangzhen Lai T. Krishna Vikas Chandra Weiwen Jiang Yiyu Shi 46 115 0 10 Feb 2020