Speedy Performance Estimation for Neural Architecture Search

8 June 2020

Papers citing "Speedy Performance Estimation for Neural Architecture Search"

50 / 51 papers shown

Title
Supervised Models Can Generalize Also When Trained on Random Labels Oskar Allerbo Thomas B. Schön OOD SSL 81 0 0 16 May 2025
Early Stopping Against Label Noise Without Validation Data Suqin Yuan Lei Feng Tongliang Liu NoLa 195 18 0 11 Feb 2025
Multi-objective Differentiable Neural Architecture Search R. Sukthanker Arber Zela B. Staffler Samuel Dooley Josif Grabocka Frank Hutter 81 1 0 28 Feb 2024
How Powerful are Performance Predictors in Neural Architecture Search? Colin White Arber Zela Binxin Ru Yang Liu Frank Hutter 57 127 0 02 Apr 2021
Information-Theoretic Generalization Bounds for Stochastic Gradient Descent Gergely Neu Gintare Karolina Dziugaite Mahdi Haghifam Daniel M. Roy 41 86 0 01 Feb 2021
On the Origin of Implicit Regularization in Stochastic Gradient Descent Samuel L. Smith Benoit Dherin David Barrett Soham De MLT 27 202 0 28 Jan 2021
Zero-Cost Proxies for Lightweight NAS Mohamed S. Abdelfattah Abhinav Mehrotra Łukasz Dudziak Nicholas D. Lane 56 255 0 20 Jan 2021
A Bayesian Perspective on Training Speed and Model Selection Clare Lyle Lisa Schut Binxin Ru Y. Gal Mark van der Wilk 67 24 0 27 Oct 2020
A Study on Encodings for Neural Architecture Search Colin White Willie Neiswanger Sam Nolen Yash Savani AI4CE 26 74 0 09 Jul 2020
Theory-Inspired Path-Regularized Differential Network Architecture Search Pan Zhou Caiming Xiong R. Socher Guosheng Lin 28 55 0 30 Jun 2020
Does Unsupervised Architecture Representation Learning Help Neural Architecture Search? Shen Yan Yu Zheng Wei Ao Xiao Zeng Mi Zhang SSL AI4CE 68 101 0 12 Jun 2020
Neural Architecture Search without Training J. Mellor Jack Turner Amos Storkey Elliot J. Crowley 45 380 0 08 Jun 2020
Neural Architecture Generator Optimization Binxin Ru P. Esperança Fabio Maria Carlucci 37 40 0 03 Apr 2020
The large learning rate phase of deep learning: the catapult mechanism Aitor Lewkowycz Yasaman Bahri Ethan Dyer Jascha Narain Sohl-Dickstein Guy Gur-Ari ODL 182 238 0 04 Mar 2020
Calibrating Deep Neural Networks using Focal Loss Jishnu Mukhoti Viveka Kulharia Amartya Sanyal Stuart Golodetz Philip Torr P. Dokania UQCV 81 454 0 21 Feb 2020
NAS-Bench-1Shot1: Benchmarking and Dissecting One-shot Neural Architecture Search Arber Zela Julien N. Siems Frank Hutter 118 147 0 28 Jan 2020
NAS-Bench-201: Extending the Scope of Reproducible Neural Architecture Search Xuanyi Dong Yi Yang 130 703 0 02 Jan 2020
NAS evaluation is frustratingly hard Antoine Yang P. Esperança Fabio Maria Carlucci 54 167 0 28 Dec 2019
Fantastic Generalization Measures and Where to Find Them Yiding Jiang Behnam Neyshabur H. Mobahi Dilip Krishnan Samy Bengio AI4CE 95 599 0 04 Dec 2019
Information-Theoretic Generalization Bounds for SGLD via Data-Dependent Estimates Jeffrey Negrea Mahdi Haghifam Gintare Karolina Dziugaite Ashish Khisti Daniel M. Roy FedML 148 149 0 06 Nov 2019
FairNAS: Rethinking Evaluation Fairness of Weight Sharing Neural Architecture Search Xiangxiang Chu Bo Zhang Ruijun Xu 57 332 0 03 Jul 2019
On Network Design Spaces for Visual Recognition Ilija Radosavovic Justin Johnson Saining Xie Wan-Yen Lo Piotr Dollár 52 135 0 30 May 2019
Generalization Bounds of Stochastic Gradient Descent for Wide and Deep Neural Networks Yuan Cao Quanquan Gu MLT AI4CE 76 384 0 30 May 2019
Exploring Randomly Wired Neural Networks for Image Recognition Saining Xie Alexander Kirillov Ross B. Girshick Kaiming He 61 365 0 02 Apr 2019
Universally Slimmable Networks and Improved Training Techniques Jiahui Yu Thomas Huang 53 384 0 12 Mar 2019
NAS-Bench-101: Towards Reproducible Neural Architecture Search Chris Ying Aaron Klein Esteban Real Eric Christiansen Kevin Patrick Murphy Frank Hutter 60 678 0 25 Feb 2019
Evaluating the Search Phase of Neural Architecture Search Kaicheng Yu C. Sciuto Martin Jaggi C. Musat Mathieu Salzmann 38 343 0 21 Feb 2019
Random Search and Reproducibility for Neural Architecture Search Liam Li Ameet Talwalkar OOD 66 719 0 20 Feb 2019
Stiffness: A New Perspective on Generalization in Neural Networks Stanislav Fort Pawel Krzysztof Nowak Stanislaw Jastrzebski S. Narayanan 117 94 0 28 Jan 2019
Fine-Grained Analysis of Optimization and Generalization for Overparameterized Two-Layer Neural Networks Sanjeev Arora S. Du Wei Hu Zhiyuan Li Ruosong Wang MLT 156 966 0 24 Jan 2019
SNAS: Stochastic Neural Architecture Search Sirui Xie Hehui Zheng Chunxiao Liu Liang Lin 72 932 0 24 Dec 2018
Meta Architecture Search Albert Eaton Shaw Wei Wei Weiyang Liu Le Song Bo Dai BDL 43 35 0 22 Dec 2018
Towards Automated Deep Learning: Efficient Joint Neural Architecture and Hyperparameter Search Arber Zela Aaron Klein Stefan Falkner Frank Hutter 56 159 0 18 Jul 2018
BOHB: Robust and Efficient Hyperparameter Optimization at Scale Stefan Falkner Aaron Klein Frank Hutter BDL 169 1,077 0 04 Jul 2018
DARTS: Differentiable Architecture Search Hanxiao Liu Karen Simonyan Yiming Yang 183 4,326 0 24 Jun 2018
Neural Architecture Search with Bayesian Optimisation and Optimal Transport Kirthevasan Kandasamy Willie Neiswanger J. Schneider Barnabás Póczós Eric Xing 66 603 0 11 Feb 2018
Efficient Neural Architecture Search via Parameter Sharing Hieu H. Pham M. Guan Barret Zoph Quoc V. Le J. Dean 86 2,761 0 09 Feb 2018
Regularized Evolution for Image Classifier Architecture Search Esteban Real A. Aggarwal Yanping Huang Quoc V. Le 148 3,021 0 05 Feb 2018
The Implicit Bias of Gradient Descent on Separable Data Daniel Soudry Elad Hoffer Mor Shpigel Nacson Suriya Gunasekar Nathan Srebro 108 908 0 27 Oct 2017
Learning Transferable Architectures for Scalable Image Recognition Barret Zoph Vijay Vasudevan Jonathon Shlens Quoc V. Le 157 5,577 0 21 Jul 2017
Exploring Generalization in Deep Learning Behnam Neyshabur Srinadh Bhojanapalli David A. McAllester Nathan Srebro FAtt 139 1,245 0 27 Jun 2017
Computing Nonvacuous Generalization Bounds for Deep (Stochastic) Neural Networks with Many More Parameters than Training Data Gintare Karolina Dziugaite Daniel M. Roy 93 808 0 31 Mar 2017
Large-Scale Evolution of Image Classifiers Esteban Real Sherry Moore Andrew Selle Saurabh Saxena Y. Suematsu Jie Tan Quoc V. Le Alexey Kurakin 107 1,631 0 03 Mar 2017
Algorithmic stability and hypothesis complexity Tongliang Liu Gábor Lugosi Gergely Neu Dacheng Tao 41 92 0 28 Feb 2017
Neural Architecture Search with Reinforcement Learning Barret Zoph Quoc V. Le 408 5,362 0 05 Nov 2016
On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima N. Keskar Dheevatsa Mudigere J. Nocedal M. Smelyanskiy P. T. P. Tang ODL 382 2,922 0 15 Sep 2016
PAC-Bayesian Theory Meets Bayesian Inference Pascal Germain Francis R. Bach Alexandre Lacoste Simon Lacoste-Julien 60 182 0 27 May 2016
Fast Bayesian Optimization of Machine Learning Hyperparameters on Large Datasets Aaron Klein Stefan Falkner Simon Bartels Philipp Hennig Frank Hutter AI4CE 66 547 0 23 May 2016
Hyperband: A Novel Bandit-Based Approach to Hyperparameter Optimization Lisha Li Kevin Jamieson Giulia DeSalvo Afshin Rostamizadeh Ameet Talwalkar 182 2,307 0 21 Mar 2016
XGBoost: A Scalable Tree Boosting System Tianqi Chen Carlos Guestrin 482 37,815 0 09 Mar 2016