Rethink DARTS Search Space and Renovate a New Benchmark

12 June 2023

Papers citing "Rethink DARTS Search Space and Renovate a New Benchmark"

50 / 57 papers shown

Title
Robustifying DARTS by Eliminating Information Bypass Leakage via Explicit Sparse Regularization Jiuling Zhang Zhiming Ding AAML 54 3 0 12 Jun 2023
Scaling Laws vs Model Architectures: How does Inductive Bias Influence Scaling? Yi Tay Mostafa Dehghani Samira Abnar Hyung Won Chung W. Fedus J. Rao Sharan Narang Vinh Q. Tran Dani Yogatama Donald Metzler AI4CE 104 106 0 21 Jul 2022
Efficient Architecture Search for Diverse Tasks Jun Shen M. Khodak Ameet Talwalkar 36 32 0 15 Apr 2022
$β$ -DARTS: Beta-Decay Regularization for Differentiable Architecture Search Peng Ye Baopu Li Yikang Li Tao Chen Jiayuan Fan Wanli Ouyang 57 104 0 03 Mar 2022
Learning Features with Parameter-Free Layers Dongyoon Han Y. Yoo Beomyoung Kim Byeongho Heo 67 8 0 06 Feb 2022
NAS-Bench-Suite: NAS Evaluation is (Now) Surprisingly Easy Yash Mehta Colin White Arber Zela Arjun Krishnakumar Guri Zabergja Shakiba Moradian Mahmoud Safari Kaicheng Yu Frank Hutter 64 43 0 31 Jan 2022
Patches Are All You Need? Asher Trockman J. Zico Kolter ViT 260 410 0 24 Jan 2022
Searching the Search Space of Vision Transformer Minghao Chen Kan Wu Bolin Ni Houwen Peng Bei Liu Jianlong Fu Hongyang Chao Haibin Ling ViT 76 53 0 29 Nov 2021
FBNetV5: Neural Architecture Search for Multiple Tasks in One Run Bichen Wu Chaojian Li Hang Zhang Xiaoliang Dai Peizhao Zhang Matthew Yu Jialiang Wang Yingyan Lin Peter Vajda ViT 112 24 0 19 Nov 2021
Parameter Prediction for Unseen Deep Architectures Boris Knyazev M. Drozdzal Graham W. Taylor Adriana Romero Soriano OOD 95 83 0 25 Oct 2021
EfficientBERT: Progressively Searching Multilayer Perceptron via Warm-up Knowledge Distillation Chenhe Dong Guangrun Wang Hang Xu Jiefeng Peng Xiaozhe Ren Xiaodan Liang 75 28 0 15 Sep 2021
Rethinking Architecture Selection in Differentiable NAS Ruochen Wang Minhao Cheng Xiangning Chen Xiaocheng Tang Cho-Jui Hsieh 71 177 0 10 Aug 2021
Rapid Neural Architecture Search by Learning to Generate Graphs from Datasets Hayeon Lee Eunyoung Hyung Sung Ju Hwang 86 43 0 02 Jul 2021
TransNAS-Bench-101: Improving Transferability and Generalizability of Cross-Task Neural Architecture Search Yawen Duan Xin Chen Hang Xu Zewei Chen Li Xiaodan Tong Zhang Zhenguo Li ViT 75 73 0 25 May 2021
Searching by Generating: Flexible and Efficient One-Shot NAS with Architecture Generator Sian-Yao Huang W. Chu 51 26 0 12 Mar 2021
AttentiveNAS: Improving Neural Architecture Search via Attentive Sampling Dilin Wang Meng Li Chengyue Gong Vikas Chandra 69 103 0 18 Nov 2020
Towards NNGP-guided Neural Architecture Search Daniel S. Park Jaehoon Lee Daiyi Peng Yuan Cao Jascha Narain Sohl-Dickstein BDL 71 34 0 11 Nov 2020
Cream of the Crop: Distilling Prioritized Paths For One-Shot Neural Architecture Search Houwen Peng Hao Du Hongyuan Yu Qi Li Jing Liao Jianlong Fu 75 67 0 29 Oct 2020
Revisiting Neural Architecture Search Anubhav Garg Amit Kumar Saha Debo Dutta 15 2 0 12 Oct 2020
DARTS-: Robustly Stepping out of Performance Collapse Without Indicators Xiangxiang Chu Xiaoxing Wang Bo Zhang Shun Lu Xiaolin K. Wei Junchi Yan 48 167 0 02 Sep 2020
Evaluating Efficient Performance Estimators of Neural Architectures Xuefei Ning Changcheng Tang Wenshuo Li Zixuan Zhou Shuang Liang Huazhong Yang Yu Wang 76 78 0 07 Aug 2020
Neural Architecture Search as Sparse Supernet Yongpeng Wu Aoming Liu Zhiwu Huang Siwei Zhang Luc Van Gool 49 22 0 31 Jul 2020
DrNAS: Dirichlet Neural Architecture Search Xiangning Chen Ruochen Wang Minhao Cheng Xiaocheng Tang Cho-Jui Hsieh OOD 66 102 0 18 Jun 2020
A Comprehensive Survey of Neural Architecture Search: Challenges and Solutions Pengzhen Ren Yun Xiao Xiaojun Chang Po-Yao (Bernie) Huang Zhihui Li Xiaojiang Chen Xin Wang AI4CE 119 677 0 01 Jun 2020
Geometry-Aware Gradient Algorithms for Neural Architecture Search Liam Li M. Khodak Maria-Florina Balcan Ameet Talwalkar 71 67 0 16 Apr 2020
MiLeNAS: Efficient Neural Architecture Search via Mixed-Level Reformulation Chaoyang He Haishan Ye Li Shen Tong Zhang 70 129 0 27 Mar 2020
BigNAS: Scaling Up Neural Architecture Search with Big Single-Stage Models Jiahui Yu Pengchong Jin Hanxiao Liu Gabriel Bender Pieter-Jan Kindermans Mingxing Tan Thomas Huang Xiaodan Song Ruoming Pang Quoc V. Le 84 304 0 24 Mar 2020
AutoML-Zero: Evolving Machine Learning Algorithms From Scratch Esteban Real Chen Liang David R. So Quoc V. Le 77 225 0 06 Mar 2020
Stabilizing Differentiable Architecture Search via Perturbation-based Regularization Xiangning Chen Cho-Jui Hsieh 81 204 0 12 Feb 2020
To Share or Not To Share: A Comprehensive Appraisal of Weight-Sharing Aloïs Pourchot Alexis Ducarouge Olivier Sigaud 53 21 0 11 Feb 2020
NAS-Bench-1Shot1: Benchmarking and Dissecting One-shot Neural Architecture Search Arber Zela Julien N. Siems Frank Hutter 125 149 0 28 Jan 2020
Deeper Insights into Weight Sharing in Neural Architecture Search Yuge Zhang Zejun Lin Junyan Jiang Quanlu Zhang Yujing Wang Hui Xue Chen Zhang Yaming Yang 74 50 0 06 Jan 2020
NAS-Bench-201: Extending the Scope of Reproducible Neural Architecture Search Xuanyi Dong Yi Yang 141 714 0 02 Jan 2020
NAS evaluation is frustratingly hard Antoine Yang P. Esperança Fabio Maria Carlucci 70 168 0 28 Dec 2019
Fair DARTS: Eliminating Unfair Advantages in Differentiable Architecture Search Xiangxiang Chu Tianbao Zhou Bo Zhang Jixiang Li 57 310 0 27 Nov 2019
What Do Compressed Deep Neural Networks Forget? Sara Hooker Aaron Courville Gregory Clark Yann N. Dauphin Andrea Frome 87 185 0 13 Nov 2019
Searching for A Robust Neural Architecture in Four GPU Hours Xuanyi Dong Yezhou Yang 126 654 0 10 Oct 2019
RandAugment: Practical automated data augmentation with a reduced search space E. D. Cubuk Barret Zoph Jonathon Shlens Quoc V. Le MQ 253 3,502 0 30 Sep 2019
Understanding and Robustifying Differentiable Architecture Search Arber Zela T. Elsken Tonmoy Saikia Yassine Marrakchi Thomas Brox Frank Hutter OOD AAML 140 373 0 20 Sep 2019
Understanding Architectures Learnt by Cell-based Neural Architecture Search Yao Shu Wei Wang Shaofeng Cai 46 87 0 20 Sep 2019
Best Practices for Scientific Research on Neural Architecture Search Marius Lindauer Frank Hutter 59 144 0 05 Sep 2019
AutoML: A Survey of the State-of-the-Art Xin He Kaiyong Zhao Xiaowen Chu 136 1,460 0 02 Aug 2019
PC-DARTS: Partial Channel Connections for Memory-Efficient Architecture Search Yuhui Xu Lingxi Xie Xiaopeng Zhang Xin Chen Guo-Jun Qi Qi Tian H. Xiong 88 609 0 12 Jul 2019
Discovering Neural Wirings Mitchell Wortsman Ali Farhadi Mohammad Rastegari AI4CE 109 121 0 03 Jun 2019
On Network Design Spaces for Visual Recognition Ilija Radosavovic Justin Johnson Saining Xie Wan-Yen Lo Piotr Dollár 83 135 0 30 May 2019
CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Features Sangdoo Yun Dongyoon Han Seong Joon Oh Sanghyuk Chun Junsuk Choe Y. Yoo OOD 622 4,802 0 13 May 2019
Single-Path NAS: Designing Hardware-Efficient ConvNets in less than 4 Hours Dimitrios Stamoulis Ruizhou Ding Di Wang Dimitrios Lymberopoulos B. Priyantha Jie Liu Diana Marculescu 60 285 0 05 Apr 2019
Exploring Randomly Wired Neural Networks for Image Recognition Saining Xie Alexander Kirillov Ross B. Girshick Kaiming He 66 365 0 02 Apr 2019
NAS-Bench-101: Towards Reproducible Neural Architecture Search Chris Ying Aaron Klein Esteban Real Eric Christiansen Kevin Patrick Murphy Frank Hutter 83 684 0 25 Feb 2019
Evaluating the Search Phase of Neural Architecture Search Kaicheng Yu C. Sciuto Martin Jaggi C. Musat Mathieu Salzmann 68 343 0 21 Feb 2019