Stabilizing Differentiable Architecture Search via Perturbation-based Regularization

12 February 2020

Papers citing "Stabilizing Differentiable Architecture Search via Perturbation-based Regularization"

44 / 44 papers shown

Title
Robust and Efficient Transfer Learning via Supernet Transfer in Warm-started Neural Architecture Search Prabhant Singh Joaquin Vanschoren AAML OOD 34 0 0 26 Jul 2024
Robustifying and Boosting Training-Free Neural Architecture Search Zhenfeng He Yao Shu Zhongxiang Dai K. H. Low 43 1 0 12 Mar 2024
Masked Autoencoders Are Robust Neural Architecture Search Learners Yiming Hu Xiangxiang Chu Bo-Wen Zhang OOD 37 0 0 20 Nov 2023
DDNAS: Discretized Differentiable Neural Architecture Search for Text Classification Kuan-Yu Chen Cheng Li Kuo-Jung Lee 28 1 0 12 Jul 2023
Balanced Mixture of SuperNets for Learning the CNN Pooling Architecture Mehraveh Javan Matthew Toews M. Pedersoli 31 1 0 21 Jun 2023
Differentiable Instruction Optimization for Cross-Task Generalization Masaru Isonuma Junichiro Mori Ichiro Sakata 29 0 0 16 Jun 2023
Robustifying DARTS by Eliminating Information Bypass Leakage via Explicit Sparse Regularization Jiuling Zhang Zhiming Ding AAML 21 3 0 12 Jun 2023
Rethink DARTS Search Space and Renovate a New Benchmark Jiuling Zhang Zhiming Ding 35 1 0 12 Jun 2023
GeNAS: Neural Architecture Search with Better Generalization Joonhyun Jeong Joonsang Yu Geondo Park Dongyoon Han Y. Yoo 30 4 0 15 May 2023
Robust Neural Architecture Search Xunyu Zhu Jian Li Yong-Jin Liu Weiping Wang AAML 18 2 0 06 Apr 2023
ASP: Learn a Universal Neural Solver! Chenguang Wang Zhouliang Yu Stephen Marcus McAleer Tianshu Yu Yao-Chun Yang AAML 32 24 0 01 Mar 2023
Symbolic Discovery of Optimization Algorithms Xiangning Chen Chen Liang Da Huang Esteban Real Kaiyuan Wang ... Xuanyi Dong Thang Luong Cho-Jui Hsieh Yifeng Lu Quoc V. Le 64 350 0 13 Feb 2023
Operation-level Progressive Differentiable Architecture Search Xunyu Zhu Jian Li Yong Liu Weiping Wang 29 6 0 11 Feb 2023
ZiCo: Zero-shot NAS via Inverse Coefficient of Variation on Gradients Guihong Li Yuedong Yang Kartikeya Bhardwaj R. Marculescu 36 60 0 26 Jan 2023
Efficient Evaluation Methods for Neural Architecture Search: A Survey Xiangning Xie Xiaotian Song Zeqiong Lv Gary G. Yen Weiping Ding Yizhou Sun 29 12 0 14 Jan 2023
PredNAS: A Universal and Sample Efficient Neural Architecture Search Framework Liuchun Yuan Zehao Huang Naiyan Wang 29 0 0 26 Oct 2022
On the Privacy Risks of Cell-Based NAS Architectures Haiping Huang Zhikun Zhang Yun Shen Michael Backes Qi Li Yang Zhang 27 7 0 04 Sep 2022
Partial Connection Based on Channel Attention for Differentiable Neural Architecture Search Yu Xue Jiafeng Qin 27 55 0 01 Aug 2022
Warm-starting DARTS using meta-learning Matej Grobelnik Joaquin Vanschoren AI4CE 27 1 0 12 May 2022
Generalizing Few-Shot NAS with Gradient Matching Shou-Yong Hu Ruochen Wang Lanqing Hong Zhenguo Li Cho-Jui Hsieh Jiashi Feng 25 23 0 29 Mar 2022
$β$ -DARTS: Beta-Decay Regularization for Differentiable Architecture Search Peng Ye Baopu Li Yikang Li Tao Chen Jiayuan Fan Wanli Ouyang 16 101 0 03 Mar 2022
Neural Architecture Search for Dense Prediction Tasks in Computer Vision T. Elsken Arber Zela J. H. Metzen B. Staffler Thomas Brox Abhinav Valada Frank Hutter OOD 33 17 0 15 Feb 2022
Deep invariant networks with differentiable augmentation layers Cédric Rommel Thomas Moreau Alexandre Gramfort OOD 27 8 0 04 Feb 2022
Learning from Mistakes based on Class Weighting with Application to Neural Architecture Search Jay P. Gala P. Xie 29 1 0 01 Dec 2021
Local Learning Matters: Rethinking Data Heterogeneity in Federated Learning Matías Mendieta Taojiannan Yang Pu Wang Minwoo Lee Zhengming Ding Cheng Chen FedML 24 158 0 28 Nov 2021
Exploring Architectural Ingredients of Adversarially Robust Deep Neural Networks Hanxun Huang Yisen Wang S. Erfani Quanquan Gu James Bailey Xingjun Ma AAML TPM 46 100 0 07 Oct 2021
DAAS: Differentiable Architecture and Augmentation Policy Search Xiaoxing Wang Xiangxiang Chu Junchi Yan Xiaokang Yang 24 5 0 30 Sep 2021
$L$^{2}$NAS: Learning to Optimize Neural Architectures via Continuous-Action Reinforcement Learning$ L $^{2}$ NAS: Learning to Optimize Neural Architectures via Continuous-Action Reinforcement Learning Keith G. Mills Fred X. Han Mohammad Salameh Seyed Saeed Changiz Rezaei Linglong Kong Wei Lu Shuo Lian Shangling Jui Di Niu 22 10 0 25 Sep 2021
NASI: Label- and Data-agnostic Neural Architecture Search at Initialization Yao Shu Shaofeng Cai Zhongxiang Dai Beng Chin Ooi K. H. Low 22 43 0 02 Sep 2021
iDARTS: Improving DARTS by Node Normalization and Decorrelation Discretization Huiqun Wang Ruijie Yang Di Huang Yunhong Wang 16 27 0 25 Aug 2021
Is Differentiable Architecture Search truly a One-Shot Method? Jonas Geiping Jovita Lukasik M. Keuper Michael Moeller 25 0 0 12 Aug 2021
Rethinking Architecture Selection in Differentiable NAS Ruochen Wang Minhao Cheng Xiangning Chen Xiaocheng Tang Cho-Jui Hsieh 24 172 0 10 Aug 2021
Bag of Tricks for Neural Architecture Search T. Elsken B. Staffler Arber Zela J. H. Metzen Frank Hutter 27 5 0 08 Jul 2021
iDARTS: Differentiable Architecture Search with Stochastic Implicit Gradients Miao Zhang Steven W. Su Shirui Pan Xiaojun Chang Ehsan Abbasnejad Reza Haffari 24 68 0 21 Jun 2021
CATE: Computation-aware Neural Architecture Encoding with Transformers Shen Yan Kaiqiang Song Z. Feng Mi Zhang 22 24 0 14 Feb 2021
Unchain the Search Space with Hierarchical Differentiable Architecture Search Guanting Liu Yujie Zhong Sheng Guo Matthew R. Scott Weilin Huang AI4CE 19 2 0 11 Jan 2021
DSRNA: Differentiable Search of Robust Neural Architectures Ramtin Hosseini Xingyi Yang P. Xie OOD AAML 26 50 0 11 Dec 2020
Learning by Passing Tests, with Application to Neural Architecture Search Xuefeng Du Haochen Zhang P. Xie 18 4 0 30 Nov 2020
Inter-layer Transition in Neural Architecture Search Benteng Ma Jing Zhang Yong-quan Xia Dacheng Tao 34 4 0 30 Nov 2020
BARS: Joint Search of Cell Topology and Layout for Accurate and Efficient Binary ARchitectures Tianchen Zhao Xuefei Ning Xiangsheng Shi Songyi Yang Shuang Liang Peng Lei Jianfei Chen Huazhong Yang Yu Wang MQ 23 7 0 21 Nov 2020
DOTS: Decoupling Operation and Topology in Differentiable Architecture Search Yuchao Gu Li-Juan Wang Yun-Hai Liu Yi Yang Yu-Huan Wu Shao-Ping Lu Ming-Ming Cheng 32 48 0 02 Oct 2020
NAS-Bench-1Shot1: Benchmarking and Dissecting One-shot Neural Architecture Search Arber Zela Julien N. Siems Frank Hutter 88 147 0 28 Jan 2020
Efficient Multi-objective Neural Architecture Search via Lamarckian Evolution T. Elsken J. H. Metzen Frank Hutter 131 498 0 24 Apr 2018
Neural Architecture Search with Reinforcement Learning Barret Zoph Quoc V. Le 271 5,329 0 05 Nov 2016