Stabilizing Differentiable Architecture Search via Perturbation-based Regularization

12 February 2020

Papers citing "Stabilizing Differentiable Architecture Search via Perturbation-based Regularization"

41 / 41 papers shown

Title
Robust and Efficient Transfer Learning via Supernet Transfer in Warm-started Neural Architecture Search Prabhant Singh Joaquin Vanschoren AAML OOD 34 0 0 26 Jul 2024
Robustifying and Boosting Training-Free Neural Architecture Search Zhenfeng He Yao Shu Zhongxiang Dai K. H. Low 32 1 0 12 Mar 2024
Masked Autoencoders Are Robust Neural Architecture Search Learners Yiming Hu Xiangxiang Chu Bo-Wen Zhang OOD 37 0 0 20 Nov 2023
DDNAS: Discretized Differentiable Neural Architecture Search for Text Classification Kuan-Yu Chen Cheng Li Kuo-Jung Lee 28 1 0 12 Jul 2023
Balanced Mixture of SuperNets for Learning the CNN Pooling Architecture Mehraveh Javan Matthew Toews M. Pedersoli 31 1 0 21 Jun 2023
Differentiable Instruction Optimization for Cross-Task Generalization Masaru Isonuma Junichiro Mori Ichiro Sakata 29 0 0 16 Jun 2023
Robustifying DARTS by Eliminating Information Bypass Leakage via Explicit Sparse Regularization Jiuling Zhang Zhiming Ding AAML 21 3 0 12 Jun 2023
Rethink DARTS Search Space and Renovate a New Benchmark Jiuling Zhang Zhiming Ding 33 1 0 12 Jun 2023
GeNAS: Neural Architecture Search with Better Generalization Joonhyun Jeong Joonsang Yu Geondo Park Dongyoon Han Y. Yoo 25 4 0 15 May 2023
ASP: Learn a Universal Neural Solver! Chenguang Wang Zhouliang Yu Stephen Marcus McAleer Tianshu Yu Yao-Chun Yang AAML 32 24 0 01 Mar 2023
Symbolic Discovery of Optimization Algorithms Xiangning Chen Chen Liang Da Huang Esteban Real Kaiyuan Wang ... Xuanyi Dong Thang Luong Cho-Jui Hsieh Yifeng Lu Quoc V. Le 55 350 0 13 Feb 2023
Operation-level Progressive Differentiable Architecture Search Xunyu Zhu Jian Li Yong Liu Weiping Wang 21 6 0 11 Feb 2023
ZiCo: Zero-shot NAS via Inverse Coefficient of Variation on Gradients Guihong Li Yuedong Yang Kartikeya Bhardwaj R. Marculescu 36 60 0 26 Jan 2023
PredNAS: A Universal and Sample Efficient Neural Architecture Search Framework Liuchun Yuan Zehao Huang Naiyan Wang 29 0 0 26 Oct 2022
On the Privacy Risks of Cell-Based NAS Architectures Haiping Huang Zhikun Zhang Yun Shen Michael Backes Qi Li Yang Zhang 27 7 0 04 Sep 2022
Partial Connection Based on Channel Attention for Differentiable Neural Architecture Search Yu Xue Jiafeng Qin 27 55 0 01 Aug 2022
Warm-starting DARTS using meta-learning Matej Grobelnik Joaquin Vanschoren AI4CE 22 1 0 12 May 2022
Generalizing Few-Shot NAS with Gradient Matching Shou-Yong Hu Ruochen Wang Lanqing Hong Zhenguo Li Cho-Jui Hsieh Jiashi Feng 25 23 0 29 Mar 2022
$β$ -DARTS: Beta-Decay Regularization for Differentiable Architecture Search Peng Ye Baopu Li Yikang Li Tao Chen Jiayuan Fan Wanli Ouyang 16 101 0 03 Mar 2022
Neural Architecture Search for Dense Prediction Tasks in Computer Vision T. Elsken Arber Zela J. H. Metzen B. Staffler Thomas Brox Abhinav Valada Frank Hutter OOD 33 17 0 15 Feb 2022
Deep invariant networks with differentiable augmentation layers Cédric Rommel Thomas Moreau Alexandre Gramfort OOD 22 8 0 04 Feb 2022
Learning from Mistakes based on Class Weighting with Application to Neural Architecture Search Jay P. Gala P. Xie 29 1 0 01 Dec 2021
Local Learning Matters: Rethinking Data Heterogeneity in Federated Learning Matías Mendieta Taojiannan Yang Pu Wang Minwoo Lee Zhengming Ding C. L. P. Chen FedML 24 158 0 28 Nov 2021
Exploring Architectural Ingredients of Adversarially Robust Deep Neural Networks Hanxun Huang Yisen Wang S. Erfani Quanquan Gu James Bailey Xingjun Ma AAML TPM 46 100 0 07 Oct 2021
DAAS: Differentiable Architecture and Augmentation Policy Search Xiaoxing Wang Xiangxiang Chu Junchi Yan Xiaokang Yang 24 5 0 30 Sep 2021
$L$^{2}$NAS: Learning to Optimize Neural Architectures via Continuous-Action Reinforcement Learning$ L $^{2}$ NAS: Learning to Optimize Neural Architectures via Continuous-Action Reinforcement Learning Keith G. Mills Fred X. Han Mohammad Salameh Seyed Saeed Changiz Rezaei Linglong Kong Wei Lu Shuo Lian Shangling Jui Di Niu 19 10 0 25 Sep 2021
NASI: Label- and Data-agnostic Neural Architecture Search at Initialization Yao Shu Shaofeng Cai Zhongxiang Dai Beng Chin Ooi K. H. Low 16 43 0 02 Sep 2021
iDARTS: Improving DARTS by Node Normalization and Decorrelation Discretization Huiqun Wang Ruijie Yang Di Huang Yunhong Wang 16 27 0 25 Aug 2021
Is Differentiable Architecture Search truly a One-Shot Method? Jonas Geiping Jovita Lukasik M. Keuper Michael Moeller 25 0 0 12 Aug 2021
Rethinking Architecture Selection in Differentiable NAS Ruochen Wang Minhao Cheng Xiangning Chen Xiaocheng Tang Cho-Jui Hsieh 21 172 0 10 Aug 2021
Bag of Tricks for Neural Architecture Search T. Elsken B. Staffler Arber Zela J. H. Metzen Frank Hutter 25 5 0 08 Jul 2021
iDARTS: Differentiable Architecture Search with Stochastic Implicit Gradients Miao Zhang Steven W. Su Shirui Pan Xiaojun Chang Ehsan Abbasnejad Reza Haffari 21 68 0 21 Jun 2021
CATE: Computation-aware Neural Architecture Encoding with Transformers Shen Yan Kaiqiang Song Z. Feng Mi Zhang 22 24 0 14 Feb 2021
Unchain the Search Space with Hierarchical Differentiable Architecture Search Guanting Liu Yujie Zhong Sheng Guo Matthew R. Scott Weilin Huang AI4CE 19 2 0 11 Jan 2021
DSRNA: Differentiable Search of Robust Neural Architectures Ramtin Hosseini Xingyi Yang P. Xie OOD AAML 21 50 0 11 Dec 2020
Learning by Passing Tests, with Application to Neural Architecture Search Xuefeng Du Haochen Zhang P. Xie 18 4 0 30 Nov 2020
Inter-layer Transition in Neural Architecture Search Benteng Ma Jing Zhang Yong-quan Xia Dacheng Tao 25 4 0 30 Nov 2020
DOTS: Decoupling Operation and Topology in Differentiable Architecture Search Yuchao Gu Li-Juan Wang Yun-Hai Liu Yi Yang Yu-Huan Wu Shao-Ping Lu Ming-Ming Cheng 29 48 0 02 Oct 2020
NAS-Bench-1Shot1: Benchmarking and Dissecting One-shot Neural Architecture Search Arber Zela Julien N. Siems Frank Hutter 88 147 0 28 Jan 2020
Efficient Multi-objective Neural Architecture Search via Lamarckian Evolution T. Elsken J. H. Metzen Frank Hutter 131 498 0 24 Apr 2018
Neural Architecture Search with Reinforcement Learning Barret Zoph Quoc V. Le 271 5,326 0 05 Nov 2016