sharpDARTS: Faster and More Accurate Differentiable Architecture Search

23 March 2019

Papers citing "sharpDARTS: Faster and More Accurate Differentiable Architecture Search"

34 / 34 papers shown

Title
Increasing Both Batch Size and Learning Rate Accelerates Stochastic Gradient Descent Hikaru Umeda Hideaki Iiduka 67 2 0 17 Feb 2025
Convergence of Sharpness-Aware Minimization Algorithms using Increasing Batch Size and Decaying Learning Rate Hinata Harada Hideaki Iiduka 30 1 0 16 Sep 2024
A Pairwise Comparison Relation-assisted Multi-objective Evolutionary Neural Architecture Search Method with Multi-population Mechanism Yu Xue Chenchen Zhu MengChu Zhou Mohamed Wahib M. Gabbouj 37 1 0 22 Jul 2024
MiniCPM: Unveiling the Potential of Small Language Models with Scalable Training Strategies Shengding Hu Yuge Tu Xu Han Chaoqun He Ganqu Cui ... Chaochao Jia Guoyang Zeng Dahai Li Zhiyuan Liu Maosong Sun MoE 43 282 0 09 Apr 2024
AZ-NAS: Assembling Zero-Cost Proxies for Network Architecture Search Junghyup Lee Bumsub Ham 24 6 0 28 Mar 2024
Using Stochastic Gradient Descent to Smooth Nonconvex Functions: Analysis of Implicit Graduated Optimization with Optimal Noise Scheduling Naoki Sato Hideaki Iiduka 22 3 0 15 Nov 2023
DP-HyPO: An Adaptive Private Hyperparameter Optimization Framework Hua Wang Sheng-yang Gao Huanyu Zhang Weijie J. Su Milan Shen 20 5 0 09 Jun 2023
ZiCo: Zero-shot NAS via Inverse Coefficient of Variation on Gradients Guihong Li Yuedong Yang Kartikeya Bhardwaj R. Marculescu 36 60 0 26 Jan 2023
Efficient Evaluation Methods for Neural Architecture Search: A Survey Xiangning Xie Xiaotian Song Zeqiong Lv Gary G. Yen Weiping Ding Y. Sun 26 12 0 14 Jan 2023
DASS: Differentiable Architecture Search for Sparse neural networks H. Mousavi Mohammad Loni Mina Alibeigi Masoud Daneshtalab 33 11 0 14 Jul 2022
Warm-starting DARTS using meta-learning Matej Grobelnik Joaquin Vanschoren AI4CE 22 1 0 12 May 2022
PRE-NAS: Predictor-assisted Evolutionary Neural Architecture Search Yameng Peng A. Song V. Ciesielski Haytham M. Fayek Xiaojun Chang 21 14 0 27 Apr 2022
On Redundancy and Diversity in Cell-based Neural Architecture Search Xingchen Wan Binxin Ru Pedro M. Esperancca Zhenguo Li 25 20 0 16 Mar 2022
Guided Sampling-based Evolutionary Deep Neural Network for Intelligent Fault Diagnosis Arun K. Sharma N. Verma 29 2 0 12 Nov 2021
Single-DARTS: Towards Stable Architecture Search Pengfei Hou Ying Jin Yukang Chen 10 7 0 18 Aug 2021
COVID Detection in Chest CTs: Improving the Baseline on COV19-CT-DB R. Miron Cosmin Moisii Sergiu-Andrei Dinu Mihaela Breaban 16 6 0 10 Jul 2021
Differentiable Architecture Search for Reinforcement Learning Yingjie Miao Xingyou Song John D. Co-Reyes Daiyi Peng Summer Yue E. Brevdo Aleksandra Faust 20 4 0 04 Jun 2021
Reconsidering CO2 emissions from Computer Vision André Fu Mahdi S. Hosseini Konstantinos N. Plataniotis 13 12 0 18 Apr 2021
Single-level Optimization For Differential Architecture Search Pengfei Hou Ying Jin 17 2 0 15 Dec 2020
Weight-Sharing Neural Architecture Search: A Battle to Shrink the Optimization Gap Lingxi Xie Xin Chen Kaifeng Bi Longhui Wei Yuhui Xu ... Lanfei Wang Anxiang Xiao Jianlong Chang Xiaopeng Zhang Qi Tian ViT 38 108 0 04 Aug 2020
Multi-Objective Neural Architecture Search Based on Diverse Structures and Adaptive Recommendation Chunnan Wang Hongzhi Wang Guocheng Feng Fei Geng 11 5 0 06 Jul 2020
Geometry-Aware Gradient Algorithms for Neural Architecture Search Liam Li M. Khodak Maria-Florina Balcan Ameet Talwalkar 28 66 0 16 Apr 2020
MiLeNAS: Efficient Neural Architecture Search via Mixed-Level Reformulation Chaoyang He Haishan Ye Li Shen Tong Zhang 14 128 0 27 Mar 2020
NAS evaluation is frustratingly hard Antoine Yang P. Esperança Fabio Maria Carlucci 6 166 0 28 Dec 2019
Balanced One-shot Neural Architecture Optimization Renqian Luo Tao Qin Enhong Chen BDL 22 14 0 24 Sep 2019
Neural Architecture Search in Embedding Space Chunmiao Liu 12 0 0 09 Sep 2019
AutoML: A Survey of the State-of-the-Art Xin He Kaiyong Zhao X. Chu 20 1,419 0 02 Aug 2019
Single-Path Mobile AutoML: Efficient ConvNet Design and NAS Hyperparameter Optimization Dimitrios Stamoulis Ruizhou Ding Di Wang Dimitrios Lymberopoulos B. Priyantha Jie Liu Diana Marculescu 12 33 0 01 Jul 2019
XNAS: Neural Architecture Search with Expert Advice Niv Nayman Asaf Noy T. Ridnik Itamar Friedman R. L. Jin Lihi Zelnik-Manor 18 127 0 19 Jun 2019
Prune and Replace NAS Kevin Laube A. Zell 6 13 0 18 Jun 2019
Single-Path NAS: Device-Aware Efficient ConvNet Design Dimitrios Stamoulis Ruizhou Ding Di Wang Dimitrios Lymberopoulos B. Priyantha Jie Liu Diana Marculescu 11 18 0 10 May 2019
Neural Architecture Search for Deep Face Recognition Ning Zhu CVBM 14 9 0 21 Apr 2019
ASAP: Architecture Search, Anneal and Prune Asaf Noy Niv Nayman T. Ridnik Nadav Zamir Sivan Doveh Itamar Friedman Raja Giryes Lihi Zelnik-Manor 25 100 0 08 Apr 2019
Neural Architecture Search with Reinforcement Learning Barret Zoph Quoc V. Le 271 5,329 0 05 Nov 2016