Can weight sharing outperform random architecture search? An investigation with TuNAS

13 August 2020

Pieter-Jan Kindermans

Quoc V. Le

OOD

ArXiv PDF HTML

Papers citing "Can weight sharing outperform random architecture search? An investigation with TuNAS"

34 / 34 papers shown

Title
RBFleX-NAS: Training-Free Neural Architecture Search Using Radial Basis Function Kernel and Hyperparameter Detection Tomomasa Yamasaki Zhehui Wang Tao Luo Niangjun Chen Bo Wang 32 0 0 26 Mar 2025
FLIQS: One-Shot Mixed-Precision Floating-Point and Integer Quantization Search Jordan Dotzel Gang Wu Andrew Li M. Umar Yun Ni ... Liqun Cheng Martin G. Dixon N. Jouppi Quoc V. Le Sheng Li MQ 33 3 0 07 Aug 2023
Towards Hardware-Specific Automatic Compression of Neural Networks Torben Krieger Bernhard Klein Holger Fröning MQ 27 2 0 15 Dec 2022
Packed-Ensembles for Efficient Uncertainty Estimation Olivier Laurent Adrien Lafage Enzo Tartaglione Geoffrey Daniel Jean-Marc Martinez Andrei Bursuc Gianni Franchi OODD 44 32 0 17 Oct 2022
Pareto-aware Neural Architecture Generation for Diverse Computational Budgets Yong Guo Yaofo Chen Yin Zheng Qi Chen P. Zhao Jian Chen Junzhou Huang Mingkui Tan 28 5 0 14 Oct 2022
LidarNAS: Unifying and Searching Neural Architectures for 3D Point Clouds Chenxi Liu Zhaoqi Leng Peigen Sun Shuyang Cheng C. Qi Yin Zhou Mingxing Tan Drago Anguelov 3DPC 3DV 37 5 0 10 Oct 2022
On the Factory Floor: ML Engineering for Industrial-Scale Ads Recommendation Models Rohan Anil S. Gadanho Danya Huang Nijith Jacob Zhuoshu Li ... Cristina Pop Kevin Regan G. Shamir Rakesh Shivanna Qiqi Yan 3DV 29 41 0 12 Sep 2022
Design Automation for Fast, Lightweight, and Effective Deep Learning Models: A Survey Dalin Zhang Kaixuan Chen Yan Zhao B. Yang Li-Ping Yao Christian S. Jensen 48 3 0 22 Aug 2022
A Survey on Video Action Recognition in Sports: Datasets, Methods and Applications Fei Wu Qingzhong Wang Jian Bian Haoyi Xiong Ning Ding Feixiang Lu Junqing Cheng Dejing Dou AI4TS 28 52 0 02 Jun 2022
Neural Architecture Search using Property Guided Synthesis Charles Jin P. Phothilimthana Sudip Roy 27 6 0 08 May 2022
When NAS Meets Trees: An Efficient Algorithm for Neural Architecture Search Guocheng Qian Xuanyang Zhang Ge Li Chen Zhao Yukang Chen Xinming Zhang Guohao Li Jian Sun 39 4 0 11 Apr 2022
Searching for Efficient Neural Architectures for On-Device ML on Edge TPUs Berkin Akin Suyog Gupta Yun Long Anton Spiridonov Zhuo Wang Marie White Haonan Xu Ping Zhou Yanqi Zhou 24 9 0 09 Apr 2022
A Semi-Decoupled Approach to Fast and Optimal Hardware-Software Co-Design of Neural Accelerators Bingqian Lu Zheyu Yan Yiyu Shi Shaolei Ren 23 2 0 25 Mar 2022
Neural Architecture Search for Dense Prediction Tasks in Computer Vision T. Elsken Arber Zela J. H. Metzen B. Staffler Thomas Brox Abhinav Valada Frank Hutter OOD 36 17 0 15 Feb 2022
GradTail: Learning Long-Tailed Data Using Gradient-based Sample Weighting Zhao Chen Vincent Casser Henrik Kretzschmar Dragomir Anguelov 31 5 0 16 Jan 2022
Automated Deep Learning: Neural Architecture Search Is Not the End Xuanyi Dong D. Kedziora Katarzyna Musial Bogdan Gabrys 25 26 0 16 Dec 2021
Searching for TrioNet: Combining Convolution with Local and Global Self-Attention Huaijin Pi Huiyu Wang Yingwei Li Zizhang Li Alan Yuille ViT 27 3 0 15 Nov 2021
One Proxy Device Is Enough for Hardware-Aware Neural Architecture Search Bingqian Lu Jianyi Yang Weiwen Jiang Yiyu Shi Shaolei Ren 24 24 0 01 Nov 2021
An Analysis of Super-Net Heuristics in Weight-Sharing NAS Kaicheng Yu René Ranftl Mathieu Salzmann 31 6 0 04 Oct 2021
Profiling Neural Blocks and Design Spaces for Mobile Neural Architecture Search Keith G. Mills Fred X. Han Jialin Zhang Seyed Saeed Changiz Rezaei Fabián A. Chudak Wei Lu Shuo Lian Shangling Jui Di Niu 19 8 0 25 Sep 2021
$L$^{2}$NAS: Learning to Optimize Neural Architectures via Continuous-Action Reinforcement Learning$ L $^{2}$ NAS: Learning to Optimize Neural Architectures via Continuous-Action Reinforcement Learning Keith G. Mills Fred X. Han Mohammad Salameh Seyed Saeed Changiz Rezaei Linglong Kong Wei Lu Shuo Lian Shangling Jui Di Niu 25 10 0 25 Sep 2021
Primer: Searching for Efficient Transformers for Language Modeling David R. So Wojciech Mañke Hanxiao Liu Zihang Dai Noam M. Shazeer Quoc V. Le VLM 91 152 0 17 Sep 2021
Learning to Rank Ace Neural Architectures via Normalized Discounted Cumulative Gain Yuge Zhang Quan Zhang Li Zhang Yaming Yang Chenqian Yan Xiaotian Gao Yuqing Yang 33 0 0 06 Aug 2021
Bag of Tricks for Neural Architecture Search T. Elsken B. Staffler Arber Zela J. H. Metzen Frank Hutter 27 5 0 08 Jul 2021
Fisher Task Distance and Its Application in Neural Architecture Search Cat P. Le Mohammadreza Soltani Juncheng Dong Vahid Tarokh FedML 24 8 0 23 Mar 2021
BossNAS: Exploring Hybrid CNN-transformers with Block-wisely Self-supervised Neural Architecture Search Changlin Li Tao Tang Guangrun Wang Jiefeng Peng Bing Wang Xiaodan Liang Xiaojun Chang ViT 46 105 0 23 Mar 2021
Rethinking Co-design of Neural Architectures and Hardware Accelerators Yanqi Zhou Xuanyi Dong Berkin Akin Mingxing Tan Daiyi Peng Tianjian Meng Amir Yazdanbakhsh Da Huang Ravi Narayanaswami James Laudon 60 26 0 17 Feb 2021
CATE: Computation-aware Neural Architecture Encoding with Transformers Shen Yan Kaiqiang Song Z. Feng Mi Zhang 22 24 0 14 Feb 2021
A Comprehensive Survey on Hardware-Aware Neural Architecture Search Hadjer Benmeziane Kaoutar El Maghraoui Hamza Ouarnoughi Smail Niar Martin Wistuba Naigang Wang 34 96 0 22 Jan 2021
Joslim: Joint Widths and Weights Optimization for Slimmable Neural Networks Ting-Wu Chin Ari S. Morcos Diana Marculescu 24 10 0 23 Jul 2020
HourNAS: Extremely Fast Neural Architecture Search Through an Hourglass Lens Zhaohui Yang Yunhe Wang Xinghao Chen Jianyuan Guo Wei Zhang Chao Xu Chunjing Xu Dacheng Tao Chang Xu 39 17 0 29 May 2020
Neural Predictor for Neural Architecture Search W. Wen Hanxiao Liu H. Li Yiran Chen Gabriel Bender Pieter-Jan Kindermans 46 194 0 02 Dec 2019
NetAdapt: Platform-Aware Neural Network Adaptation for Mobile Applications Tien-Ju Yang Andrew G. Howard Bo Chen Xiao Zhang Alec Go Mark Sandler Vivienne Sze Hartwig Adam 90 515 0 09 Apr 2018
Neural Architecture Search with Reinforcement Learning Barret Zoph Quoc V. Le 271 5,327 0 05 Nov 2016