Once-for-All: Train One Network and Specialize it for Efficient Deployment

26 August 2019

Chuang Gan

Song Han

Papers citing "Once-for-All: Train One Network and Specialize it for Efficient Deployment"

50 / 257 papers shown

Title
SONAR: Joint Architecture and System Optimization Search Elias Jääsaari Michelle Ma Ameet Talwalkar Tianqi Chen 36 1 0 25 Aug 2022
DeepPicarMicro: Applying TinyML to Autonomous Cyber Physical Systems Michael Bechtel QiTao Weng H. Yun BDL 23 7 0 23 Aug 2022
SVD-NAS: Coupling Low-Rank Approximation and Neural Architecture Search Zhewen Yu C. Bouganis 32 4 0 22 Aug 2022
Design Automation for Fast, Lightweight, and Effective Deep Learning Models: A Survey Dalin Zhang Kaixuan Chen Yan Zhao B. Yang Li-Ping Yao Christian S. Jensen 46 3 0 22 Aug 2022
Accelerating Vision Transformer Training via a Patch Sampling Schedule Bradley McDanel C. Huynh ViT 25 1 0 19 Aug 2022
Surrogate-assisted Multi-objective Neural Architecture Search for Real-time Semantic Segmentation Zhichao Lu Ran Cheng Shihua Huang Haotong Zhang Changxiao Qiu Fan Yang SSeg 22 22 0 14 Aug 2022
Mixed-Precision Neural Networks: A Survey M. Rakka M. Fouda Pramod P. Khargonekar Fadi J. Kurdahi MQ 25 11 0 11 Aug 2022
Tackling Neural Architecture Search With Quality Diversity Optimization Lennart Schneider Florian Pfisterer P. Kent Juergen Branke B. Bischl Janek Thomas AI4CE 35 3 0 30 Jul 2022
UFO: Unified Feature Optimization Teng Xi Yifan Sun Deli Yu Bi Li Nan Peng ... Haocheng Feng Junyu Han Jingtuo Liu Errui Ding Jingdong Wang 32 10 0 21 Jul 2022
Bi-fidelity Evolutionary Multiobjective Search for Adversarially Robust Deep Neural Architectures Jia-Wei Liu Ran Cheng Yaochu Jin AAML 27 7 0 12 Jul 2022
DRESS: Dynamic REal-time Sparse Subnets Zhongnan Qu Syed Shakib Sarwar Xin Dong Yuecheng Li Huseyin Ekin Sumbul B. D. Salvo 3DH 18 1 0 01 Jul 2022
Switchable Representation Learning Framework with Self-compatibility Shengsen Wu Yan Bai Yihang Lou Xiongkun Linghu Jianzhong He Ling-yu Duan 22 1 0 16 Jun 2022
Simple and Efficient Architectures for Semantic Segmentation Dushyant Mehta Andrii Skliar H. Yahia Shubhankar Borse Fatih Porikli A. Habibian Tijmen Blankevoort SSeg 21 13 0 16 Jun 2022
Slimmable Domain Adaptation Rang Meng Weijie Chen Shicai Yang Mingli Song Luojun Lin Di Xie Shiliang Pu Xinchao Wang Mingli Song Yueting Zhuang 29 12 0 14 Jun 2022
A Survey on Computationally Efficient Neural Architecture Search Shiqing Liu Haoyu Zhang Yaochu Jin 30 41 0 03 Jun 2022
Edge Learning for B5G Networks with Distributed Signal Processing: Semantic Communication, Edge Computing, and Wireless Sensing Wei Xu Zhaohui Yang Derrick Wing Kwan Ng Marco Levorato Yonina C. Eldar Mérouane Debbah 28 398 0 01 Jun 2022
Towards Efficient 3D Object Detection with Knowledge Distillation Jihan Yang Shaoshuai Shi Runyu Ding Zhe Wang Xiaojuan Qi 114 46 0 30 May 2022
Machine Learning for Microcontroller-Class Hardware: A Review Swapnil Sayan Saha S. Sandha Mani B. Srivastava 27 118 0 29 May 2022
Compression-aware Training of Neural Networks using Frank-Wolfe Max Zimmer Christoph Spiegel Sebastian Pokutta 29 9 0 24 May 2022
Super Vision Transformer Mingbao Lin Yonghong Tian Yuxin Zhang Yunhang Shen Rongrong Ji Liujuan Cao ViT 46 20 0 23 May 2022
A Hardware-Aware Framework for Accelerating Neural Architecture Search Across Modalities Daniel Cummings Anthony Sarah S. N. Sridhar Maciej Szankin J. P. Muñoz Sairam Sundaresan 30 8 0 19 May 2022
Semi-Supervised Learning for Image Classification using Compact Networks in the BioMedical Context Adrián Inés Andrés Díaz-Pinto C. Domínguez Jónathan Heras Eloy J. Mata Vico Pascual 27 1 0 19 May 2022
PVNAS: 3D Neural Architecture Search with Point-Voxel Convolution Zhijian Liu Haotian Tang Shengyu Zhao Kevin Shao Song Han 3DPC 21 40 0 25 Apr 2022
SplitNets: Designing Neural Architectures for Efficient Distributed Computing on Head-Mounted Systems Xin Dong B. D. Salvo Meng Li Chiao Liu Zhongnan Qu H. T. Kung Ziyun Li 3DGS 26 20 0 10 Apr 2022
Solving ImageNet: a Unified Scheme for Training any Backbone to Top Results T. Ridnik Hussam Lawen Emanuel Ben-Baruch Asaf Noy 38 11 0 07 Apr 2022
LightHuBERT: Lightweight and Configurable Speech Representation Learning with Once-for-All Hidden-Unit BERT Rui Wang Qibing Bai Junyi Ao Long Zhou Zhixiang Xiong Zhihua Wei Yu Zhang Tom Ko Haizhou Li 34 61 0 29 Mar 2022
Generalizing Few-Shot NAS with Gradient Matching Shou-Yong Hu Ruochen Wang Lanqing Hong Zhenguo Li Cho-Jui Hsieh Jiashi Feng 25 23 0 29 Mar 2022
Pruning In Time (PIT): A Lightweight Network Architecture Optimizer for Temporal Convolutional Networks Matteo Risso Alessio Burrello Daniele Jahier Pagliari Francesco Conti Lorenzo Lamberti Enrico Macii Luca Benini M. Poncino 21 10 0 28 Mar 2022
Automated Progressive Learning for Efficient Training of Vision Transformers Changlin Li Bohan Zhuang Guangrun Wang Xiaodan Liang Xiaojun Chang Yi Yang 28 46 0 28 Mar 2022
A Semi-Decoupled Approach to Fast and Optimal Hardware-Software Co-Design of Neural Accelerators Bingqian Lu Zheyu Yan Yiyu Shi Shaolei Ren 23 2 0 25 Mar 2022
Adaptive Patch Exiting for Scalable Single Image Super-Resolution Shizun Wang Ming Lu Kaixin Chen Xiaoqi Li Jiaming Liu Yandong Guo SupR 30 23 0 22 Mar 2022
Ensemble Knowledge Guided Sub-network Search and Fine-tuning for Filter Pruning Seunghyun Lee B. Song 19 8 0 05 Mar 2022
Exploring Patch-wise Semantic Relation for Contrastive Learning in Image-to-Image Translation Tasks Chanyong Jung Gihyun Kwon Jong Chul Ye 29 84 0 03 Mar 2022
Accelerating Neural Architecture Exploration Across Modalities Using Genetic Algorithms Daniel Cummings S. N. Sridhar Anthony Sarah Maciej Szankin AI4CE 25 0 0 25 Feb 2022
Towards Tailored Models on Private AIoT Devices: Federated Direct Neural Architecture Search Chunhui Zhang Xiaoming Yuan Qianyun Zhang Guangxu Zhu Lei Cheng Ning Zhang FedML OOD 13 15 0 23 Feb 2022
Compute Trends Across Three Eras of Machine Learning J. Sevilla Lennart Heim A. Ho T. Besiroglu Marius Hobbhahn Pablo Villalobos 30 269 0 11 Feb 2022
Model Architecture Adaption for Bayesian Neural Networks Duo Wang Yiren Zhao Ilia Shumailov Robert D. Mullins UQCV OOD BDL 23 0 0 09 Feb 2022
Membership Inference Attacks and Defenses in Neural Network Pruning Xiaoyong Yuan Lan Zhang AAML 18 44 0 07 Feb 2022
ASFD: Automatic and Scalable Face Detector Jian Li Bin Zhang Yabiao Wang Ying Tai Feiyue Huang Chengjie Wang Jilin Li Wenjiang Pei Yili Xia CVBM 51 43 0 26 Jan 2022
It's All in the Head: Representation Knowledge Distillation through Classifier Sharing Emanuel Ben-Baruch M. Karklinsky Yossi Biton Avi Ben-Cohen Hussam Lawen Nadav Zamir 24 11 0 18 Jan 2022
UDC: Unified DNAS for Compressible TinyML Models Igor Fedorov Ramon Matas Hokchhay Tann Chu Zhou Matthew Mattina P. Whatmough AI4CE 21 13 0 15 Jan 2022
Croesus: Multi-Stage Processing and Transactions for Video-Analytics in Edge-Cloud Systems Samaa Gazzaz Vishal Chakraborty Faisal Nawab 30 10 0 31 Dec 2021
Compact Multi-level Sparse Neural Networks with Input Independent Dynamic Rerouting Minghai Qin Tianyun Zhang Fei Sun Yen-kuang Chen M. Fardad Yanzhi Wang Yuan Xie 49 0 0 21 Dec 2021
Enabling NAS with Automated Super-Network Generation J. P. Muñoz N. Lyalyushkin Yash Akhauri A. Senina Alexander Kozlov Nilesh Jain 30 17 0 20 Dec 2021
Automated Deep Learning: Neural Architecture Search Is Not the End Xuanyi Dong D. Kedziora Katarzyna Musial Bogdan Gabrys 25 26 0 16 Dec 2021
Nonuniform-to-Uniform Quantization: Towards Accurate Quantization via Generalized Straight-Through Estimation Zechun Liu Kwang-Ting Cheng Dong Huang Eric P. Xing Zhiqiang Shen MQ 25 103 0 29 Nov 2021
MAE-DET: Revisiting Maximum Entropy Principle in Zero-Shot NAS for Efficient Object Detection Zhenhong Sun Ming Lin Xiuyu Sun Zhiyu Tan Hao Li Rong Jin 23 32 0 26 Nov 2021
Pruning Self-attentions into Convolutional Layers in Single Path Haoyu He Jianfei Cai Jing Liu Zizheng Pan Jing Zhang Dacheng Tao Bohan Zhuang ViT 34 40 0 23 Nov 2021
FBNetV5: Neural Architecture Search for Multiple Tasks in One Run Bichen Wu Chaojian Li Hang Zhang Xiaoliang Dai Peizhao Zhang Matthew Yu Jialiang Wang Yingyan Lin Peter Vajda ViT 31 23 0 19 Nov 2021
Searching for TrioNet: Combining Convolution with Local and Global Self-Attention Huaijin Pi Huiyu Wang Yingwei Li Zizhang Li Alan Yuille ViT 24 3 0 15 Nov 2021