Once-for-All: Train One Network and Specialize it for Efficient Deployment

26 August 2019

Chuang Gan

Song Han

Papers citing "Once-for-All: Train One Network and Specialize it for Efficient Deployment"

50 / 257 papers shown

Title
One Proxy Device Is Enough for Hardware-Aware Neural Architecture Search Bingqian Lu Jianyi Yang Weiwen Jiang Yiyu Shi Shaolei Ren 24 24 0 01 Nov 2021
MCUNetV2: Memory-Efficient Patch-based Inference for Tiny Deep Learning Ji Lin Wei-Ming Chen Han Cai Chuang Gan Song Han 43 154 0 28 Oct 2021
Multi-label Classification with Partial Annotations using Class-aware Selective Loss Emanuel Ben-Baruch T. Ridnik Itamar Friedman Avi Ben-Cohen Nadav Zamir Asaf Noy Lihi Zelnik-Manor 32 38 0 21 Oct 2021
SMOF: Squeezing More Out of Filters Yields Hardware-Friendly CNN Pruning Yanli Liu Bochen Guan Qinwen Xu Weiyi Li Shuxue Quan 33 2 0 21 Oct 2021
Sub-bit Neural Networks: Learning to Compress and Accelerate Binary Neural Networks Yikai Wang Yi Yang Gang Hua Anbang Yao MQ 29 15 0 18 Oct 2021
Joint Channel and Weight Pruning for Model Acceleration on Moblie Devices Tianli Zhao Xi Sheryl Zhang Wentao Zhu Jiaxing Wang Sen Yang Ji Liu Jian Cheng 56 2 0 15 Oct 2021
Across-Task Neural Architecture Search via Meta Learning Jingtao Rong Xinyi Yu Mingyang Zhang L. Ou 23 1 0 12 Oct 2021
LCS: Learning Compressible Subspaces for Adaptive Network Compression at Inference Time Elvis Nunez Maxwell Horton Anish K. Prabhu Anurag Ranjan Ali Farhadi Mohammad Rastegari 26 4 0 08 Oct 2021
UniNet: Unified Architecture Search with Convolution, Transformer, and MLP Jihao Liu Hongsheng Li Guanglu Song Xin Huang Yu Liu ViT 37 35 0 08 Oct 2021
Accelerating Multi-Objective Neural Architecture Search by Random-Weight Evaluation Shengran Hu Ran Cheng Cheng He Zhichao Lu Jing Wang Miao Zhang 32 7 0 08 Oct 2021
ABCP: Automatic Block-wise and Channel-wise Network Pruning via Joint Search Jiaqi Li Haoran Li Yaran Chen Zixiang Ding Nannan Li Mingjun Ma Zicheng Duan Dong Zhao 40 9 0 08 Oct 2021
PhiNets: a scalable backbone for low-power AI at the edge Francesco Paissan Alberto Ancilotto Elisabetta Farella 26 32 0 01 Oct 2021
$L$^{2}$NAS: Learning to Optimize Neural Architectures via Continuous-Action Reinforcement Learning$ L $^{2}$ NAS: Learning to Optimize Neural Architectures via Continuous-Action Reinforcement Learning Keith G. Mills Fred X. Han Mohammad Salameh Seyed Saeed Changiz Rezaei Linglong Kong Wei Lu Shuo Lian Shangling Jui Di Niu 22 10 0 25 Sep 2021
PP-LCNet: A Lightweight CPU Convolutional Neural Network Cheng Cui Tingquan Gao Shengyun Wei Yuning Du Ruoyu Guo ... X. Lv Qiwen Liu Xiaoguang Hu Dianhai Yu Yanjun Ma ObjD 44 121 0 17 Sep 2021
EfficientBERT: Progressively Searching Multilayer Perceptron via Warm-up Knowledge Distillation Chenhe Dong Guangrun Wang Hang Xu Jiefeng Peng Xiaozhe Ren Xiaodan Liang 21 28 0 15 Sep 2021
Pareto-wise Ranking Classifier for Multi-objective Evolutionary Neural Architecture Search Lianbo Ma Nan Li Guo-Ding Yu Xiao Geng Min Huang Xingwei Wang 30 53 0 14 Sep 2021
DHA: End-to-End Joint Optimization of Data Augmentation Policy, Hyper-parameter and Architecture Kaichen Zhou Lanqing Hong Shuailiang Hu Fengwei Zhou Binxin Ru Jiashi Feng Zhenguo Li 59 10 0 13 Sep 2021
Prioritized Subnet Sampling for Resource-Adaptive Supernet Training Bohong Chen Mingbao Lin Rongrong Ji Liujuan Cao 26 2 0 12 Sep 2021
FedZKT: Zero-Shot Knowledge Transfer towards Resource-Constrained Federated Learning with Heterogeneous On-Device Models Lan Zhang Dapeng Oliver Wu Xiaoyong Yuan FedML 38 47 0 08 Sep 2021
Architecture Aware Latency Constrained Sparse Neural Networks Tianli Zhao Qinghao Hu Xiangyu He Weixiang Xu Jiaxing Wang Cong Leng Jian Cheng 33 0 0 01 Sep 2021
Full-Cycle Energy Consumption Benchmark for Low-Carbon Computer Vision Bo-wen Li Xinyang Jiang Donglin Bai Yuge Zhang Ningxin Zheng Xuanyi Dong Lu Liu Yuqing Yang Dongsheng Li 14 10 0 30 Aug 2021
Design and Scaffolded Training of an Efficient DNN Operator for Computer Vision on the Edge Vinod Ganesan Pratyush Kumar 39 2 0 25 Aug 2021
A Survey on GAN Acceleration Using Memory Compression Technique Dina Tantawy Mohamed Zahran A. Wassal 36 8 0 14 Aug 2021
FOX-NAS: Fast, On-device and Explainable Neural Architecture Search Chia-Hsiang Liu Yu-Shin Han Yuan-Yao Sung Yi Lee Hung-Yueh Chiang Kai-Chiang Wu 21 11 0 14 Aug 2021
perf4sight: A toolflow to model CNN training performance on Edge GPUs A. Rajagopal C. Bouganis 21 7 0 12 Aug 2021
Learning to Rank Ace Neural Architectures via Normalized Discounted Cumulative Gain Yuge Zhang Quan Zhang Li Lyna Zhang Yaming Yang Chenqian Yan Xiaotian Gao Yuqing Yang 33 0 0 06 Aug 2021
FLASH: Fast Neural Architecture Search with Hardware Optimization Guihong Li Sumit K. Mandal Ümit Y. Ogras R. Marculescu 27 20 0 01 Aug 2021
MFAGAN: A Compression Framework for Memory-Efficient On-Device Super-Resolution GAN Wenlong Cheng Mingbo Zhao Zhiling Ye Shuhang Gu 18 22 0 27 Jul 2021
QuantumNAS: Noise-Adaptive Search for Robust Quantum Circuits Hanrui Wang Yongshan Ding Jiaqi Gu Zirui Li Yujun Lin David Z. Pan Frederic T. Chong Song Han 33 170 0 22 Jul 2021
AutoBERT-Zero: Evolving BERT Backbone from Scratch Jiahui Gao Hang Xu Han Shi Xiaozhe Ren Philip L. H. Yu Xiaodan Liang Xin Jiang Zhenguo Li 21 37 0 15 Jul 2021
Rapid Neural Architecture Search by Learning to Generate Graphs from Datasets Hayeon Lee Eunyoung Hyung Sung Ju Hwang 40 43 0 02 Jul 2021
AutoFormer: Searching Transformers for Visual Recognition Minghao Chen Houwen Peng Jianlong Fu Haibin Ling ViT 36 259 0 01 Jul 2021
Elbert: Fast Albert with Confidence-Window Based Early Exit Keli Xie Siyuan Lu Meiqi Wang Zhongfeng Wang 14 20 0 01 Jul 2021
GAIA: A Transfer Learning System of Object Detection that Fits Your Needs Xingyuan Bu Junran Peng Junjie Yan Tieniu Tan Zhaoxiang Zhang ObjD VLM 31 53 0 21 Jun 2021
CompConv: A Compact Convolution Module for Efficient Feature Learning Chen Zhang Yinghao Xu Yujun Shen VLM SSL 16 10 0 19 Jun 2021
HELP: Hardware-Adaptive Efficient Latency Prediction for NAS via Meta-Learning Hayeon Lee Sewoong Lee Song Chong Sung Ju Hwang 18 26 0 16 Jun 2021
BoolNet: Minimizing The Energy Consumption of Binary Neural Networks Nianhui Guo Joseph Bethge Haojin Yang Kai Zhong Xuefei Ning Christoph Meinel Yu Wang MQ 24 11 0 13 Jun 2021
Auto-NBA: Efficient and Effective Search Over the Joint Space of Networks, Bitwidths, and Accelerators Yonggan Fu Yongan Zhang Yang Zhang David D. Cox Yingyan Lin MQ 55 17 0 11 Jun 2021
Pedestrian Attribute Recognition in Video Surveillance Scenarios Based on View-attribute Attention Localization Wei-Chen Chen Xin-Yi Yu Linlin Ou 30 15 0 11 Jun 2021
The Care Label Concept: A Certification Suite for Trustworthy and Resource-Aware Machine Learning K. Morik Helena Kotthaus Lukas Heppe Danny Heinrich Raphael Fischer Andrea Pauly Nico Piatkowski 23 4 0 01 Jun 2021
Memory-Efficient Differentiable Transformer Architecture Search Yuekai Zhao Li Dong Yelong Shen Zhihua Zhang Furu Wei Weizhu Chen ViT 30 17 0 31 May 2021
The Power of Log-Sum-Exp: Sequential Density Ratio Matrix Estimation for Speed-Accuracy Optimization Taiki Miyagawa Akinori F. Ebihara 25 3 0 28 May 2021
NAAS: Neural Accelerator Architecture Search Yujun Lin Mengtian Yang Song Han 26 58 0 27 May 2021
FNAS: Uncertainty-Aware Fast Neural Architecture Search Jihao Liu Ming Zhang Yangting Sun B. Liu Guanglu Song Yu Liu Hongsheng Li 30 7 0 25 May 2021
ViPNAS: Efficient Video Pose Estimation via Neural Architecture Search Lumin Xu Yingda Guan Sheng Jin Wentao Liu Chao Qian Ping Luo Wanli Ouyang Xiaogang Wang 31 52 0 21 May 2021
Fast Camera Image Denoising on Mobile GPUs with Deep Learning, Mobile AI 2021 Challenge: Report Andrey D. Ignatov Kim Byeoung-su Radu Timofte Angeline Pouget Fenglong Song ... Lei Lei Chaoyu Feng L. Huang Z. Lei Feifei Chen 25 30 0 17 May 2021
MutualNet: Adaptive ConvNet via Mutual Learning from Different Model Configurations Taojiannan Yang Sijie Zhu Matías Mendieta Pu Wang Ravikumar Balakrishnan Minwoo Lee T. Han M. Shah Cheng Chen 3DH OOD 28 22 0 14 May 2021
Dynamic-OFA: Runtime DNN Architecture Switching for Performance Scaling on Heterogeneous Embedded Platforms W. Lou Lei Xun Amin Sabet Jia Bi Jonathon S. Hare G. Merrett AI4CE 28 28 0 08 May 2021
BasisNet: Two-stage Model Synthesis for Efficient Inference Mingda Zhang Chun-Te Chu A. Zhmoginov Andrew G. Howard Brendan Jou Yukun Zhu Li Zhang R. Hwa Adriana Kovashka 3DH 31 7 0 07 May 2021
Single-Training Collaborative Object Detectors Adaptive to Bandwidth and Computation Juliano S. Assine José Cândido Silveira Santos Filho Eduardo Valle ObjD 42 8 0 03 May 2021