Once-for-All: Train One Network and Specialize it for Efficient Deployment

26 August 2019

Chuang Gan

Song Han

Papers citing "Once-for-All: Train One Network and Specialize it for Efficient Deployment"

50 / 257 papers shown

Title
LightTrack: Finding Lightweight Neural Networks for Object Tracking via One-Shot Architecture Search B. Yan Houwen Peng Kan Wu Dong Wang Jianlong Fu Huchuan Lu 36 164 0 29 Apr 2021
CompOFA: Compound Once-For-All Networks for Faster Multi-Platform Deployment Manas Sahni S. Varshini Alind Khare Alexey Tumanov 15 31 0 26 Apr 2021
A Survey of Modern Deep Learning based Object Detection Models Syed Sahil Abbas Zaidi M. S. Ansari Asra Aslam N. Kanwal M. Asghar Brian Lee VLM ObjD 67 728 0 24 Apr 2021
ImageNet-21K Pretraining for the Masses T. Ridnik Emanuel Ben-Baruch Asaf Noy Lihi Zelnik-Manor SSeg VLM CLIP 181 687 0 22 Apr 2021
Measuring what Really Matters: Optimizing Neural Networks for TinyML Lennart Heim Andreas Biri Zhongnan Qu Lothar Thiele 49 30 0 21 Apr 2021
MobileStyleGAN: A Lightweight Convolutional Neural Network for High-Fidelity Image Synthesis Sergei Belousov GAN 35 20 0 10 Apr 2021
Rethinking Neural Operations for Diverse Tasks Nicholas Roberts M. Khodak Tri Dao Liam Li Christopher Ré Ameet Talwalkar AI4CE 36 22 0 29 Mar 2021
Fisher Task Distance and Its Application in Neural Architecture Search Cat P. Le Mohammadreza Soltani Juncheng Dong Vahid Tarokh FedML 24 8 0 23 Mar 2021
Revisiting Dynamic Convolution via Matrix Decomposition Yunsheng Li Yinpeng Chen Xiyang Dai Mengchen Liu Dongdong Chen Ye Yu Lu Yuan Zicheng Liu Mei Chen Nuno Vasconcelos 32 67 0 15 Mar 2021
Searching by Generating: Flexible and Efficient One-Shot NAS with Architecture Generator Sian-Yao Huang W. Chu 14 25 0 12 Mar 2021
Quantization-Guided Training for Compact TinyML Models Sedigh Ghamari Koray Ozcan Thu Dinh A. Melnikov Juan Carvajal Jan Ernst S. Chai MQ 21 16 0 10 Mar 2021
Teachers Do More Than Teach: Compressing Image-to-Image Models Qing Jin Jian Ren Oliver J. Woodford Jiazhuo Wang Geng Yuan Yanzhi Wang Sergey Tulyakov 39 54 0 05 Mar 2021
Rethinking Co-design of Neural Architectures and Hardware Accelerators Yanqi Zhou Xuanyi Dong Berkin Akin Mingxing Tan Daiyi Peng Tianjian Meng Amir Yazdanbakhsh Da Huang Ravi Narayanaswami James Laudon 60 26 0 17 Feb 2021
AlphaNet: Improved Training of Supernets with Alpha-Divergence Dilin Wang Chengyue Gong Meng Li Qiang Liu Vikas Chandra 155 44 0 16 Feb 2021
Learning Task-Oriented Communication for Edge Inference: An Information Bottleneck Approach Jiawei Shao Yuyi Mao Jun Zhang 47 212 0 08 Feb 2021
AHAR: Adaptive CNN for Energy-efficient Human Activity Recognition in Low-power Edge Devices Nafiul Rashid B. U. Demirel Mohammad Abdullah Al Faruque 19 73 0 03 Feb 2021
AACP: Model Compression by Accurate and Automatic Channel Pruning Lanbo Lin Yujiu Yang Zhenhua Guo MQ 22 12 0 31 Jan 2021
Pruning and Quantization for Deep Neural Network Acceleration: A Survey Tailin Liang C. Glossner Lei Wang Shaobo Shi Xiaotong Zhang MQ 150 674 0 24 Jan 2021
A Comprehensive Survey on Hardware-Aware Neural Architecture Search Hadjer Benmeziane Kaoutar El Maghraoui Hamza Ouarnoughi Smail Niar Martin Wistuba Naigang Wang 34 96 0 22 Jan 2021
Advances in Electron Microscopy with Deep Learning Jeffrey M. Ede 32 2 0 04 Jan 2021
Generalized Latency Performance Estimation for Once-For-All Neural Architecture Search Muhtadyuzzaman Syed A. Srinivasan 16 9 0 04 Jan 2021
Inception Convolution with Efficient Dilation Search Jie Liu Chuming Li Feng Liang Chen Lin Ming-hui Sun Junjie Yan Wanli Ouyang Dong Xu 39 27 0 25 Dec 2020
Hardware and Software Optimizations for Accelerating Deep Neural Networks: Survey of Current Trends, Challenges, and the Road Ahead Maurizio Capra Beatrice Bussolino Alberto Marchisio Guido Masera Maurizio Martina Muhammad Shafique BDL 56 140 0 21 Dec 2020
Bringing AI To Edge: From Deep Learning's Perspective Di Liu Hao Kong Xiangzhong Luo Weichen Liu Ravi Subramaniam 52 116 0 25 Nov 2020
MicroNet: Towards Image Recognition with Extremely Low FLOPs Yunsheng Li Yinpeng Chen Xiyang Dai Dongdong Chen Mengchen Liu Lu Yuan Zicheng Liu Lei Zhang Nuno Vasconcelos 30 25 0 24 Nov 2020
Scaling Wide Residual Networks for Panoptic Segmentation Liang-Chieh Chen Huiyu Wang Siyuan Qiao SSeg 27 47 0 23 Nov 2020
Learnable Boundary Guided Adversarial Training Jiequan Cui Shu Liu Liwei Wang Jiaya Jia OOD AAML 24 124 0 23 Nov 2020
Larq Compute Engine: Design, Benchmark, and Deploy State-of-the-Art Binarized Neural Networks T. Bannink Arash Bakhtiari Adam Hillier Lukas Geiger T. D. Bruin Leon Overweel J. Neeven K. Helwegen 3DV MQ 13 36 0 18 Nov 2020
Once Quantization-Aware Training: High Performance Extremely Low-bit Architecture Search Mingzhu Shen Feng Liang Ruihao Gong Yuhang Li Chuming Li Chen Lin F. Yu Junjie Yan Wanli Ouyang MQ 28 36 0 09 Oct 2020
Binary Neural Networks for Memory-Efficient and Effective Visual Place Recognition in Changing Environments Bruno Ferrarini Michael Milford Klaus D. McDonald-Maier Shoaib Ehsan MQ 25 22 0 01 Oct 2020
Review: Deep Learning in Electron Microscopy Jeffrey M. Ede 34 79 0 17 Sep 2020
S3NAS: Fast NPU-aware Neural Architecture Search Methodology Jaeseong Lee Duseok Kang S. Ha 35 10 0 04 Sep 2020
Searching Efficient 3D Architectures with Sparse Point-Voxel Convolution Haotian Tang Zhijian Liu Shengyu Zhao Yujun Lin Ji Lin Hanrui Wang Song Han 3DPC 39 631 0 31 Jul 2020
NSGANetV2: Evolutionary Multi-Objective Surrogate-Assisted Neural Architecture Search Zhichao Lu Kalyanmoy Deb E. Goodman W. Banzhaf Vishnu Naresh Boddeti 26 144 0 20 Jul 2020
MCUNet: Tiny Deep Learning on IoT Devices Ji Lin Wei-Ming Chen Yujun Lin J. Cohn Chuang Gan Song Han 59 475 0 20 Jul 2020
Sudo rm -rf: Efficient Networks for Universal Audio Source Separation Efthymios Tzinis Zhepei Wang Paris Smaragdis 30 127 0 14 Jul 2020
Cyclic Differentiable Architecture Search Hongyuan Yu Houwen Peng Yan Huang Jianlong Fu Hao Du Liang Wang Haibin Ling 3DPC 25 48 0 18 Jun 2020
On the Predictability of Pruning Across Scales Jonathan S. Rosenfeld Jonathan Frankle Michael Carbin Nir Shavit 14 37 0 18 Jun 2020
APQ: Joint Search for Network Architecture, Pruning and Quantization Policy Tianzhe Wang Kuan-Chieh Jackson Wang Han Cai Ji Lin Zhijian Liu Song Han MQ 39 174 0 15 Jun 2020
Are we done with ImageNet? Lucas Beyer Olivier J. Hénaff Alexander Kolesnikov Xiaohua Zhai Aaron van den Oord VLM 19 396 0 12 Jun 2020
Few-shot Neural Architecture Search Yiyang Zhao Linnan Wang Yuandong Tian Rodrigo Fonseca Tian Guo 23 90 0 11 Jun 2020
AMEIR: Automatic Behavior Modeling, Interaction Exploration and MLP Investigation in the Recommender System Pengyu Zhao Kecheng Xiao Yuanxing Zhang Kaigui Bian Wei Yan 21 16 0 10 Jun 2020
A Comprehensive Survey of Neural Architecture Search: Challenges and Solutions Pengzhen Ren Yun Xiao Xiaojun Chang Po-Yao (Bernie) Huang Zhihui Li Xiaojiang Chen Xin Wang AI4CE 48 653 0 01 Jun 2020
HourNAS: Extremely Fast Neural Architecture Search Through an Hourglass Lens Zhaohui Yang Yunhe Wang Xinghao Chen Jianyuan Guo Wei Zhang Chao Xu Chunjing Xu Dacheng Tao Chang Xu 34 17 0 29 May 2020
Joint Multi-Dimension Pruning via Numerical Gradient Update Zechun Liu Xinming Zhang Zhiqiang Shen Zhe Li Yichen Wei Kwang-Ting Cheng Jian Sun 47 18 0 18 May 2020
Angle-based Search Space Shrinking for Neural Architecture Search Yiming Hu Yuding Liang Zichao Guo Ruosi Wan Xinming Zhang Yichen Wei Qingyi Gu Jian Sun 24 62 0 28 Apr 2020
Computation on Sparse Neural Networks: an Inspiration for Future Hardware Fei Sun Minghai Qin Tianyun Zhang Liu Liu Yen-kuang Chen Yuan Xie 29 7 0 24 Apr 2020
ResNeSt: Split-Attention Networks Hang Zhang Chongruo Wu Zhongyue Zhang Yi Zhu Yanghua Peng ... Tong He Jonas W. Mueller R. Manmatha Mu Li Alex Smola 51 1,462 0 19 Apr 2020
Evolving Normalization-Activation Layers Hanxiao Liu Andrew Brock Karen Simonyan Quoc V. Le 12 79 0 06 Apr 2020
GAN Compression: Efficient Architectures for Interactive Conditional GANs Muyang Li Ji Lin Yaoyao Ding Zhijian Liu Jun-Yan Zhu Song Han GAN 22 2 0 19 Mar 2020