Slimmable Neural Networks

21 December 2018

Thomas Huang

Papers citing "Slimmable Neural Networks"

50 / 123 papers shown

Title
Efficient Split-Mix Federated Learning for On-Demand and In-Situ Customization Junyuan Hong Haotao Wang Zhangyang Wang Jiayu Zhou FedML 22 56 0 18 Mar 2022
Ensemble Knowledge Guided Sub-network Search and Fine-tuning for Filter Pruning Seunghyun Lee B. Song 21 8 0 05 Mar 2022
Pruning Networks with Cross-Layer Ranking & k-Reciprocal Nearest Filters Mingbao Lin Liujuan Cao Yuxin Zhang Ling Shao Chia-Wen Lin Rongrong Ji 35 51 0 15 Feb 2022
Borrowing from yourself: Faster future video segmentation with partial channel update Evann Courdier Franccois Fleuret 22 0 0 11 Feb 2022
Learning Features with Parameter-Free Layers Dongyoon Han Y. Yoo Beomyoung Kim Byeongho Heo 35 8 0 06 Feb 2022
Iterative Activation-based Structured Pruning Kaiqi Zhao Animesh Jain Ming Zhao 42 0 0 22 Jan 2022
GhostNets on Heterogeneous Devices via Cheap Operations Kai Han Yunhe Wang Chang Xu Jianyuan Guo Chunjing Xu Enhua Wu Qi Tian 19 102 0 10 Jan 2022
A Multi-channel Training Method Boost the Performance Yingdong Hu 19 1 0 27 Dec 2021
Compact Multi-level Sparse Neural Networks with Input Independent Dynamic Rerouting Minghai Qin Tianyun Zhang Fei Sun Yen-kuang Chen M. Fardad Yanzhi Wang Yuan Xie 49 0 0 21 Dec 2021
DISTREAL: Distributed Resource-Aware Learning in Heterogeneous Systems Martin Rapp R. Khalili Kilian Pfeiffer J. Henkel 19 18 0 16 Dec 2021
DPICT: Deep Progressive Image Compression Using Trit-Planes Jae-Han Lee S. Jeon K. Choi Youngo Park Chang-Su Kim 29 29 0 12 Dec 2021
On the Convergence of Shallow Neural Network Training with Randomly Masked Neurons Fangshuo Liao Anastasios Kyrillidis 46 16 0 05 Dec 2021
Communication and Energy Efficient Slimmable Federated Learning via Superposition Coding and Successive Decoding Hankyul Baek Won Joon Yun Soyi Jung Jihong Park Mingyue Ji Joongheon Kim M. Bennis 46 1 0 05 Dec 2021
Joint Superposition Coding and Training for Federated Learning over Multi-Width Neural Networks Hankyul Baek Won Joon Yun Yunseok Kwak Soyi Jung Mingyue Ji M. Bennis Jihong Park Joongheon Kim FedML 74 21 0 05 Dec 2021
Information Theoretic Representation Distillation Roy Miles Adrian Lopez-Rodriguez K. Mikolajczyk MQ 13 21 0 01 Dec 2021
Sharpness-aware Quantization for Deep Neural Networks Jing Liu Jianfei Cai Bohan Zhuang MQ 27 24 0 24 Nov 2021
Reconstructing Pruned Filters using Cheap Spatial Transformations Roy Miles K. Mikolajczyk 26 0 0 25 Oct 2021
Sub-bit Neural Networks: Learning to Compress and Accelerate Binary Neural Networks Yikai Wang Yi Yang Gang Hua Anbang Yao MQ 29 15 0 18 Oct 2021
ProgFed: Effective, Communication, and Computation Efficient Federated Learning by Progressive Training Hui-Po Wang Sebastian U. Stich Yang He Mario Fritz FedML AI4CE 36 46 0 11 Oct 2021
LCS: Learning Compressible Subspaces for Adaptive Network Compression at Inference Time Elvis Nunez Maxwell Horton Anish K. Prabhu Anurag Ranjan Ali Farhadi Mohammad Rastegari 29 4 0 08 Oct 2021
ABCP: Automatic Block-wise and Channel-wise Network Pruning via Joint Search Jiaqi Li Haoran Li Yaran Chen Zixiang Ding Nannan Li Mingjun Ma Zicheng Duan Dong Zhao 40 9 0 08 Oct 2021
Partial to Whole Knowledge Distillation: Progressive Distilling Decomposed Knowledge Boosts Student Better Xuanyang Zhang Xinming Zhang Jian Sun 25 1 0 26 Sep 2021
Prioritized Subnet Sampling for Resource-Adaptive Supernet Training Bohong Chen Mingbao Lin Rongrong Ji Liujuan Cao 29 2 0 12 Sep 2021
Group Fisher Pruning for Practical Network Compression Liyang Liu Shilong Zhang Zhanghui Kuang Aojun Zhou Jingliang Xue Xinjiang Wang Yimin Chen Wenming Yang Q. Liao Wayne Zhang 25 146 0 02 Aug 2021
Training Compact CNNs for Image Classification using Dynamic-coded Filter Fusion Mingbao Lin Bohong Chen Rongrong Ji Rongrong Ji VLM 33 23 0 14 Jul 2021
AutoFormer: Searching Transformers for Visual Recognition Minghao Chen Houwen Peng Jianlong Fu Haibin Ling ViT 36 259 0 01 Jul 2021
Collaborative Training of Acoustic Encoders for Speech Recognition Varun K. Nagaraja Yangyang Shi Ganesh Venkatesh Ozlem Kalinli M. Seltzer Vikas Chandra 43 11 0 16 Jun 2021
Scalable Transformers for Neural Machine Translation Peng Gao Shijie Geng Ping Luo Xiaogang Wang Jifeng Dai Hongsheng Li 31 13 0 04 Jun 2021
Towards Compact Single Image Super-Resolution via Contrastive Self-distillation Yanbo Wang Shaohui Lin Yanyun Qu Haiyan Wu Zhizhong Zhang Yuan Xie Angela Yao SupR 28 53 0 25 May 2021
MutualNet: Adaptive ConvNet via Mutual Learning from Different Model Configurations Taojiannan Yang Sijie Zhu Matías Mendieta Pu Wang Ravikumar Balakrishnan Minwoo Lee T. Han M. Shah Chong Chen 3DH OOD 28 23 0 14 May 2021
Dynamic-OFA: Runtime DNN Architecture Switching for Performance Scaling on Heterogeneous Embedded Platforms W. Lou Lei Xun Amin Sabet Jia Bi Jonathon S. Hare G. Merrett AI4CE 28 28 0 08 May 2021
Single-Training Collaborative Object Detectors Adaptive to Bandwidth and Computation Juliano S. Assine José Cândido Silveira Santos Filho Eduardo Valle ObjD 47 8 0 03 May 2021
CompOFA: Compound Once-For-All Networks for Faster Multi-Platform Deployment Manas Sahni S. Varshini Alind Khare Alexey Tumanov 23 31 0 26 Apr 2021
Slimmable Compressive Autoencoders for Practical Neural Image Compression Feiyu Yang Luis Herranz Yongmei Cheng M. Mozerov 31 65 0 29 Mar 2021
Enabling Design Methodologies and Future Trends for Edge AI: Specialization and Co-design Cong Hao Jordan Dotzel Jinjun Xiong Luca Benini Zhiru Zhang Deming Chen 58 34 0 25 Mar 2021
BossNAS: Exploring Hybrid CNN-transformers with Block-wisely Self-supervised Neural Architecture Search Changlin Li Tao Tang Guangrun Wang Jiefeng Peng Bing Wang Xiaodan Liang Xiaojun Chang ViT 48 105 0 23 Mar 2021
Revisiting Dynamic Convolution via Matrix Decomposition Yunsheng Li Yinpeng Chen Xiyang Dai Mengchen Liu Dongdong Chen Ye Yu Lu Yuan Zicheng Liu Mei Chen Nuno Vasconcelos 32 67 0 15 Mar 2021
Searching by Generating: Flexible and Efficient One-Shot NAS with Architecture Generator Sian-Yao Huang W. Chu 14 25 0 12 Mar 2021
Lost in Pruning: The Effects of Pruning Neural Networks beyond Test Accuracy Lucas Liebenwein Cenk Baykal Brandon Carter David K Gifford Daniela Rus AAML 40 71 0 04 Mar 2021
AlphaNet: Improved Training of Supernets with Alpha-Divergence Dilin Wang Chengyue Gong Meng Li Qiang Liu Vikas Chandra 155 44 0 16 Feb 2021
VA-RED $^2$ : Video Adaptive Redundancy Reduction Bowen Pan Yikang Shen Camilo Luciano Fosco Chung-Ching Lin A. Andonian Yue Meng Kate Saenko A. Oliva Rogerio Feris 15 19 0 15 Feb 2021
Learning Task-Oriented Communication for Edge Inference: An Information Bottleneck Approach Jiawei Shao Yuyi Mao Jun Zhang 47 212 0 08 Feb 2021
Pruning and Quantization for Deep Neural Network Acceleration: A Survey Tailin Liang C. Glossner Lei Wang Shaobo Shi Xiaotong Zhang MQ 150 675 0 24 Jan 2021
Bringing AI To Edge: From Deep Learning's Perspective Di Liu Hao Kong Xiangzhong Luo Weichen Liu Ravi Subramaniam 52 116 0 25 Nov 2020
MicroNet: Towards Image Recognition with Extremely Low FLOPs Yunsheng Li Yinpeng Chen Xiyang Dai Dongdong Chen Mengchen Liu Lu Yuan Zicheng Liu Lei Zhang Nuno Vasconcelos 30 25 0 24 Nov 2020
Dual-mode ASR: Unify and Improve Streaming ASR with Full-context Modeling Jiahui Yu Wei Han Anmol Gulati Chung-Cheng Chiu Bo-wen Li Tara N. Sainath Yonghui Wu Ruoming Pang 30 18 0 12 Oct 2020
Once Quantization-Aware Training: High Performance Extremely Low-bit Architecture Search Mingzhu Shen Feng Liang Ruihao Gong Yuhang Li Chuming Li Chen Lin F. Yu Junjie Yan Wanli Ouyang MQ 31 36 0 09 Oct 2020
Mix Dimension in Poincaré Geometry for 3D Skeleton-based Action Recognition Wei Peng Jingang Shi Zhaoqiang Xia Guoying Zhao GNN 26 60 0 30 Jul 2020
WeightNet: Revisiting the Design Space of Weight Networks Ningning Ma Xinming Zhang Jiawei Huang Jian Sun 16 106 0 23 Jul 2020
Joslim: Joint Widths and Weights Optimization for Slimmable Neural Networks Ting-Wu Chin Ari S. Morcos Diana Marculescu 26 10 0 23 Jul 2020