Universally Slimmable Networks and Improved Training Techniques

12 March 2019

Thomas Huang

Papers citing "Universally Slimmable Networks and Improved Training Techniques"

50 / 89 papers shown

Title
How to Train Your Metamorphic Deep Neural Network Thomas Sommariva Simone Calderara Angelo Porrello 30 0 0 07 May 2025
DPNet: Dynamic Pooling Network for Tiny Object Detection Luqi Gong Haotian Chen Yushen Chen Tianliang Yao Chao Li Shuai Zhao Guangjie Han ObjD 194 0 0 05 May 2025
Balcony: A Lightweight Approach to Dynamic Inference of Generative Language Models Benyamin Jamialahmadi Parsa Kavehzadeh Mehdi Rezagholizadeh Parsa Farinneya Hossein Rajabzadeh A. Jafari Boxing Chen Marzieh S. Tahaei 47 0 0 06 Mar 2025
DεpS: Delayed ε-Shrinking for Faster Once-For-All Training Aditya Annavajjala Alind Khare Animesh Agrawal Igor Fedorov Hugo Latapie Myungjin Lee Alexey Tumanov CLL 42 0 0 08 Jul 2024
AdaRevD: Adaptive Patch Exiting Reversible Decoder Pushes the Limit of Image Deblurring Xintian Mao Qingli Li Yan Wang 48 14 0 13 Jun 2024
NaviSlim: Adaptive Context-Aware Navigation and Sensing via Dynamic Slimmable Networks Timothy K Johnsen Marco Levorato 41 1 0 16 May 2024
Unsupervised Domain Adaptation Architecture Search with Self-Training for Land Cover Mapping Clifford Broni-Bediako Junshi Xia Naoto Yokoya AI4CE 34 3 0 23 Apr 2024
Adapting to Length Shift: FlexiLength Network for Trajectory Prediction Yi Tian Xu Yun Fu 44 11 0 31 Mar 2024
Adaptive Depth Networks with Skippable Sub-Paths Woochul Kang 36 1 0 27 Dec 2023
Cooperative Learning for Cost-Adaptive Inference Xingli Fang Richard M. Bradford Jung-Eun Kim 40 1 0 13 Dec 2023
Adaptive Early Exiting for Collaborative Inference over Noisy Wireless Channels Mikolaj Jankowski Deniz Gunduz K. Mikolajczyk 27 3 0 29 Nov 2023
Efficient Stitchable Task Adaptation Haoyu He Zizheng Pan Jing Liu Jianfei Cai Bohan Zhuang 34 3 0 29 Nov 2023
Straggler-resilient Federated Learning: Tackling Computation Heterogeneity with Layer-wise Partial Model Training in Mobile Edge Network Student Member Ieee Hongda Wu F. I. C. V. Ping Wang Aswartha Narayana FedML 52 1 0 16 Nov 2023
Continuous Levels of Detail for Light Field Networks David Li Brandon Yushan Feng Amitabh Varshney 37 1 0 20 Sep 2023
Maestro: Uncovering Low-Rank Structures via Trainable Decomposition Samuel Horváth Stefanos Laskaridis Shashank Rajput Hongyi Wang BDL 32 4 0 28 Aug 2023
Make A Long Image Short: Adaptive Token Length for Vision Transformers Yuqin Zhu Yichen Zhu ViT 72 17 0 05 Jul 2023
MBQuant: A Novel Multi-Branch Topology Method for Arbitrary Bit-width Network Quantization Mingliang Xu Yuyao Zhou Rongrong Ji Rongrong Ji MQ 34 1 0 14 May 2023
TIPS: Topologically Important Path Sampling for Anytime Neural Networks Guihong Li Kartikeya Bhardwaj Yuedong Yang R. Marculescu AAML 38 0 0 13 May 2023
Cuttlefish: Low-Rank Model Training without All the Tuning Hongyi Wang Saurabh Agarwal Pongsakorn U-chupala Yoshiki Tanaka Eric P. Xing Dimitris Papailiopoulos OffRL 58 22 0 04 May 2023
Small-footprint slimmable networks for keyword spotting Zuhaib Akhtar Mohammad Omar Khursheed Dongsu Du Yuzong Liu 30 2 0 21 Apr 2023
Efficient Transformer-based 3D Object Detection with Dynamic Token Halting Mao Ye Gregory P. Meyer Yuning Chai Qiang Liu 32 8 0 09 Mar 2023
Jaccard Metric Losses: Optimizing the Jaccard Index with Soft Labels Zifu Wang Xuefei Ning Matthew B. Blaschko VLM 35 12 0 11 Feb 2023
EVC: Towards Real-Time Neural Image Compression with Mask Decay G. Wang Jiahao Li Bin Li Yan Lu 22 63 0 10 Feb 2023
Rethinking Vision Transformers for MobileNet Size and Speed Yanyu Li Ju Hu Yang Wen Georgios Evangelidis Kamyar Salahi Yanzhi Wang Sergey Tulyakov Jian Ren ViT 35 159 0 15 Dec 2022
DeepSpeed Data Efficiency: Improving Deep Learning Model Quality and Training Efficiency via Efficient Data Sampling and Routing Conglong Li Z. Yao Xiaoxia Wu Minjia Zhang Connor Holmes Cheng Li Yuxiong He 27 24 0 07 Dec 2022
HEAT: Hardware-Efficient Automatic Tensor Decomposition for Transformer Compression Jiaqi Gu Ben Keller Jean Kossaifi Anima Anandkumar Brucek Khailany David Z. Pan ViT 35 8 0 30 Nov 2022
SteppingNet: A Stepping Neural Network with Incremental Accuracy Enhancement Wenhao Sun Grace Li Zhang Xunzhao Yin Cheng Zhuo Huaxi Gu Bing Li Ulf Schlichtmann 17 2 0 27 Nov 2022
Random-LTD: Random and Layerwise Token Dropping Brings Efficient Training for Large-scale Transformers Z. Yao Xiaoxia Wu Conglong Li Connor Holmes Minjia Zhang Cheng-rong Li Yuxiong He 28 11 0 17 Nov 2022
Stimulative Training of Residual Networks: A Social Psychology Perspective of Loafing Peng Ye Shengji Tang Baopu Li Tao Chen Wanli Ouyang 31 13 0 09 Oct 2022
DFA: Dynamic Feature Aggregation for Efficient Video Object Detection Yiming Cui 37 8 0 02 Oct 2022
Slimmable Networks for Contrastive Self-supervised Learning Shuai Zhao Xiaohan Wang Linchao Zhu Yi Yang 35 1 0 30 Sep 2022
PIM-QAT: Neural Network Quantization for Processing-In-Memory (PIM) Systems Qing Jin Zhiyu Chen J. Ren Yanyu Li Yanzhi Wang Kai-Min Yang MQ 18 2 0 18 Sep 2022
Design Automation for Fast, Lightweight, and Effective Deep Learning Models: A Survey Dalin Zhang Kaixuan Chen Yan Zhao B. Yang Li-Ping Yao Christian S. Jensen 48 3 0 22 Aug 2022
Streamable Neural Fields Junwoo Cho Seungtae Nam Daniel Rho J. Ko Eunbyung Park AI4TS 30 17 0 20 Jul 2022
DRESS: Dynamic REal-time Sparse Subnets Zhongnan Qu Syed Shakib Sarwar Xin Dong Yuecheng Li Huseyin Ekin Sumbul B. D. Salvo 3DH 18 1 0 01 Jul 2022
Slimmable Domain Adaptation Rang Meng Weijie Chen Shicai Yang Mingli Song Luojun Lin Di Xie Shiliang Pu Xinchao Wang Mingli Song Yueting Zhuang 29 12 0 14 Jun 2022
Revisiting Random Channel Pruning for Neural Network Compression Yawei Li Kamil Adamczewski Wen Li Shuhang Gu Radu Timofte Luc Van Gool 32 84 0 11 May 2022
CD $^2$ -pFed: Cyclic Distillation-guided Channel Decoupling for Model Personalization in Federated Learning Yiqing Shen Yuyin Zhou Lequan Yu OOD 24 55 0 08 Apr 2022
Automated Progressive Learning for Efficient Training of Vision Transformers Changlin Li Bohan Zhuang Guangrun Wang Xiaodan Liang Xiaojun Chang Yi Yang 28 46 0 28 Mar 2022
SlimFL: Federated Learning with Superposition Coding over Slimmable Neural Networks Won Joon Yun Yunseok Kwak Hankyul Baek Soyi Jung Mingyue Ji M. Bennis Jihong Park Joongheon Kim 18 16 0 26 Mar 2022
Adaptive Patch Exiting for Scalable Single Image Super-Resolution Shizun Wang Ming Lu Kaixin Chen Xiaoqi Li Jiaming Liu Yandong Guo SupR 33 23 0 22 Mar 2022
ARM: Any-Time Super-Resolution Method Bohong Chen Mingbao Lin Kekai Sheng Mengdan Zhang Peixian Chen Ke Li Liujuan Cao Rongrong Ji SupR 28 31 0 21 Mar 2022
Ensemble Knowledge Guided Sub-network Search and Fine-tuning for Filter Pruning Seunghyun Lee B. Song 21 8 0 05 Mar 2022
Borrowing from yourself: Faster future video segmentation with partial channel update Evann Courdier Franccois Fleuret 22 0 0 11 Feb 2022
Enabling NAS with Automated Super-Network Generation J. P. Muñoz N. Lyalyushkin Yash Akhauri A. Senina Alexander Kozlov Nilesh Jain 30 17 0 20 Dec 2021
DPICT: Deep Progressive Image Compression Using Trit-Planes Jae-Han Lee S. Jeon K. Choi Youngo Park Chang-Su Kim 29 29 0 12 Dec 2021
Communication and Energy Efficient Slimmable Federated Learning via Superposition Coding and Successive Decoding Hankyul Baek Won Joon Yun Soyi Jung Jihong Park Mingyue Ji Joongheon Kim M. Bennis 46 1 0 05 Dec 2021
Joint Superposition Coding and Training for Federated Learning over Multi-Width Neural Networks Hankyul Baek Won Joon Yun Yunseok Kwak Soyi Jung Mingyue Ji M. Bennis Jihong Park Joongheon Kim FedML 74 21 0 05 Dec 2021
Information Theoretic Representation Distillation Roy Miles Adrian Lopez-Rodriguez K. Mikolajczyk MQ 13 21 0 01 Dec 2021
Searching for TrioNet: Combining Convolution with Local and Global Self-Attention Huaijin Pi Huiyu Wang Yingwei Li Zizhang Li Alan Yuille ViT 27 3 0 15 Nov 2021