TDC: Towards Extremely Efficient CNNs on GPUs via Hardware-Aware Tucker Decomposition

7 November 2022

Lizhi Xiang

Miao Yin

Chengming Zhang

Aravind Sukumaran-Rajam

Dingwen Tao

Papers citing "TDC: Towards Extremely Efficient CNNs on GPUs via Hardware-Aware Tucker Decomposition"

30 / 30 papers shown

Title
Towards Efficient Tensor Decomposition-Based DNN Model Compression with Optimization Framework Miao Yin Yang Sui Siyu Liao Bo Yuan 42 79 0 26 Jul 2021
APNN-TC: Accelerating Arbitrary Precision Neural Networks on Ampere GPU Tensor Cores Boyuan Feng Yuke Wang Tong Geng Ang Li Yufei Ding MQ 37 37 0 23 Jun 2021
Towards Compact CNNs via Collaborative Compression Yuchao Li Shaohui Lin Jianzhuang Liu QiXiang Ye Mengdi Wang Chia-Wen Lin Fan Yang Jincheng Ma Qi Tian Rongrong Ji 3DV 49 88 0 24 May 2021
Towards Extremely Compact RNNs for Video Recognition with Fully Decomposed Hierarchical Tucker Structure Miao Yin Siyu Liao Xiao-Yang Liu Xiaodong Wang Bo Yuan AI4TS 40 31 0 12 Apr 2021
SCOP: Scientific Control for Reliable Neural Network Pruning Yehui Tang Yunhe Wang Yixing Xu Dacheng Tao Chunjing Xu Chao Xu Chang Xu AAML 72 167 0 21 Oct 2020
Stable Low-rank Tensor Decomposition for Compression of Convolutional Neural Network Anh-Huy Phan Konstantin Sobolev Konstantin Sozykin Dmitry Ermilov Julia Gusak P. Tichavský Valeriy Glukhov Ivan Oseledets A. Cichocki BDL 54 129 0 12 Aug 2020
TRP: Trained Rank Pruning for Efficient Deep Neural Networks Yuhui Xu Yuxi Li Shuai Zhang W. Wen Botao Wang Y. Qi Yiran Chen Weiyao Lin H. Xiong AAML 55 71 0 30 Apr 2020
DSA: More Efficient Budgeted Pruning via Differentiable Sparsity Allocation Xuefei Ning Tianchen Zhao Wenshuo Li Peng Lei Yu Wang Huazhong Yang 56 103 0 05 Apr 2020
HRank: Filter Pruning using High-Rank Feature Map Mingbao Lin Rongrong Ji Yan Wang Yichen Zhang Baochang Zhang Yonghong Tian Ling Shao 62 719 0 24 Feb 2020
RTMobile: Beyond Real-Time Mobile Acceleration of RNNs for Speech Recognition Peiyan Dong Siyue Wang Wei Niu Chengming Zhang Sheng Lin ... Yifan Gong Bin Ren Xinyu Lin Yanzhi Wang Dingwen Tao 35 45 0 19 Feb 2020
LightGCN: Simplifying and Powering Graph Convolution Network for Recommendation Xiangnan He Kuan Deng Xiang Wang Yan Li Yongdong Zhang Meng Wang GNN 146 3,586 0 06 Feb 2020
PyTorch: An Imperative Style, High-Performance Deep Learning Library Adam Paszke Sam Gross Francisco Massa Adam Lerer James Bradbury ... Sasank Chilamkurthy Benoit Steiner Lu Fang Junjie Bai Soumith Chintala ODL 310 42,038 0 03 Dec 2019
PCONV: The Missing but Desirable Sparsity in DNN Weight Pruning for Real-time Execution on Mobile Devices Xiaolong Ma Fu-Ming Guo Wei Niu Xue Lin Jian Tang Kaisheng Ma Bin Ren Yanzhi Wang CVBM 47 176 0 06 Sep 2019
DeepSZ: A Novel Framework to Compress Deep Neural Networks by Using Error-Bounded Lossy Compression Sian Jin Sheng Di Xin Liang Jiannan Tian Dingwen Tao Franck Cappello AI4CE 42 59 0 26 Jan 2019
Filter Pruning via Geometric Median for Deep Convolutional Neural Networks Acceleration Yang He Ping Liu Ziwei Wang Zhilan Hu Yi Yang AAML 3DPC 81 1,044 0 01 Nov 2018
Exascale Deep Learning for Climate Analytics Thorsten Kurth Sean Treichler Josh Romero M. Mudigonda Nathan Luehr ... Michael A. Matheson J. Deslippe M. Fatica P. Prabhat Michael Houston BDL 38 261 0 03 Oct 2018
CosmoFlow: Using Deep Learning to Learn the Universe at Scale Amrita Mathuriya Deborah Bard P. Mendygral Lawrence Meadows James A. Arnemann ... Nalini Kumar S. Ho Michael F. Ringenburg P. Prabhat Victor W. Lee AI4CE 35 125 0 14 Aug 2018
Wide Compression: Tensor Ring Nets Wenqi Wang Yifan Sun Brian Eriksson Wenlin Wang Vaneet Aggarwal 46 168 0 25 Feb 2018
Learning Transferable Architectures for Scalable Image Recognition Barret Zoph Vijay Vasudevan Jonathon Shlens Quoc V. Le 157 5,577 0 21 Jul 2017
Ultimate tensorization: compressing convolutional and FC layers alike T. Garipov D. Podoprikhin Alexander Novikov Dmitry Vetrov 58 190 0 10 Nov 2016
Densely Connected Convolutional Networks Gao Huang Zhuang Liu Laurens van der Maaten Kilian Q. Weinberger PINN 3DV 675 36,599 0 25 Aug 2016
Faster CNNs with Direct Sparse Convolutions and Guided Pruning Jongsoo Park Sheng Li W. Wen P. T. P. Tang Hai Helen Li Yiran Chen Pradeep Dubey 60 183 0 04 Aug 2016
Tensor Ring Decomposition Qibin Zhao Guoxu Zhou Shengli Xie Liqing Zhang A. Cichocki 42 358 0 17 Jun 2016
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 1.6K 192,638 0 10 Dec 2015
Compression of Deep Convolutional Neural Networks for Fast and Low Power Mobile Applications Yong-Deok Kim Eunhyeok Park S. Yoo Taelim Choi Lu Yang Dongjun Shin 77 893 0 20 Nov 2015
Tensorizing Neural Networks Alexander Novikov D. Podoprikhin A. Osokin Dmitry Vetrov 84 879 0 22 Sep 2015
Speeding-up Convolutional Neural Networks Using Fine-tuned CP-Decomposition V. Lebedev Yaroslav Ganin M. Rakhuba Ivan Oseledets Victor Lempitsky 49 882 0 19 Dec 2014
cuDNN: Efficient Primitives for Deep Learning Sharan Chetlur Cliff Woolley Philippe Vandermersch Jonathan M. Cohen J. Tran Bryan Catanzaro Evan Shelhamer 106 1,844 0 03 Oct 2014
Going Deeper with Convolutions Christian Szegedy Wei Liu Yangqing Jia P. Sermanet Scott E. Reed Dragomir Anguelov D. Erhan Vincent Vanhoucke Andrew Rabinovich 361 43,511 0 17 Sep 2014
Very Deep Convolutional Networks for Large-Scale Image Recognition Karen Simonyan Andrew Zisserman FAtt MDE 1.1K 99,991 0 04 Sep 2014