Speeding up Convolutional Neural Networks with Low Rank Expansions

15 May 2014

Andrea Vedaldi

Papers citing "Speeding up Convolutional Neural Networks with Low Rank Expansions"

50 / 236 papers shown

Title
Low-Rank Nonlinear Decoding of $μ$ -ECoG from the Primary Auditory Cortex M. Emami Mojtaba Sahraee Ardakan Parthe Pandit A. Fletcher S. Rangan M. Trumpis Brinnae Bent Chia-Han Chiang J. Viventi BDL 17 2 0 06 May 2020
PERMDNN: Efficient Compressed DNN Architecture with Permuted Diagonal Matrices Chunhua Deng Siyu Liao Yi Xie Keshab K. Parhi Xuehai Qian Bo Yuan 38 93 0 23 Apr 2020
Learning Low-rank Deep Neural Networks via Singular Vector Orthogonality Regularization and Singular Value Sparsification Huanrui Yang Minxue Tang W. Wen Feng Yan Daniel Hu Ang Li H. Li Yiran Chen 36 63 0 20 Apr 2020
Orthogonal Over-Parameterized Training Weiyang Liu Rongmei Lin Zhen Liu James M. Rehg Liam Paull Li Xiong Le Song Adrian Weller 32 41 0 09 Apr 2020
A Survey of Convolutional Neural Networks: Analysis, Applications, and Prospects Zewen Li Wenjie Yang Shouheng Peng Fan Liu HAI 3DV 54 2,600 0 01 Apr 2020
Binary Neural Networks: A Survey Haotong Qin Ruihao Gong Xianglong Liu Xiao Bai Jingkuan Song N. Sebe MQ 50 458 0 31 Mar 2020
Rethinking Depthwise Separable Convolutions: How Intra-Kernel Correlations Lead to Improved MobileNets D. Haase Manuel Amthor 20 132 0 30 Mar 2020
A Survey of Methods for Low-Power Deep Learning and Computer Vision Abhinav Goel Caleb Tung Yung-Hsiang Lu George K. Thiruvathukal VLM 15 92 0 24 Mar 2020
Group Sparsity: The Hinge Between Filter Pruning and Decomposition for Network Compression Yawei Li Shuhang Gu Christoph Mayer Luc Van Gool Radu Timofte 137 189 0 19 Mar 2020
MINT: Deep Network Compression via Mutual Information-based Neuron Trimming Madan Ravi Ganesh Jason J. Corso Salimeh Yasaei Sekeh MQ 43 15 0 18 Mar 2020
Learned Threshold Pruning K. Azarian Yash Bhalgat Jinwon Lee Tijmen Blankevoort MQ 28 38 0 28 Feb 2020
Communication-Efficient Edge AI: Algorithms and Systems Yuanming Shi Kai Yang Tao Jiang Jun Zhang Khaled B. Letaief GNN 29 326 0 22 Feb 2020
Learning Architectures for Binary Networks Dahyun Kim Kunal Pratap Singh Jonghyun Choi MQ 25 44 0 17 Feb 2020
Progressive Local Filter Pruning for Image Retrieval Acceleration Xiaodong Wang Zhedong Zheng Yang He Fei Yan Zhi-qiang Zeng Yi Yang 33 34 0 24 Jan 2020
Harmonic Convolutional Networks based on Discrete Cosine Transform Matej Ulicny V. Krylov Rozenn Dahyot 27 34 0 18 Jan 2020
Least squares binary quantization of neural networks Hadi Pouransari Zhucheng Tu Oncel Tuzel MQ 17 32 0 09 Jan 2020
Resource-Efficient Neural Networks for Embedded Systems Wolfgang Roth Günther Schindler Lukas Pfeifenberger Robert Peharz Sebastian Tschiatschek Holger Fröning Franz Pernkopf Zoubin Ghahramani 34 47 0 07 Jan 2020
Convolutional Neural Networks with Intermediate Loss for 3D Super-Resolution of CT and MRI Scans Mariana-Iuliana Georgescu Radu Tudor Ionescu N. Verga SupR MedIm 22 46 0 05 Jan 2020
Discrimination-aware Network Pruning for Deep Model Compression Jing Liu Bohan Zhuang Zhuangwei Zhuang Yong Guo Junzhou Huang Jin-Hui Zhu Mingkui Tan CVBM 19 119 0 04 Jan 2020
Lossless Compression of Deep Neural Networks Thiago Serra Abhinav Kumar Srikumar Ramalingam 24 56 0 01 Jan 2020
Hiding Data in Images Using Cryptography and Deep Neural Network Kartik Sharma Ashutosh Aggarwal Tanay Singhania Deepak Gupta Ashish Khanna 20 111 0 22 Dec 2019
GhostNet: More Features from Cheap Operations Kai Han Yunhe Wang Qi Tian Jianyuan Guo Chunjing Xu Chang Xu 20 2,582 0 27 Nov 2019
Quantization Networks Jiwei Yang Xu Shen Jun Xing Xinmei Tian Houqiang Li Bing Deng Jianqiang Huang Xiansheng Hua MQ 36 339 0 21 Nov 2019
Decomposable-Net: Scalable Low-Rank Compression for Neural Networks A. Yaguchi Taiji Suzuki Shuhei Nitta Y. Sakata A. Tanizawa 19 9 0 29 Oct 2019
Depth-wise Decomposition for Accelerating Separable Convolutions in Efficient Convolutional Neural Networks Yihui He Jianing Qian Jianren Wang Cindy X. Le Congrui Hetang Qi Lyu Wenping Wang Tianwei Yue 48 11 0 21 Oct 2019
Model Compression with Two-stage Multi-teacher Knowledge Distillation for Web Question Answering System Ze Yang Linjun Shou Ming Gong Wutao Lin Daxin Jiang 20 92 0 18 Oct 2019
Model Pruning Enables Efficient Federated Learning on Edge Devices Yuang Jiang Shiqiang Wang Victor Valls Bongjun Ko Wei-Han Lee Kin K. Leung Leandros Tassiulas 38 445 0 26 Sep 2019
Constrained deep neural network architecture search for IoT devices accounting hardware calibration F. Scheidegger Luca Benini C. Bekas A. Malossi 3DV 29 15 0 24 Sep 2019
On the Effectiveness of Low-Rank Matrix Factorization for LSTM Model Compression Genta Indra Winata Andrea Madotto Jamin Shin Elham J. Barezi Pascale Fung 24 28 0 27 Aug 2019
Learning Filter Basis for Convolutional Neural Network Compression Yawei Li Shuhang Gu Luc Van Gool Radu Timofte SupR 17 5 0 23 Aug 2019
Deep Sparse Band Selection for Hyperspectral Face Recognition Fariborz Taherkhani J. Dawson Nasser M. Nasrabadi CVBM 20 11 0 15 Aug 2019
ACNet: Strengthening the Kernel Skeletons for Powerful CNN via Asymmetric Convolution Blocks Xiaohan Ding Yuchen Guo Guiguang Ding J. Han 31 661 0 11 Aug 2019
Similarity-Preserving Knowledge Distillation Frederick Tung Greg Mori 43 959 0 23 Jul 2019
ViP: Virtual Pooling for Accelerating CNN-based Image Classification and Object Detection Zhuo Chen Jiyuan Zhang Ruizhou Ding Diana Marculescu 13 12 0 19 Jun 2019
Effectiveness of Distillation Attack and Countermeasure on Neural Network Watermarking Ziqi Yang Hung Dang E. Chang AAML 27 34 0 14 Jun 2019
Parameterized Structured Pruning for Deep Neural Networks Günther Schindler Wolfgang Roth Franz Pernkopf Holger Froening 24 6 0 12 Jun 2019
BasisConv: A method for compressed representation and learning in CNNs M. Tayyab Abhijit Mahalanobis 3DPC SSL 21 6 0 11 Jun 2019
Butterfly Transform: An Efficient FFT Based Neural Architecture Design Keivan Alizadeh-Vahid Anish K. Prabhu Ali Farhadi Mohammad Rastegari 32 50 0 05 Jun 2019
Training CNNs with Selective Allocation of Channels Jongheon Jeong Jinwoo Shin CVBM 39 15 0 11 May 2019
Correlation Congruence for Knowledge Distillation Baoyun Peng Xiao Jin Jiaheng Liu Shunfeng Zhou Yichao Wu Yu Liu Dongsheng Li Zhaoning Zhang 63 507 0 03 Apr 2019
All You Need is a Few Shifts: Designing Efficient Convolutional Neural Networks for Image Classification Weijie Chen Di Xie Yuan Zhang Shiliang Pu 30 80 0 13 Mar 2019
Cascaded Projection: End-to-End Network Compression and Acceleration Breton L. Minnehan Andreas E. Savakis 18 26 0 12 Mar 2019
CircConv: A Structured Convolution with Low Complexity Siyu Liao Zhe Li Liang Zhao Qinru Qiu Yanzhi Wang Bo Yuan 19 18 0 28 Feb 2019
Spatially-Adaptive Filter Units for Compact and Efficient Deep Neural Networks Domen Tabernik Matej Kristan A. Leonardis 16 22 0 20 Feb 2019
Parameter Efficient Training of Deep Convolutional Neural Networks by Dynamic Sparse Reparameterization Hesham Mostafa Xin Wang 37 307 0 15 Feb 2019
CodedSketch: A Coding Scheme for Distributed Computation of Approximated Matrix Multiplication Tayyebeh Jahani-Nezhad M. Maddah-ali 19 41 0 26 Dec 2018
E-RNN: Design Optimization for Efficient Recurrent Neural Networks in FPGAs Zhe Li Caiwen Ding Siyue Wang Wujie Wen Youwei Zhuo ... Qinru Qiu Wenyao Xu X. Lin Xuehai Qian Yanzhi Wang MQ 12 64 0 12 Dec 2018
Reliable Identification of Redundant Kernels for Convolutional Neural Network Compression Wei Wang Liqiang Zhu CVBM 20 13 0 10 Dec 2018
Harmonic Networks: Integrating Spectral Information into CNNs Matej Ulicny V. Krylov Rozenn Dahyot 23 7 0 07 Dec 2018
Structured Pruning of Neural Networks with Budget-Aware Regularization Carl Lemaire Andrew Achkar Pierre-Marc Jodoin 27 92 0 23 Nov 2018