Speeding up Convolutional Neural Networks with Low Rank Expansions

15 May 2014

Andrea Vedaldi

Papers citing "Speeding up Convolutional Neural Networks with Low Rank Expansions"

50 / 236 papers shown

Title
Data-Efficient Structured Pruning via Submodular Optimization Marwa El Halabi Suraj Srinivas Simon Lacoste-Julien 20 18 0 09 Mar 2022
Update Compression for Deep Neural Networks on the Edge Bo Chen A. Bakhshi Gustavo E. A. P. A. Batista Brian Ng Tat-Jun Chin 26 17 0 09 Mar 2022
The Combinatorial Brain Surgeon: Pruning Weights That Cancel One Another in Neural Networks Xin Yu Thiago Serra Srikumar Ramalingam Shandian Zhe 42 48 0 09 Mar 2022
Learn From the Past: Experience Ensemble Knowledge Distillation Chaofei Wang Shaowei Zhang S. Song Gao Huang 33 4 0 25 Feb 2022
HRel: Filter Pruning based on High Relevance between Activation Maps and Class Labels C. Sarvani Mrinmoy Ghorai S. Dubey S. H. Shabbeer Basha VLM 39 37 0 22 Feb 2022
GhostNets on Heterogeneous Devices via Cheap Operations Kai Han Yunhe Wang Chang Xu Jianyuan Guo Chunjing Xu Enhua Wu Qi Tian 19 102 0 10 Jan 2022
Mixed Precision Low-bit Quantization of Neural Network Language Models for Speech Recognition Junhao Xu Jianwei Yu Shoukang Hu Xunying Liu Helen Meng MQ 27 13 0 29 Nov 2021
Relational Self-Attention: What's Missing in Attention for Video Understanding Manjin Kim Heeseung Kwon Chunyu Wang Suha Kwak Minsu Cho ViT 27 28 0 02 Nov 2021
Blending Anti-Aliasing into Vision Transformer Shengju Qian Hao Shao Yi Zhu Mu Li Jiaya Jia 26 20 0 28 Oct 2021
The Efficiency Misnomer Daoyuan Chen Liuyi Yao Dawei Gao Ashish Vaswani Yaliang Li 34 99 0 25 Oct 2021
Reconstructing Pruned Filters using Cheap Spatial Transformations Roy Miles K. Mikolajczyk 26 0 0 25 Oct 2021
Class-Discriminative CNN Compression Yuchen Liu D. Wentzlaff S. Kung 26 1 0 21 Oct 2021
Adaptive Distillation: Aggregating Knowledge from Multiple Paths for Efficient Distillation Sumanth Chennupati Mohammad Mahdi Kamani Zhongwei Cheng Lin Chen 26 4 0 19 Oct 2021
Channel redundancy and overlap in convolutional neural networks with channel-wise NNK graphs David Bonet Antonio Ortega Javier Ruiz-Hidalgo Sarath Shekkizhar GNN 33 7 0 18 Oct 2021
BNAS v2: Learning Architectures for Binary Networks with Empirical Improvements Dahyun Kim Kunal Pratap Singh Jonghyun Choi MQ 46 7 0 16 Oct 2021
Semi-tensor Product-based TensorDecomposition for Neural Network Compression Hengling Zhao Yipeng Liu Xiaolin Huang Ce Zhu 47 6 0 30 Sep 2021
Architecture Aware Latency Constrained Sparse Neural Networks Tianli Zhao Qinghao Hu Xiangyu He Weixiang Xu Jiaxing Wang Cong Leng Jian Cheng 39 0 0 01 Sep 2021
NeuroCartography: Scalable Automatic Visual Summarization of Concepts in Deep Neural Networks Haekyu Park Nilaksh Das Rahul Duggal Austin P. Wright Omar Shaikh Fred Hohman Duen Horng Chau HAI 19 25 0 29 Aug 2021
Compact representations of convolutional neural networks via weight pruning and quantization Giosuè Cataldo Marinò A. Petrini D. Malchiodi Marco Frasca MQ 21 4 0 28 Aug 2021
Design and Scaffolded Training of an Efficient DNN Operator for Computer Vision on the Edge Vinod Ganesan Pratyush Kumar 42 2 0 25 Aug 2021
A Survey on GAN Acceleration Using Memory Compression Technique Dina Tantawy Mohamed Zahran A. Wassal 36 8 0 14 Aug 2021
Training Compact CNNs for Image Classification using Dynamic-coded Filter Fusion Mingbao Lin Bohong Chen Rongrong Ji Rongrong Ji VLM 33 23 0 14 Jul 2021
Trustworthy AI: A Computational Perspective Haochen Liu Yiqi Wang Wenqi Fan Xiaorui Liu Yaxin Li Shaili Jain Yunhao Liu Anil K. Jain Jiliang Tang FaML 104 196 0 12 Jul 2021
Tensor Methods in Computer Vision and Deep Learning Yannis Panagakis Jean Kossaifi Grigorios G. Chrysos James Oldfield M. Nicolaou Anima Anandkumar S. Zafeiriou 27 119 0 07 Jul 2021
Learning Gradual Argumentation Frameworks using Genetic Algorithms J. Spieler Nico Potyka Steffen Staab AI4CE 36 4 0 25 Jun 2021
Knowledge Distillation via Instance-level Sequence Learning Haoran Zhao Xin Sun Junyu Dong Zihe Dong Qiong Li 31 23 0 21 Jun 2021
Sparse Training via Boosting Pruning Plasticity with Neuroregeneration Shiwei Liu Tianlong Chen Xiaohan Chen Zahra Atashgahi Lu Yin Huanyu Kou Li Shen Mykola Pechenizkiy Zhangyang Wang Decebal Constantin Mocanu 40 111 0 19 Jun 2021
Content-Aware GAN Compression Yuchen Liu Zhixin Shu Yijun Li Zhe-nan Lin Federico Perazzi S. Kung GAN 35 58 0 06 Apr 2021
Compacting Deep Neural Networks for Internet of Things: Methods and Applications Ke Zhang Hanbo Ying Hongning Dai Lin Li Yuangyuang Peng Keyi Guo Hongfang Yu 21 38 0 20 Mar 2021
Toward Compact Deep Neural Networks via Energy-Aware Pruning Seul-Ki Yeom Kyung-Hwan Shim Jee-Hyun Hwang CVBM 28 12 0 19 Mar 2021
Involution: Inverting the Inherence of Convolution for Visual Recognition Duo Li Jie Hu Changhu Wang Xiangtai Li Qi She Lei Zhu Tong Zhang Qifeng Chen BDL 19 304 0 10 Mar 2021
BSQ: Exploring Bit-Level Sparsity for Mixed-Precision Neural Network Quantization Huanrui Yang Lin Duan Yiran Chen Hai Helen Li MQ 18 64 0 20 Feb 2021
CheXtransfer: Performance and Parameter Efficiency of ImageNet Models for Chest X-Ray Interpretation Alexander Ke William Ellsworth Oishi Banerjee A. Ng Pranav Rajpurkar MedIm 73 101 0 18 Jan 2021
Parallel Blockwise Knowledge Distillation for Deep Neural Network Compression Cody Blakeney Xiaomin Li Yan Yan Ziliang Zong 46 39 0 05 Dec 2020
SegBlocks: Block-Based Dynamic Resolution Networks for Real-Time Segmentation Thomas Verelst Tinne Tuytelaars SSeg 10 16 0 24 Nov 2020
Improving Neural Network Training in Low Dimensional Random Bases Frithjof Gressmann Zach Eaton-Rosen Carlo Luschi 30 28 0 09 Nov 2020
Depthwise Multiception Convolution for Reducing Network Parameters without Sacrificing Accuracy Guoqing Bao M. Graeber Xiuying Wang 13 5 0 07 Nov 2020
Low-Complexity Models for Acoustic Scene Classification Based on Receptive Field Regularization and Frequency Damping Khaled Koutini Florian Henkel Hamid Eghbalzadeh Gerhard Widmer 22 9 0 05 Nov 2020
Parameter Efficient Deep Neural Networks with Bilinear Projections Litao Yu Yongsheng Gao Jun Zhou Jian Zhang 21 1 0 03 Nov 2020
Permute, Quantize, and Fine-tune: Efficient Compression of Neural Networks Julieta Martinez Jashan Shewakramani Ting Liu Ioan Andrei Bârsan Wenyuan Zeng R. Urtasun MQ 23 30 0 29 Oct 2020
Block-term Tensor Neural Networks Jinmian Ye Guangxi Li Di Chen Haiqin Yang Shandian Zhe Zenglin Xu 24 30 0 10 Oct 2020
Review: Deep Learning in Electron Microscopy Jeffrey M. Ede 34 79 0 17 Sep 2020
ResNet-like Architecture with Low Hardware Requirements E. Limonova D. Alfonso D. Nikolaev V. Arlazarov 27 15 0 15 Sep 2020
High Throughput Matrix-Matrix Multiplication between Asymmetric Bit-Width Operands Dibakar Gope Jesse G. Beu Matthew Mattina 20 4 0 03 Aug 2020
Reparameterizing Convolutions for Incremental Multi-Task Learning without Task Interference Menelaos Kanakis David Brüggemann Suman Saha Stamatios Georgoulis Anton Obukhov Luc Van Gool CLL 30 72 0 24 Jul 2020
T-Basis: a Compact Representation for Neural Networks Anton Obukhov M. Rakhuba Stamatios Georgoulis Menelaos Kanakis Dengxin Dai Luc Van Gool 39 27 0 13 Jul 2020
Dynamic Group Convolution for Accelerating Convolutional Neural Networks Z. Su Linpu Fang Wenxiong Kang D. Hu M. Pietikäinen Li Liu 15 44 0 08 Jul 2020
Operation-Aware Soft Channel Pruning using Differentiable Masks Minsoo Kang Bohyung Han AAML 35 138 0 08 Jul 2020
Rethinking Bottleneck Structure for Efficient Mobile Network Design Zhou Daquan Qibin Hou Yunpeng Chen Jiashi Feng Shuicheng Yan 26 197 0 05 Jul 2020
An Overview of Neural Network Compression James OÑeill AI4CE 45 98 0 05 Jun 2020