Survey: Exploiting Data Redundancy for Optimization of Deep Learning

29 August 2022

Papers citing "Survey: Exploiting Data Redundancy for Optimization of Deep Learning"

50 / 83 papers shown

Title
AntiDote: Attention-based Dynamic Optimization for Neural Network Runtime Efficiency Fuxun Yu Chenchen Liu Di Wang Yanzhi Wang Xiang Chen 21 7 0 14 Aug 2020
Data Movement Is All You Need: A Case Study on Optimizing Transformers A. Ivanov Nikoli Dryden Tal Ben-Nun Shigang Li Torsten Hoefler 91 134 0 30 Jun 2020
Funnel-Transformer: Filtering out Sequential Redundancy for Efficient Language Processing Zihang Dai Guokun Lai Yiming Yang Quoc V. Le 78 233 0 05 Jun 2020
A Feature-map Discriminant Perspective for Pruning Deep Neural Networks Zejiang Hou S. Kung 30 5 0 28 May 2020
Feature Statistics Guided Efficient Filter Pruning Hang Li Chen Ma Wenyuan Xu Xue Liu 35 34 0 21 May 2020
X3D: Expanding Architectures for Efficient Video Recognition Christoph Feichtenhofer 125 1,018 0 09 Apr 2020
Binary Neural Networks: A Survey Haotong Qin Ruihao Gong Xianglong Liu Xiao Bai Jingkuan Song N. Sebe MQ 103 466 0 31 Mar 2020
Acceleration of Convolutional Neural Network Using FFT-Based Split Convolutions Kamran Chitsaz M. Hajabdollahi N. Karimi S. Samavi S. Shirani 13 27 0 27 Mar 2020
What is the State of Neural Network Pruning? Davis W. Blalock Jose Javier Gonzalez Ortiz Jonathan Frankle John Guttag 255 1,047 0 06 Mar 2020
Compressing Large-Scale Transformer-Based Models: A Case Study on BERT Prakhar Ganesh Yao Chen Xin Lou Mohammad Ali Khan Yifan Yang Hassan Sajjad Preslav Nakov Deming Chen Marianne Winslett AI4CE 90 200 0 27 Feb 2020
Reformer: The Efficient Transformer Nikita Kitaev Lukasz Kaiser Anselm Levskaya VLM 181 2,307 0 13 Jan 2020
Deep Learning for 3D Point Clouds: A Survey Yulan Guo Hanyun Wang Qingyong Hu Hao Liu Li Liu Bennamoun 3DPC 75 1,666 0 27 Dec 2019
DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter Victor Sanh Lysandre Debut Julien Chaumond Thomas Wolf 208 7,481 0 02 Oct 2019
ALBERT: A Lite BERT for Self-supervised Learning of Language Representations Zhenzhong Lan Mingda Chen Sebastian Goodman Kevin Gimpel Piyush Sharma Radu Soricut SSL AIMat 334 6,441 0 26 Sep 2019
Multi-Agent Reinforcement Learning Based Frame Sampling for Effective Untrimmed Video Recognition Wenhao Wu Dongliang He Xiao Tan Shifeng Chen Shilei Wen 62 127 0 31 Jul 2019
XLNet: Generalized Autoregressive Pretraining for Language Understanding Zhilin Yang Zihang Dai Yiming Yang J. Carbonell Ruslan Salakhutdinov Quoc V. Le AI4CE 220 8,415 0 19 Jun 2019
ViP: Virtual Pooling for Accelerating CNN-based Image Classification and Object Detection Zhuo Chen Jiyuan Zhang Ruizhou Ding Diana Marculescu 23 12 0 19 Jun 2019
What Does BERT Look At? An Analysis of BERT's Attention Kevin Clark Urvashi Khandelwal Omer Levy Christopher D. Manning MILM 209 1,592 0 11 Jun 2019
Are Sixteen Heads Really Better than One? Paul Michel Omer Levy Graham Neubig MoE 100 1,060 0 25 May 2019
Analyzing Multi-Head Self-Attention: Specialized Heads Do the Heavy Lifting, the Rest Can Be Pruned Elena Voita David Talbot F. Moiseev Rico Sennrich Ivan Titov 106 1,134 0 23 May 2019
Drop an Octave: Reducing Spatial Redundancy in Convolutional Neural Networks with Octave Convolution Yunpeng Chen Haoqi Fan Bing Xu Zhicheng Yan Yannis Kalantidis Marcus Rohrbach Shuicheng Yan Jiashi Feng 98 558 0 10 Apr 2019
SCSampler: Sampling Salient Clips from Video for Efficient Action Recognition Bruno Korbar Du Tran Lorenzo Torresani 64 223 0 08 Apr 2019
Resource Efficient 3D Convolutional Neural Networks Okan Kopuklu Neslihan Köse Ahmet Gunduz Gerhard Rigoll 46 188 0 04 Apr 2019
Stateful Dataflow Multigraphs: A Data-Centric Model for Performance Portability on Heterogeneous Architectures Tal Ben-Nun Johannes de Fine Licht A. Ziogas Timo Schneider Torsten Hoefler 69 103 0 27 Feb 2019
AdaScale: Towards Real-time Video Object Detection Using Adaptive Scaling Ting-Wu Chin Ruizhou Ding Diana Marculescu 35 84 0 08 Feb 2019
A Comprehensive Survey on Graph Neural Networks Zonghan Wu Shirui Pan Fengwen Chen Guodong Long Chengqi Zhang Philip S. Yu FaML GNN AI4TS AI4CE 672 8,496 0 03 Jan 2019
What Is One Grain of Sand in the Desert? Analyzing Individual Neurons in Deep NLP Models Fahim Dalvi Nadir Durrani Hassan Sajjad Yonatan Belinkov A. Bau James R. Glass MILM 54 188 0 21 Dec 2018
A Layer Decomposition-Recomposition Framework for Neuron Pruning towards Accurate Lightweight Networks Weijie Chen Yuan Zhang Di Xie Shiliang Pu 37 13 0 17 Dec 2018
Exploiting Kernel Sparsity and Entropy for Interpretable CNN Compression Yuchao Li Shaohui Lin Baochang Zhang Jianzhuang Liu David Doermann Yongjian Wu Feiyue Huang Rongrong Ji 53 130 0 11 Dec 2018
Accelerating Convolutional Neural Networks via Activation Map Compression Georgios Georgiadis 63 73 0 10 Dec 2018
Accelerate CNN via Recursive Bayesian Pruning Yuefu Zhou Ya Zhang Yanfeng Wang Qi Tian BDL 40 58 0 02 Dec 2018
AdaFrame: Adaptive Frame Selection for Fast Video Recognition Zuxuan Wu Caiming Xiong Chih-Yao Ma R. Socher L. Davis 160 198 0 29 Nov 2018
Online Embedding Compression for Text Classification using Low Rank Matrix Factorization Anish Acharya Rahul Goel A. Metallinou Inderjit Dhillon 60 61 0 01 Nov 2018
Discrimination-aware Channel Pruning for Deep Neural Networks Zhuangwei Zhuang Mingkui Tan Bohan Zhuang Jing Liu Yong Guo Qingyao Wu Junzhou Huang Jin-Hui Zhu 107 598 0 28 Oct 2018
Morph: Flexible Acceleration for 3D CNN-based Video Understanding Kartik Hegde R. Agrawal Yulun Yao Christopher W. Fletcher 52 71 0 16 Oct 2018
Dynamic Channel Pruning: Feature Boosting and Suppression Xitong Gao Yiren Zhao Łukasz Dudziak Robert D. Mullins Chengzhong Xu 63 316 0 12 Oct 2018
CaTDet: Cascaded Tracked Detector for Efficient Object Detection from Video Huizi Mao Taeyoung Kong W. Dally VOT 49 23 0 30 Sep 2018
CBinfer: Exploiting Frame-to-Frame Locality for Faster Convolutional Network Inference on Video Streams Lukas Cavigelli Luca Benini 54 26 0 15 Aug 2018
A Survey on Methods and Theories of Quantized Neural Networks Yunhui Guo MQ 62 232 0 13 Aug 2018
UCNN: Exploiting Computational Reuse in Deep Neural Networks via Weight Repetition Kartik Hegde Jiyong Yu R. Agrawal Mengjia Yan Michael Pellauer Christopher W. Fletcher 39 164 0 18 Apr 2018
Towards High Performance Video Object Detection for Mobiles Xizhou Zhu Jifeng Dai Xingchi Zhu Yichen Wei Lu Yuan ObjD 39 49 0 16 Apr 2018
Optimizing Video Object Detection via a Scale-Time Lattice Kai-xiang Chen Jiaqi Wang Shuo Yang Xingcheng Zhang Yuanjun Xiong Chen Change Loy Dahua Lin ObjD 69 106 0 16 Apr 2018
Exploring Linear Relationship in Feature Map Subspace for ConvNets Compression Dong Wang Lei Zhou Xueni Zhang Xiao Bai Jun Zhou 53 47 0 15 Mar 2018
Generating Wikipedia by Summarizing Long Sequences Peter J. Liu Mohammad Saleh Etienne Pot Ben Goodrich Ryan Sepassi Lukasz Kaiser Noam M. Shazeer CVBM 174 797 0 30 Jan 2018
Towards High Performance Video Object Detection Xizhou Zhu Jifeng Dai Lu Yuan Yichen Wei ObjD 55 243 0 30 Nov 2017
A Closer Look at Spatiotemporal Convolutions for Action Recognition Du Tran Heng Wang Lorenzo Torresani Jamie Ray Yann LeCun Manohar Paluri 196 3,021 0 30 Nov 2017
Mobile Video Object Detection with Temporally-Aware Feature Maps Mason Liu Menglong Zhu ObjD 42 196 0 17 Nov 2017
Dynamic Zoom-in Network for Fast Object Detection in Large Images M. Gao Ruichi Yu Ang Li Vlad I. Morariu L. Davis ObjD 68 129 0 14 Nov 2017
Zoom Out-and-In Network with Map Attention Decision for Region Proposal and Object Detection Hongyang Li Yu Liu Wanli Ouyang Xiaogang Wang ObjD 39 80 0 13 Sep 2017
Kill Two Birds With One Stone: Boosting Both Object Detection Accuracy and Speed With adaptive Patch-of-Interest Composition Shihao Zhang Weiyao Lin Ping Lu Weihua Li Shuo Deng ObjD 35 12 0 12 Aug 2017