Paying More Attention to Attention: Improving the Performance of Convolutional Neural Networks via Attention Transfer

12 December 2016

Papers citing "Paying More Attention to Attention: Improving the Performance of Convolutional Neural Networks via Attention Transfer"

50 / 1,157 papers shown

Title
ExpandNets: Linear Over-parameterization to Train Compact Convolutional Networks Shuxuan Guo J. Álvarez Mathieu Salzmann 21 77 0 26 Nov 2018
Structured Pruning for Efficient ConvNets via Incremental Regularization Huan Wang Qiming Zhang Yuehai Wang Haoji Hu 3DPC 40 45 0 20 Nov 2018
Multi-layer Pruning Framework for Compressing Single Shot MultiBox Detector Pravendra Singh Manikandan Ravikiran Neeraj Matiyali Vinay P. Namboodiri 25 21 0 20 Nov 2018
Factorized Distillation: Training Holistic Person Re-identification Model by Distilling an Ensemble of Partial ReID Models Pengyuan Ren Jianmin Li 25 9 0 20 Nov 2018
Learning without Memorizing Prithviraj Dhar Rajat Vikram Singh Kuan-Chuan Peng Ziyan Wu Rama Chellappa CLL 16 472 0 20 Nov 2018
Development of Real-time ADAS Object Detector for Deployment on CPU Alexander Kozlov D. Osokin ObjD 16 7 0 14 Nov 2018
Knowledge Transfer via Distillation of Activation Boundaries Formed by Hidden Neurons Byeongho Heo Minsik Lee Sangdoo Yun J. Choi 11 516 0 08 Nov 2018
Amalgamating Knowledge towards Comprehensive Classification Chengchao Shen L. Câlmâc Mingli Song Li Sun Xiuming Zhang MoMe 30 89 0 07 Nov 2018
Distilling with Performance Enhanced Students Jack Turner Elliot J. Crowley Valentin Radu José Cano Amos Storkey Michael F. P. O'Boyle 18 3 0 24 Oct 2018
Improving Fast Segmentation With Teacher-student Learning Jiafeng Xie Bing Shuai Jianfang Hu Jingyang Lin Weishi Zheng 36 95 0 19 Oct 2018
KTAN: Knowledge Transfer Adversarial Network Peiye Liu Wu Liu Huadong Ma Tao Mei Mingoo Seok GAN 36 28 0 18 Oct 2018
Deep Reinforcement Learning Yuxi Li VLM OffRL 28 144 0 15 Oct 2018
A Closer Look at Structured Pruning for Neural Network Compression Elliot J. Crowley Jack Turner Amos Storkey Michael F. P. O'Boyle 3DPC 29 31 0 10 Oct 2018
Multi-Label Image Classification via Knowledge Distillation from Weakly-Supervised Detection Yongcheng Liu Lu Sheng Jing Shao Junjie Yan Shiming Xiang Chunhong Pan WSOD VLM 21 114 0 16 Sep 2018
Network Recasting: A Universal Method for Network Architecture Transformation Joonsang Yu Sungbum Kang Kiyoung Choi 31 1 0 14 Sep 2018
Instance-based Deep Transfer Learning Tianyang Wang Jun Huan M. Zhu 31 40 0 08 Sep 2018
RDPD: Rich Data Helps Poor Data via Imitation linda Qiao Cao Xiao Trong Nghia Hoang Tengfei Ma Hongyan Li Jimeng Sun 9 7 0 06 Sep 2018
Attention-Guided Answer Distillation for Machine Reading Comprehension Minghao Hu Yuxing Peng Furu Wei Zhen Huang Dongsheng Li Nan Yang M. Zhou FaML 26 75 0 23 Aug 2018
Saliency for Fine-grained Object Recognition in Domains with Scarce Training Data Carola Figueroa Flores Abel Gonzalez-Garcia Joost van de Weijer Bogdan Raducanu 27 50 0 01 Aug 2018
CBAM: Convolutional Block Attention Module Sanghyun Woo Jongchan Park Joon-Young Lee In So Kweon 100 16,177 0 17 Jul 2018
Targeted Kernel Networks: Faster Convolutions with Attentive Regularization Kashyap Chitta 22 2 0 01 Jun 2018
A novel channel pruning method for deep neural network compression Yiming Hu Siyang Sun Jianquan Li Xingang Wang Qingyi Gu 17 67 0 29 May 2018
Learning what and where to attend Drew Linsley Dan Scheibler S. Eberhardt Thomas Serre 22 32 0 22 May 2018
Recurrent knowledge distillation S. Pintea Yue Liu Jan van Gemert ODL 19 2 0 18 May 2018
Knowledge Distillation with Adversarial Samples Supporting Decision Boundary Byeongho Heo Minsik Lee Sangdoo Yun J. Choi AAML 32 146 0 15 May 2018
Born Again Neural Networks Tommaso Furlanello Zachary Chase Lipton Michael Tschannen Laurent Itti Anima Anandkumar 36 1,024 0 12 May 2018
Fast and Accurate Tumor Segmentation of Histology Images using Persistent Homology and Deep Convolutional Features Talha Qaiser Yee Wah Tsang D. Taniyama Naoya Sakamoto Kazuaki Nakane David B. A. Epstein Nasir M. Rajpoot 12 176 0 09 May 2018
Boosting Self-Supervised Learning via Knowledge Transfer M. Noroozi Ananth Vinjimoor Paolo Favaro Hamed Pirsiavash SSL 224 292 0 01 May 2018
Network Transplanting Quanshi Zhang Yu Yang Ying Nian Wu Song-Chun Zhu OOD 14 5 0 26 Apr 2018
Better and Faster: Knowledge Transfer from Multiple Self-supervised Learning Tasks via Graph Distillation for Video Classification Chenrui Zhang Yuxin Peng SSL 31 56 0 26 Apr 2018
Training a Binary Weight Object Detector by Knowledge Transfer for Autonomous Driving Jiaolong Xu Peng Wang Hengzhang Yang Antonio M. López MQ 35 23 0 17 Apr 2018
Learn To Pay Attention Saumya Jetley Nicholas A. Lord Namhoon Lee Philip Torr 67 437 0 06 Apr 2018
Exploring Linear Relationship in Feature Map Subspace for ConvNets Compression Dong Wang Lei Zhou Xueni Zhang Xiao Bai Jun Zhou 18 47 0 15 Mar 2018
Knowledge Transfer with Jacobian Matching Suraj Srinivas François Fleuret 29 169 0 01 Mar 2018
Attention-Aware Generative Adversarial Networks (ATA-GANs) D. Kastaniotis Ioanna Ntinou Dimitrios Tsourounis G. Economou S. Fotopoulos GAN 28 32 0 25 Feb 2018
Paraphrasing Complex Network: Network Compression via Factor Transfer Jangho Kim Seonguk Park Nojun Kwak 18 543 0 14 Feb 2018
Recent Advances in Efficient Computation of Deep Convolutional Neural Networks Jian Cheng Peisong Wang Gang Li Qinghao Hu Hanqing Lu 32 3 0 03 Feb 2018
Deep Adversarial Attention Alignment for Unsupervised Domain Adaptation: the Benefit of Target Expectation Maximization Guoliang Kang Liang Zheng Yan Yan Yi Yang OOD 30 121 0 30 Jan 2018
Multi-Level Recurrent Residual Networks for Action Recognition Zhenxing Zheng Gaoyun An Q. Ruan 8 12 0 22 Nov 2017
Apprentice: Using Knowledge Distillation Techniques To Improve Low-Precision Network Accuracy Asit K. Mishra Debbie Marr FedML 38 330 0 15 Nov 2017
Saliency-based Sequential Image Attention with Multiset Prediction Sean Welleck Jialin Mao Kyunghyun Cho Zheng-Wei Zhang 31 23 0 14 Nov 2017
Moonshine: Distilling with Cheap Convolutions Elliot J. Crowley Gavia Gray Amos Storkey 30 120 0 07 Nov 2017
Towards Effective Low-bitwidth Convolutional Neural Networks Bohan Zhuang Chunhua Shen Mingkui Tan Lingqiao Liu Ian Reid MQ 33 231 0 01 Nov 2017
Grad-CAM++: Improved Visual Explanations for Deep Convolutional Networks Aditya Chattopadhyay Anirban Sarkar Prantik Howlader V. Balasubramanian FAtt 33 2,256 0 30 Oct 2017
A Survey of Model Compression and Acceleration for Deep Neural Networks Yu Cheng Duo Wang Pan Zhou Zhang Tao 40 1,087 0 23 Oct 2017
RADNET: Radiologist Level Accuracy using Deep Learning for HEMORRHAGE detection in CT Scans Monika Grewal Muktabh Mayank Srivastava Pulkit Kumar Srikrishna Varadarajan MedIm 16 195 0 13 Oct 2017
Fast Fine-grained Image Classification via Weakly Supervised Discriminative Localization Xiangteng He Yuxin Peng Junjie Zhao WSOL 34 63 0 30 Sep 2017
HydraPlus-Net: Attentive Deep Features for Pedestrian Analysis Xihui Liu Haiyu Zhao Maoqing Tian Lu Sheng Jing Shao Shuai Yi Junjie Yan Xiaogang Wang 27 511 0 28 Sep 2017
Training Shallow and Thin Networks for Acceleration via Knowledge Distillation with Conditional Adversarial Networks Zheng Xu Yen-Chang Hsu Jiawei Huang GAN 35 12 0 02 Sep 2017
Rocket Launching: A Universal and Efficient Framework for Training Well-performing Light Net Guorui Zhou Ying Fan Runpeng Cui Weijie Bian Xiaoqiang Zhu Kun Gai 26 115 0 14 Aug 2017