Paying More Attention to Attention: Improving the Performance of Convolutional Neural Networks via Attention Transfer

12 December 2016

Papers citing "Paying More Attention to Attention: Improving the Performance of Convolutional Neural Networks via Attention Transfer"

50 / 1,157 papers shown

Title
End-to-End Interactive Prediction and Planning with Optical Flow Distillation for Autonomous Driving Hengli Wang Peide Cai Rui Fan Yuxiang Sun Ming Liu 40 23 0 18 Apr 2021
Learning Interpretable End-to-End Vision-Based Motion Planning for Autonomous Driving with Optical Flow Distillation Hengli Wang Peide Cai Yuxiang Sun Lujia Wang Ming Liu 26 46 0 18 Apr 2021
TEACHTEXT: CrossModal Generalized Distillation for Text-Video Retrieval Ioana Croitoru Simion-Vlad Bogolin Marius Leordeanu Hailin Jin Andrew Zisserman Samuel Albanie Yang Liu VGen 21 124 0 16 Apr 2021
Thief, Beware of What Get You There: Towards Understanding Model Extraction Attack Xinyi Zhang Chengfang Fang Jie Shi MIACV MLAU SILM 48 15 0 13 Apr 2021
Data-Free Knowledge Distillation with Soft Targeted Transfer Set Synthesis Zehao Wang 31 30 0 10 Apr 2021
Learning from 2D: Contrastive Pixel-to-Point Knowledge Transfer for 3D Pretraining Yueh-Cheng Liu Yu-Kai Huang HungYueh Chiang Hung-Ting Su Zhe-Yu Liu Chin-Tang Chen Ching-Yu Tseng Winston H. Hsu 3DPC 25 35 0 10 Apr 2021
MRI-based Alzheimer's disease prediction via distilling the knowledge in multi-modal data Hao Guan Chaoyue Wang Dacheng Tao 24 30 0 08 Apr 2021
Distilling and Transferring Knowledge via cGAN-generated Samples for Image Classification and Regression Xin Ding Z. J. Wang Zuheng Xu Z. Jane Wang William J. Welch 41 22 0 07 Apr 2021
Weakly supervised segmentation with cross-modality equivariant constraints Gaurav Patel Jose Dolz SSL 40 47 0 06 Apr 2021
Content-Aware GAN Compression Yuchen Liu Zhixin Shu Yijun Li Zhe Lin Federico Perazzi S. Kung GAN 37 58 0 06 Apr 2021
Compressing Visual-linguistic Model via Knowledge Distillation Zhiyuan Fang Jianfeng Wang Xiaowei Hu Lijuan Wang Yezhou Yang Zicheng Liu VLM 39 97 0 05 Apr 2021
Attention Forcing for Machine Translation Qingyun Dou Yiting Lu Potsawee Manakul Xixin Wu Mark Gales 31 7 0 02 Apr 2021
HVPR: Hybrid Voxel-Point Representation for Single-stage 3D Object Detection Jongyoun Noh Sanghoon Lee Bumsub Ham 3DPC 36 127 0 02 Apr 2021
DF^2AM: Dual-level Feature Fusion and Affinity Modeling for RGB-Infrared Cross-modality Person Re-identification Junhui Yin Zhanyu Ma Jiyang Xie Shibo Nie Kongming Liang Jun Guo 31 2 0 01 Apr 2021
Knowledge Distillation By Sparse Representation Matching D. Tran Moncef Gabbouj Alexandros Iosifidis 29 0 0 31 Mar 2021
Fixing the Teacher-Student Knowledge Discrepancy in Distillation Jiangfan Han Mengya Gao Yujie Wang Quanquan Li Hongsheng Li Xiaogang Wang 17 3 0 31 Mar 2021
Attention, please! A survey of Neural Attention Models in Deep Learning Alana de Santana Correia Esther Luna Colombini HAI 28 175 0 31 Mar 2021
Lagrangian Objective Function Leads to Improved Unforeseen Attack Generalization in Adversarial Training Mohammad Azizmalayeri M. Rohban OOD 37 4 0 29 Mar 2021
Complementary Relation Contrastive Distillation Jinguo Zhu Shixiang Tang Dapeng Chen Shijie Yu Yakun Liu A. Yang M. Rong Xiaohua Wang 27 77 0 29 Mar 2021
Zero-shot Adversarial Quantization Yuang Liu Wei Zhang Jun Wang MQ 19 78 0 29 Mar 2021
Embedding Transfer with Label Relaxation for Improved Metric Learning Sungyeon Kim Dongwon Kim Minsu Cho Suha Kwak 32 32 0 27 Mar 2021
Deep Ensemble Collaborative Learning by using Knowledge-transfer Graph for Fine-grained Object Classification Naoki Okamoto Soma Minami Tsubasa Hirakawa Takayoshi Yamashita H. Fujiyoshi FedML 21 2 0 27 Mar 2021
Distilling Object Detectors via Decoupled Features Jianyuan Guo Kai Han Yunhe Wang Han Wu Xinghao Chen Chunjing Xu Chang Xu 48 199 0 26 Mar 2021
Distilling a Powerful Student Model via Online Knowledge Distillation Shaojie Li Mingbao Lin Yan Wang Yongjian Wu Yonghong Tian Ling Shao Rongrong Ji FedML 27 47 0 26 Mar 2021
Hands-on Guidance for Distilling Object Detectors Yangyang Qin H. Ling Zhenghai He Yuxuan Shi Lei Wu ObjD FedML 11 1 0 26 Mar 2021
Learning Scene Structure Guidance via Cross-Task Knowledge Transfer for Single Depth Super-Resolution Baoli Sun Xinchen Ye Baopu Li Haojie Li Zhihui Wang Rui Xu 11 45 0 24 Mar 2021
Student Network Learning via Evolutionary Knowledge Distillation Kangkai Zhang Chunhui Zhang Shikun Li Dan Zeng Shiming Ge 24 83 0 23 Mar 2021
Compacting Deep Neural Networks for Internet of Things: Methods and Applications Ke Zhang Hanbo Ying Hongning Dai Lin Li Yuangyuang Peng Keyi Guo Hongfang Yu 23 38 0 20 Mar 2021
Interpretable Deep Learning: Interpretation, Interpretability, Trustworthiness, and Beyond Xuhong Li Haoyi Xiong Xingjian Li Xuanyu Wu Xiao Zhang Ji Liu Jiang Bian Dejing Dou AAML FaML XAI HAI 23 318 0 19 Mar 2021
Metric Learning for Anti-Compression Facial Forgery Detection Shenhao Cao Qin Zou Xiuqing Mao Zhongyuan Wang CVBM 10 24 0 15 Mar 2021
Refine Myself by Teaching Myself: Feature Refinement via Self-Knowledge Distillation Mingi Ji Seungjae Shin Seunghyun Hwang Gibeom Park Il-Chul Moon 13 120 0 15 Mar 2021
A New Training Framework for Deep Neural Network Zhenyan Hou Wenxuan Fan FedML 29 2 0 12 Mar 2021
Adaptive Multi-Teacher Multi-level Knowledge Distillation Yuang Liu Wei Zhang Jun Wang 28 157 0 06 Mar 2021
Improving Computational Efficiency in Visual Reinforcement Learning via Stored Embeddings Lili Chen Kimin Lee A. Srinivas Pieter Abbeel OffRL 24 11 0 04 Mar 2021
Self-Distribution Binary Neural Networks Ping Xue Yang Lu Jingfei Chang Xing Wei Zhen Wei MQ 21 10 0 03 Mar 2021
Adaptive Consistency Regularization for Semi-Supervised Transfer Learning Abulikemu Abuduweili Xingjian Li Humphrey Shi Chengzhong Xu Dejing Dou 43 77 0 03 Mar 2021
Network Pruning via Resource Reallocation Yuenan Hou Zheng Ma Chunxiao Liu Zhe Wang Chen Change Loy 6 19 0 02 Mar 2021
Improved Techniques for Quantizing Deep Networks with Adaptive Bit-Widths Ximeng Sun Yikang Shen Chun-Fu Chen Naigang Wang Bowen Pan Bowen Pan Kailash Gopalakrishnan A. Oliva Rogerio Feris Kate Saenko MQ 27 4 0 02 Mar 2021
DeepReDuce: ReLU Reduction for Fast Private Inference N. Jha Zahra Ghodsi S. Garg Brandon Reagen 47 90 0 02 Mar 2021
There is More than Meets the Eye: Self-Supervised Multi-Object Detection and Tracking with Sound by Distilling Multimodal Knowledge Francisco Rivera Valverde Juana Valeria Hurtado Abhinav Valada 28 72 0 01 Mar 2021
Listening to the city, attentively: A Spatio-Temporal Attention Boosted Autoencoder for the Short-Term Flow Prediction Problem Stefano Fiorini Michele Ciavotta A. Maurino 6 9 0 01 Mar 2021
Embedded Knowledge Distillation in Depth-Level Dynamic Neural Network Qi Zhao Shuchang Lyu Zhiwei Zhang Ting-Bing Xu Guangliang Cheng 21 2 0 01 Mar 2021
Distilling Knowledge via Intermediate Classifiers Aryan Asadian Amirali Salehi-Abari 38 1 0 28 Feb 2021
PURSUhInT: In Search of Informative Hint Points Based on Layer Clustering for Knowledge Distillation Reyhan Kevser Keser Aydin Ayanzadeh O. A. Aghdam Çaglar Kilcioglu B. U. Toreyin N. K. Üre 29 6 0 26 Feb 2021
DRIBO: Robust Deep Reinforcement Learning via Multi-View Information Bottleneck Jiameng Fan Wenchao Li OffRL 16 39 0 26 Feb 2021
Even your Teacher Needs Guidance: Ground-Truth Targets Dampen Regularization Imposed by Self-Distillation Kenneth Borup L. Andersen 30 14 0 25 Feb 2021
Localization Distillation for Dense Object Detection Zhaohui Zheng Rongguang Ye Ping Wang Dongwei Ren W. Zuo Qibin Hou Ming-Ming Cheng ObjD 104 115 0 24 Feb 2021
Enhancing Data-Free Adversarial Distillation with Activation Regularization and Virtual Interpolation Xiaoyang Qu Jianzong Wang Jing Xiao 18 14 0 23 Feb 2021
Classification of Breast Cancer Lesions in Ultrasound Images by using Attention Layer and loss Ensembles in Deep Convolutional Neural Networks E. Y. Kalafi Ata Jodeiri S. Setarehdan Ng Wei Lin Kartini Binti Rahman N. Taib S. K. Dhillon 24 37 0 23 Feb 2021
Exploring Knowledge Distillation of a Deep Neural Network for Multi-Script identification Shuvayan Ghosh Dastidar Kalpita Dutta N. Das M. Kundu M. Nasipuri 14 6 0 20 Feb 2021