Attention Mechanisms in Computer Vision: A Survey

15 November 2021

Ming-Ming Cheng

Papers citing "Attention Mechanisms in Computer Vision: A Survey"

50 / 158 papers shown

Title
Disentangled Non-Local Neural Networks Minghao Yin Zhuliang Yao Yue Cao Xiu Li Zheng Zhang Stephen Lin Han Hu 87 328 0 11 Jun 2020
Language Models are Few-Shot Learners Tom B. Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared Kaplan ... Christopher Berner Sam McCandlish Alec Radford Ilya Sutskever Dario Amodei BDL 500 41,106 0 28 May 2020
End-to-End Object Detection with Transformers Nicolas Carion Francisco Massa Gabriel Synnaeve Nicolas Usunier Alexander Kirillov Sergey Zagoruyko ViT 3DV PINN 299 12,906 0 26 May 2020
Exploring Self-attention for Image Recognition Hengshuang Zhao Jiaya Jia V. Koltun SSL 80 778 0 28 Apr 2020
ResNeSt: Split-Attention Networks Hang Zhang Chongruo Wu Zhongyue Zhang Yi Zhu Yanghua Peng ... Tong He Jonas W. Mueller R. Manmatha Mu Li Alex Smola 82 1,471 0 19 Apr 2020
MLCVNet: Multi-Level Context VoteNet for 3D Object Detection Qian Xie Yu-kun Lai Jing Wu Zhoutao Wang Yiming Zhang Kai Xu Jun Wang 3DPC 118 173 0 12 Apr 2020
Strip Pooling: Rethinking Spatial Pooling for Scene Parsing Qibin Hou Li Zhang Ming-Ming Cheng Jiashi Feng SSeg 3DPC 73 506 0 30 Mar 2020
Multi-Granularity Reference-Aided Attentive Feature Aggregation for Video-based Person Re-identification Zhizheng Zhang Cuiling Lan Wenjun Zeng Zhibo Chen VOS 44 100 0 27 Mar 2020
Spatial Pyramid Based Graph Reasoning for Semantic Segmentation Xia Li Yibo Yang Qijie Zhao Tiancheng Shen Zhouchen Lin Hong Liu SSeg GNN 123 161 0 23 Mar 2020
PointASNL: Robust Point Clouds Processing using Nonlocal Neural Networks with Adaptive Sampling Xu Yan Chaoda Zheng Zhuguo Li Sheng Wang Shuguang Cui 3DPC 81 549 0 01 Mar 2020
Dynamic Convolution: Attention over Convolution Kernels Yinpeng Chen Xiyang Dai Mengchen Liu Dongdong Chen Lu Yuan Zicheng Liu 66 886 0 07 Dec 2019
ECA-Net: Efficient Channel Attention for Deep Convolutional Neural Networks Qilong Wang Banggu Wu Peng Fei Zhu P. Li W. Zuo Q. Hu 127 3,957 0 08 Oct 2019
Gated Channel Transformation for Visual Recognition Zongxin Yang Linchao Zhu Yu Wu Yezhou Yang ViT 33 205 0 25 Sep 2019
Segmentation Transformer: Object-Contextual Representations for Semantic Segmentation Yuhui Yuan Xiaokang Chen Xilin Chen Jingdong Wang ViT 161 1,407 0 24 Sep 2019
Second-order Non-local Attention Networks for Person Re-identification Bryan (Ning) Xia Xia Yuan Gong Yizhe Zhang C. Poellabauer 3DPC 54 180 0 31 Aug 2019
VL-BERT: Pre-training of Generic Visual-Linguistic Representations Weijie Su Xizhou Zhu Yue Cao Bin Li Lewei Lu Furu Wei Jifeng Dai VLM MLLM SSL 124 1,657 0 22 Aug 2019
Asymmetric Non-local Neural Networks for Semantic Segmentation Zhen Zhu Mengde Xu S. Bai Tengteng Huang X. Bai 153 608 0 21 Aug 2019
Mixed High-Order Attention Network for Person Re-Identification Binghui Chen Weihong Deng Jiani Hu CVBM 52 355 0 16 Aug 2019
ABD-Net: Attentive but Diverse Person Re-Identification Tianlong Chen Shaojin Ding Jingyi Xie Ye Yuan Wuyang Chen Yang Zhou Ren Zhangyang Wang 73 479 0 03 Aug 2019
L2G Auto-encoder: Understanding Point Clouds by Local-to-Global Reconstruction with Hierarchical Self-Attention Xinhai Liu Zhizhong Han Xin Wen Yu-Shen Liu Matthias Zwicker 3DPC 91 86 0 02 Aug 2019
Expectation-Maximization Attention Networks for Semantic Segmentation Xia Li Zhisheng Zhong Jianlong Wu Yibo Yang Zhouchen Lin Hong Liu 3DV 3DPC 94 555 0 31 Jul 2019
XLNet: Generalized Autoregressive Pretraining for Language Understanding Zhilin Yang Zihang Dai Yiming Yang J. Carbonell Ruslan Salakhutdinov Quoc V. Le AI4CE 183 8,386 0 19 Jun 2019
Stand-Alone Self-Attention in Vision Models Prajit Ramachandran Niki Parmar Ashish Vaswani Irwan Bello Anselm Levskaya Jonathon Shlens VLM SLR ViT 68 1,208 0 13 Jun 2019
LatentGNN: Learning Efficient Non-local Relations for Visual Recognition Songyang Zhang Shipeng Yan Xuming He GNN 66 81 0 28 May 2019
GCNet: Non-local Networks Meet Squeeze-Excitation Networks and Beyond Yue Cao Jiarui Xu Stephen Lin Fangyun Wei Han Hu ISeg 68 1,561 0 25 Apr 2019
Local Relation Networks for Image Recognition Han Hu Zheng Zhang Zhenda Xie Stephen Lin FAtt 61 499 0 25 Apr 2019
Attention Augmented Convolutional Networks Irwan Bello Barret Zoph Ashish Vaswani Jonathon Shlens Quoc V. Le 123 1,008 0 22 Apr 2019
An Empirical Study of Spatial Attention Mechanisms in Deep Networks Xizhou Zhu Dazhi Cheng Zheng Zhang Stephen Lin Jifeng Dai 69 409 0 11 Apr 2019
CondConv: Conditionally Parameterized Convolutions for Efficient Inference Brandon Yang Gabriel Bender Quoc V. Le Jiquan Ngiam MedIm 3DV 52 628 0 10 Apr 2019
Modeling Point Clouds with Self-Attention and Gumbel Subset Sampling Jiancheng Yang Qiang Zhang Bingbing Ni Linguo Li Jinxian Liu Mengdie Zhou Qi Tian 3DPC 64 379 0 06 Apr 2019
Relation-Aware Global Attention for Person Re-identification Zhizheng Zhang Cuiling Lan Wenjun Zeng Xin Jin Zhibo Chen 3DPC 67 476 0 05 Apr 2019
An Attentive Survey of Attention Models S. Chaudhari Varun Mithal Gungor Polatkan R. Ramanath 114 649 0 05 Apr 2019
SRM : A Style-based Recalibration Module for Convolutional Neural Networks HyunJae Lee Hyo-Eun Kim Hyeonseob Nam 25 222 0 26 Mar 2019
Selective Kernel Networks Xiang Li Wenhai Wang Xiaolin Hu Jian Yang 70 2,015 0 15 Mar 2019
Looking for the Devil in the Details: Learning Trilinear Attention Sampling Network for Fine-grained Image Recognition Heliang Zheng Jianlong Fu Zhengjun Zha Jiebo Luo 57 383 0 14 Mar 2019
Transformer-XL: Attentive Language Models Beyond a Fixed-Length Context Zihang Dai Zhilin Yang Yiming Yang J. Carbonell Quoc V. Le Ruslan Salakhutdinov VLM 140 3,714 0 09 Jan 2019
Hierarchical LSTMs with Adaptive Attention for Visual Captioning Jingkuan Song Xiangpeng Li Lianli Gao Heng Tao Shen 46 221 0 26 Dec 2018
Graph-Based Global Reasoning Networks Yunpeng Chen Marcus Rohrbach Zhicheng Yan Shuicheng Yan Jiashi Feng Yannis Kalantidis GNN NAI 291 457 0 30 Nov 2018
Global Second-order Pooling Convolutional Networks Zilin Gao Jiangtao Xie Qilong Wang P. Li 49 332 0 29 Nov 2018
CCNet: Criss-Cross Attention for Semantic Segmentation Zilong Huang Xinggang Wang Yunchao Wei Lichao Huang Humphrey Shi Wenyu Liu Chang Huang VOS 131 2,531 0 28 Nov 2018
You Look Twice: GaterNet for Dynamic Filter Selection in CNNs Zhourong Chen Yang Li Samy Bengio Si Si 59 98 0 27 Nov 2018
Deformable ConvNets v2: More Deformable, Better Results Xizhou Zhu Han Hu Stephen Lin Jifeng Dai ObjD 83 1,998 0 27 Nov 2018
STA: Spatial-Temporal Attention for Large-Scale Video-based Person Re-Identification Yang Fu Xiaoyang Wang Yunchao Wei Thomas Huang AI4TS 44 203 0 09 Nov 2018
Compact Generalized Non-local Network Kaiyu Yue Ming Sun Yuchen Yuan Feng Zhou Errui Ding Fuxin Xu 29 161 0 31 Oct 2018
Gather-Excite: Exploiting Feature Context in Convolutional Neural Networks Jie Hu Li Shen Samuel Albanie Gang Sun Andrea Vedaldi 61 573 0 29 Oct 2018
$A^2$ -Nets: Double Attention Networks Yunpeng Chen Yannis Kalantidis Jianshu Li Shuicheng Yan Jiashi Feng 59 532 0 27 Oct 2018
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 966 93,936 0 11 Oct 2018
Set Transformer: A Framework for Attention-based Permutation-Invariant Neural Networks Juho Lee Yoonho Lee Jungtaek Kim Adam R. Kosiorek Seungjin Choi Yee Whye Teh 65 274 0 01 Oct 2018
Interpretable Spatio-temporal Attention for Video Action Recognition Lili Meng Bo Zhao B. Chang Gao Huang Wei Sun Fred Tung Leonid Sigal 55 83 0 01 Oct 2018
Dual Attention Network for Scene Segmentation J. Fu Qingbin Liu Haijie Tian Yong Li Yongjun Bao Zhiwei Fang Hanqing Lu SSeg 255 5,079 0 09 Sep 2018