Stand-Alone Self-Attention in Vision Models

13 June 2019

Papers citing "Stand-Alone Self-Attention in Vision Models"

38 / 588 papers shown

Title
A Trainable Optimal Transport Embedding for Feature Aggregation and its Relationship to Attention Grégoire Mialon Dexiong Chen Alexandre d’Aspremont Julien Mairal OT 44 0 0 22 Jun 2020
Infinite attention: NNGP and NTK for deep attention networks Jiri Hron Yasaman Bahri Jascha Narain Sohl-Dickstein Roman Novak 60 116 0 18 Jun 2020
SE(3)-Transformers: 3D Roto-Translation Equivariant Attention Networks F. Fuchs Daniel E. Worrall Volker Fischer Max Welling 3DPC 174 699 0 18 Jun 2020
Explicitly Modeled Attention Maps for Image Classification Andong Tan D. Nguyen Maximilian Dax Matthias Nießner Thomas Brox 54 9 0 14 Jun 2020
The Lipschitz Constant of Self-Attention Hyunjik Kim George Papamakarios A. Mnih 92 146 0 08 Jun 2020
Visual Transformers: Token-based Image Representation and Processing for Computer Vision Bichen Wu Chenfeng Xu Xiaoliang Dai Alvin Wan Peizhao Zhang Zhicheng Yan Masayoshi Tomizuka Joseph E. Gonzalez Kurt Keutzer Peter Vajda ViT 105 564 0 05 Jun 2020
GMAT: Global Memory Augmentation for Transformers Ankit Gupta Jonathan Berant RALM 81 50 0 05 Jun 2020
Auto-decoding Graphs Sohil Shah V. Koltun GNN 57 4 0 04 Jun 2020
Normalized Attention Without Probability Cage Oliver Richter Roger Wattenhofer 91 21 0 19 May 2020
Toward Automated Classroom Observation: Multimodal Machine Learning to Estimate CLASS Positive Climate and Negative Climate Anand Ramakrishnan Brian Zylich Erin Ottmar Jennifer LoCasale-Crouch Jacob Whitehill 36 26 0 19 May 2020
Salient Object Detection Combining a Self-attention Module and a Feature Pyramid Network Guangyu Ren Tianhong Dai P. Barmpoutis Tania Stathaki 108 15 0 30 Apr 2020
Exploring Self-attention for Image Recognition Hengshuang Zhao Jiaya Jia V. Koltun SSL 100 790 0 28 Apr 2020
Experience Grounds Language Yonatan Bisk Ari Holtzman Jesse Thomason Jacob Andreas Yoshua Bengio ... Angeliki Lazaridou Jonathan May Aleksandr Nisnevich Nicolas Pinto Joseph P. Turian 124 361 0 21 Apr 2020
Adaptive Attention Span in Computer Vision Jerrod Parker Shakti Kumar Joe Roussy ViT VLM 21 2 0 18 Apr 2020
Understanding the Difficulty of Training Transformers Liyuan Liu Xiaodong Liu Jianfeng Gao Weizhu Chen Jiawei Han AI4CE 85 258 0 17 Apr 2020
Spatially-Attentive Patch-Hierarchical Network for Adaptive Motion Deblurring Maitreya Suin Kuldeep Purohit A. N. Rajagopalan 3DV 78 283 0 11 Apr 2020
Hierarchical Opacity Propagation for Image Matting Yaoyi Li Qin Xu Hongtao Lu 71 13 0 07 Apr 2020
Self-supervised Monocular Trained Depth Estimation using Self-attention and Discrete Disparity Volume A. Johnston G. Carneiro MDE 83 237 0 31 Mar 2020
SAC: Accelerating and Structuring Self-Attention via Sparse Adaptive Connection Xiaoya Li Yuxian Meng Mingxin Zhou Qinghong Han Leilei Gan Jiwei Li 86 20 0 22 Mar 2020
PIC: Permutation Invariant Convolution for Recognizing Long-range Activities Noureldien Hussein E. Gavves A. Smeulders VLM 74 13 0 18 Mar 2020
Neuroevolution of Self-Interpretable Agents Yujin Tang Duong Nguyen David R Ha 127 113 0 18 Mar 2020
Axial-DeepLab: Stand-Alone Axial-Attention for Panoptic Segmentation Huiyu Wang Yukun Zhu Bradley Green Hartwig Adam Alan Yuille Liang-Chieh Chen 3DPC 136 674 0 17 Mar 2020
Electricity Theft Detection with self-attention Paulo Finardi Israel Campiotti Gustavo Plensack R. Souza Rodrigo Nogueira G. Pinheiro R. Lotufo 27 29 0 14 Feb 2020
Revisiting Spatial Invariance with Low-Rank Local Connectivity Gamaleldin F. Elsayed Prajit Ramachandran Jonathon Shlens Simon Kornblith 103 44 0 07 Feb 2020
Attentive Group Equivariant Convolutional Networks David W. Romero Erik J. Bekkers Jakub M. Tomczak Mark Hoogendoorn 113 91 0 07 Feb 2020
Analyzing the Dependency of ConvNets on Spatial Information Yue Fan Yongqin Xian M. Losch Bernt Schiele 18 4 0 05 Feb 2020
Reformer: The Efficient Transformer Nikita Kitaev Lukasz Kaiser Anselm Levskaya VLM 233 2,340 0 13 Jan 2020
Relational Mimic for Visual Adversarial Imitation Learning Lionel Blondé Yichuan Tang Jian Zhang Russ Webb 38 0 0 18 Dec 2019
15 Keypoints Is All You Need Michael Snower Asim Kadav Farley Lai H. Graf VOT 3DH 96 48 0 05 Dec 2019
The Origins and Prevalence of Texture Bias in Convolutional Neural Networks Katherine L. Hermann Ting Chen Simon Kornblith CVBM 78 21 0 20 Nov 2019
Affine Self Convolution Nichita Diaconu Daniel E. Worrall 35 3 0 18 Nov 2019
MUSE: Parallel Multi-Scale Attention for Sequence to Sequence Learning Guangxiang Zhao Xu Sun Jingjing Xu Zhiyuan Zhang Liangchen Luo LRM 61 49 0 17 Nov 2019
Sensory Optimization: Neural Networks as a Model for Understanding and Creating Art Owain Evans 29 0 0 16 Nov 2019
On the Relationship between Self-Attention and Convolutional Layers Jean-Baptiste Cordonnier Andreas Loukas Martin Jaggi 150 535 0 08 Nov 2019
LIP: Local Importance-based Pooling Ziteng Gao Limin Wang Gangshan Wu FAtt 85 96 0 12 Aug 2019
Attention Augmented Convolutional Networks Irwan Bello Barret Zoph Ashish Vaswani Jonathon Shlens Quoc V. Le 147 1,019 0 22 Apr 2019
An Attentive Survey of Attention Models S. Chaudhari Varun Mithal Gungor Polatkan R. Ramanath 192 666 0 05 Apr 2019
Sequential Image-based Attention Network for Inferring Force Estimation without Haptic Sensor Hochul Shin Hyeon Cho Dongyi Kim Dae-Kwan Ko Soo-Chul Lim Wonjun Hwang 48 18 0 17 Nov 2018