Axial Attention in Multidimensional Transformers

20 December 2019

Papers citing "Axial Attention in Multidimensional Transformers"

50 / 287 papers shown

Title
Ripple Attention for Visual Perception with Sub-quadratic Complexity Lin Zheng Huijie Pan Lingpeng Kong 28 3 0 06 Oct 2021
Improving Axial-Attention Network Classification via Cross-Channel Weight Sharing Nazmul Shahadat Anthony Maida 18 0 0 04 Oct 2021
Redesigning the Transformer Architecture with Insights from Multi-particle Dynamical Systems Subhabrata Dutta Tanya Gautam Soumen Chakrabarti Tanmoy Chakraborty 51 15 0 30 Sep 2021
UFO-ViT: High Performance Linear Vision Transformer without Softmax Jeonggeun Song ViT 114 20 0 29 Sep 2021
Continuous Streaming Multi-Talker ASR with Dual-path Transducers Desh Raj Liang Lu Zhuo Chen Yashesh Gaur Jinyu Li 11 17 0 17 Sep 2021
Axial multi-layer perceptron architecture for automatic segmentation of choroid plexus in multiple sclerosis Marius Schmidt-Mengin Vito A G Ricigliano B. Bodini E. Morena A. Colombi Mariem Hamzaoui Arya Yazdan Panah B. Stankoff O. Colliot 31 15 0 08 Sep 2021
SANSformers: Self-Supervised Forecasting in Electronic Health Records with Attention-Free Models Yogesh Kumar Alexander Ilin H. Salo S. Kulathinal M. Leinonen Pekka Marttinen AI4TS MedIm 28 0 0 31 Aug 2021
Transformers predicting the future. Applying attention in next-frame and time series forecasting Radostin Cholakov T. Kolev AI4TS 22 16 0 18 Aug 2021
CaraNet: Context Axial Reverse Attention Network for Segmentation of Small Medical Objects Ange Lou Shuyue Guan Hanseok Ko Murray H. Loew 150 193 0 16 Aug 2021
SOTR: Segmenting Objects with Transformers Ruohao Guo Dantong Niu Liao Qu Zhenbo Li ViT 18 102 0 15 Aug 2021
FMMformer: Efficient and Flexible Transformer via Decomposed Near-field and Far-field Attention T. Nguyen Vai Suliafu Stanley J. Osher Long Chen Bao Wang 26 35 0 05 Aug 2021
RockGPT: Reconstructing three-dimensional digital rocks from single two-dimensional slice from the perspective of video generation Qi Zheng Dongxiao Zhang 20 22 0 05 Aug 2021
Vision Transformer with Progressive Sampling Xiaoyu Yue Shuyang Sun Zhanghui Kuang Meng Wei Philip Torr Wayne Zhang Dahua Lin ViT 16 81 0 03 Aug 2021
H-Transformer-1D: Fast One-Dimensional Hierarchical Attention for Sequences Zhenhai Zhu Radu Soricut 112 41 0 25 Jul 2021
Generative Video Transformer: Can Objects be the Words? Yi-Fu Wu Jaesik Yoon Sungjin Ahn ViT 32 34 0 20 Jul 2021
Image Fusion Transformer VS Vibashan Jeya Maria Jose Valanarasu Poojan Oza Vishal M. Patel ViT 30 116 0 19 Jul 2021
AS-MLP: An Axial Shifted MLP Architecture for Vision Dongze Lian Zehao Yu Xing Sun Shenghua Gao 28 189 0 18 Jul 2021
Visual Parser: Representing Part-whole Hierarchies with Transformers Shuyang Sun Xiaoyu Yue S. Bai Philip Torr 50 27 0 13 Jul 2021
Combiner: Full Attention Transformer with Sparse Computation Cost Hongyu Ren H. Dai Zihang Dai Mengjiao Yang J. Leskovec Dale Schuurmans Bo Dai 81 77 0 12 Jul 2021
Weaving Attention U-net: A Novel Hybrid CNN and Attention-based Method for Organs-at-risk Segmentation in Head and Neck CT Images Zhuangzhuang Zhang T. Zhao Hiram Gay Weixiong Zhang B. Sun 30 19 0 10 Jul 2021
UACANet: Uncertainty Augmented Context Attention for Polyp Segmentation Taehun Kim Hyemin Lee Daijin Kim EgoV 22 251 0 06 Jul 2021
Long-Short Transformer: Efficient Transformers for Language and Vision Chen Zhu Ming-Yu Liu Chaowei Xiao M. Shoeybi Tom Goldstein Anima Anandkumar Bryan Catanzaro ViT VLM 32 131 0 05 Jul 2021
CSWin Transformer: A General Vision Transformer Backbone with Cross-Shaped Windows Xiaoyi Dong Jianmin Bao Dongdong Chen Weiming Zhang Nenghai Yu Lu Yuan Dong Chen B. Guo ViT 25 953 0 01 Jul 2021
Stable, Fast and Accurate: Kernelized Attention with Relative Positional Encoding Shengjie Luo Shanda Li Tianle Cai Di He Dinglan Peng Shuxin Zheng Guolin Ke Liwei Wang Tie-Yan Liu 27 50 0 23 Jun 2021
Vision Permutator: A Permutable MLP-Like Architecture for Visual Recognition Qibin Hou Zihang Jiang Li-xin Yuan Mingg-Ming Cheng Shuicheng Yan Jiashi Feng ViT MLLM 24 205 0 23 Jun 2021
More than Encoder: Introducing Transformer Decoder to Upsample Yijiang Li Wentian Cai Ying Gao Chengming Li Xiping Hu ViT MedIm 35 51 0 20 Jun 2021
DeepLab2: A TensorFlow Library for Deep Labeling Mark Weber Huiyu Wang Siyuan Qiao Jun Xie Maxwell D. Collins ... Laura Leal-Taixe Alan Yuille Florian Schroff Hartwig Adam Liang-Chieh Chen VLM 27 45 0 17 Jun 2021
XCiT: Cross-Covariance Image Transformers Alaaeldin El-Nouby Hugo Touvron Mathilde Caron Piotr Bojanowski Matthijs Douze ... Ivan Laptev Natalia Neverova Gabriel Synnaeve Jakob Verbeek Hervé Jégou ViT 42 499 0 17 Jun 2021
Multi-Resolution Continuous Normalizing Flows Vikram S. Voleti Chris Finlay Adam M. Oberman Christopher Pal 27 4 0 15 Jun 2021
Scene Transformer: A unified architecture for predicting multiple agent trajectories Jiquan Ngiam Benjamin Caine Vijay Vasudevan Zhengdong Zhang H. Chiang ... Ashish Venugopal David J. Weiss Benjamin Sapp Zhifeng Chen Jonathon Shlens 22 154 0 15 Jun 2021
Improved Transformer for High-Resolution GANs Long Zhao Zizhao Zhang Ting Chen Dimitris N. Metaxas Han Zhang ViT 34 95 0 14 Jun 2021
Hybrid Generative-Contrastive Representation Learning Saehoon Kim Sungwoong Kim Juho Lee SSL 17 11 0 11 Jun 2021
A Survey of Transformers Tianyang Lin Yuxin Wang Xiangyang Liu Xipeng Qiu ViT 53 1,088 0 08 Jun 2021
Chasing Sparsity in Vision Transformers: An End-to-End Exploration Tianlong Chen Yu Cheng Zhe Gan Lu Yuan Lei Zhang Zhangyang Wang ViT 15 216 0 08 Jun 2021
Self-Attention Between Datapoints: Going Beyond Individual Input-Output Pairs in Deep Learning Jannik Kossen Neil Band Clare Lyle Aidan Gomez Tom Rainforth Y. Gal OOD 3DPC 33 137 0 04 Jun 2021
SAINT: Improved Neural Networks for Tabular Data via Row Attention and Contrastive Pre-Training Gowthami Somepalli Micah Goldblum Avi Schwarzschild C. Bayan Bruss Tom Goldstein LMTD 18 309 0 02 Jun 2021
On the Distribution, Sparsity, and Inference-time Quantization of Attention Values in Transformers Tianchu Ji Shraddhan Jain M. Ferdman Peter Milder H. A. Schwartz Niranjan Balasubramanian MQ 50 15 0 02 Jun 2021
KVT: k-NN Attention for Boosting Vision Transformers Pichao Wang Xue Wang F. Wang Ming Lin Shuning Chang Hao Li R. L. Jin ViT 51 105 0 28 May 2021
Video-based Person Re-identification without Bells and Whistles Chih-Ting Liu Jun-Cheng Chen Chu-Song Chen Shao-Yi Chien 42 14 0 22 May 2021
Attention-based Stylisation for Exemplar Image Colourisation Marc Górriz Blanch Issa Khalifeh Alan F. Smeaton Noel E. O'Connor M. Mrak 31 4 0 04 May 2021
Pyramid Medical Transformer for Medical Image Segmentation Zhuangzhuang Zhang Weixiong Zhang ViT MedIm 14 46 0 29 Apr 2021
Inpainting Transformer for Anomaly Detection Jonathan Pirnay K. Chai ViT 107 165 0 28 Apr 2021
baller2vec++: A Look-Ahead Multi-Entity Transformer For Modeling Coordinated Agents Michael A. Alcorn A. Nguyen 20 15 0 24 Apr 2021
VideoGPT: Video Generation using VQ-VAE and Transformers Wilson Yan Yunzhi Zhang Pieter Abbeel A. Srinivas ViT VGen 245 484 0 20 Apr 2021
Simultaneous Face Hallucination and Translation for Thermal to Visible Face Verification using Axial-GAN Rakhil Immidisetti Shuowen Hu Vishal M. Patel CVBM PICV 28 19 0 13 Apr 2021
Skillful Precipitation Nowcasting using Deep Generative Models of Radar Suman V. Ravuri Karel Lenc Matthew Willson D. Kangin Rémi R. Lam ... R. Hadsell Nial H. Robinson Ellen Clancy A. Arribas S. Mohamed AI4Cl 14 722 0 02 Apr 2021
ViViT: A Video Vision Transformer Anurag Arnab Mostafa Dehghani G. Heigold Chen Sun Mario Lucic Cordelia Schmid ViT 30 2,087 0 29 Mar 2021
Multi-Scale Vision Longformer: A New Vision Transformer for High-Resolution Image Encoding Pengchuan Zhang Xiyang Dai Jianwei Yang Bin Xiao Lu Yuan Lei Zhang Jianfeng Gao ViT 29 329 0 29 Mar 2021
High-Fidelity Pluralistic Image Completion with Transformers Bo Liu Jingbo Zhang Dongdong Chen Jing Liao ViT 28 231 0 25 Mar 2021
Scaling Local Self-Attention for Parameter Efficient Visual Backbones Ashish Vaswani Prajit Ramachandran A. Srinivas Niki Parmar Blake A. Hechtman Jonathon Shlens 21 395 0 23 Mar 2021