Axial Attention in Multidimensional Transformers

20 December 2019

Papers citing "Axial Attention in Multidimensional Transformers"

50 / 287 papers shown

Title
Earthformer: Exploring Space-Time Transformers for Earth System Forecasting Zhihan Gao Xingjian Shi Hao Wang Yi Zhu Yuyang Wang Mu Li Dit-Yan Yeung AI4TS 39 150 0 12 Jul 2022
kMaX-DeepLab: k-means Mask Transformer Qihang Yu Huiyu Wang Siyuan Qiao Maxwell D. Collins Yukun Zhu Hartwig Adam Alan Yuille Liang-Chieh Chen ViT 40 18 0 08 Jul 2022
Efficient Representation Learning via Adaptive Context Pooling Chen Huang Walter A. Talbott Navdeep Jaitly J. Susskind 30 47 0 05 Jul 2022
CMT-DeepLab: Clustering Mask Transformers for Panoptic Segmentation Qihang Yu Huiyu Wang Dahun Kim Siyuan Qiao Maxwell D. Collins Yukun Zhu Hartwig Adam Alan Yuille Liang-Chieh Chen ViT MedIm 32 90 0 17 Jun 2022
SimA: Simple Softmax-free Attention for Vision Transformers Soroush Abbasi Koohpayegani Hamed Pirsiavash 24 25 0 17 Jun 2022
SimVP: Simpler yet Better Video Prediction Zhangyang Gao Cheng Tan Lirong Wu Stan Z. Li 40 211 0 09 Jun 2022
Blind Face Restoration: Benchmark Datasets and a Baseline Model Puyang Zhang Kaihao Zhang Wenhan Luo Changsheng Li Guoren Wang CVBM 37 17 0 08 Jun 2022
Wavelet Prior Attention Learning in Axial Inpainting Network Chenjie Cao Chengrong Wang Yuntao Zhang Yanwei Fu 43 2 0 07 Jun 2022
EAANet: Efficient Attention Augmented Convolutional Networks Runqing Zhang Tianshu Zhu 22 2 0 03 Jun 2022
What Dense Graph Do You Need for Self-Attention? Yuxing Wang Chu-Tak Lee Qipeng Guo Zhangyue Yin Yunhua Zhou Xuanjing Huang Xipeng Qiu GNN 8 4 0 27 May 2022
X-ViT: High Performance Linear Vision Transformer without Softmax Jeonggeun Song Heung-Chang Lee ViT 25 2 0 27 May 2022
ColonFormer: An Efficient Transformer based Method for Colon Polyp Segmentation N. Duc Nguyen Thi Oanh N. T. Thuy Trần Minh Triết V. Dinh ViT MedIm 138 117 0 17 May 2022
Reduce Information Loss in Transformers for Pluralistic Image Inpainting Qiankun Liu Zhentao Tan Dongdong Chen Qi Chu Xiyang Dai Yinpeng Chen Mengchen Liu Lu Yuan Nenghai Yu ViT 31 70 0 10 May 2022
Transformers in Time-series Analysis: A Tutorial Sabeen Ahmed Ian E. Nielsen Aakash Tripathi Shamoon Siddiqui Ghulam Rasool R. Ramachandran AI4TS 36 142 0 28 Apr 2022
Transformation Invariant Cancerous Tissue Classification Using Spatially Transformed DenseNet Omar Mahdi Ali Bou Nassif MedIm 9 2 0 23 Apr 2022
Future Object Detection with Spatiotemporal Transformers Adam Tonderski Joakim Johnander Christoffer Petersson Kalle AAstrom ViT 23 0 0 21 Apr 2022
A Call for Clarity in Beam Search: How It Works and When It Stops Jungo Kasai Keisuke Sakaguchi Ronan Le Bras Dragomir R. Radev Yejin Choi Noah A. Smith 26 6 0 11 Apr 2022
ManiTrans: Entity-Level Text-Guided Image Manipulation via Token-wise Semantic Alignment and Generation Jianan Wang Guansong Lu Hang Xu Zhenguo Li Chunjing Xu Yanwei Fu 33 17 0 09 Apr 2022
Video Diffusion Models Jonathan Ho Tim Salimans Alexey A. Gritsenko William Chan Mohammad Norouzi David J. Fleet DiffM VGen 47 1,523 0 07 Apr 2022
Analysis of Different Losses for Deep Learning Image Colorization C. Ballester Aurélie Bugeau Hernan Carrillo Michael Clement Rémi Giraud Lara Raad Patricia Vitoria 17 5 0 06 Apr 2022
Influence of Color Spaces for Deep Learning Image Colorization C. Ballester Aurélie Bugeau Hernan Carrillo Michael Clement Rémi Giraud Lara Raad Patricia Vitoria 34 8 0 06 Apr 2022
MaxViT: Multi-Axis Vision Transformer Zhengzhong Tu Hossein Talebi Han Zhang Feng Yang P. Milanfar A. Bovik Yinxiao Li ViT 62 636 0 04 Apr 2022
Protein language models trained on multiple sequence alignments learn phylogenetic relationships Umberto Lupo Damiano Sgarbossa Anne-Florence Bitbol 27 35 0 29 Mar 2022
Transformer Compressed Sensing via Global Image Tokens M. B. Lorenzana Craig B. Engstrom Shekhar S. Chandra ViT MedIm 20 5 0 24 Mar 2022
VPFusion: Joint 3D Volume and Pixel-Aligned Feature Fusion for Single and Multi-view 3D Reconstruction Jisan Mahmud Jan-Michael Frahm 11 3 0 14 Mar 2022
KPE: Keypoint Pose Encoding for Transformer-based Image Generation Soon Yau Cheong A. Mustafa Andrew Gilbert ViT 32 10 0 09 Mar 2022
Incremental Transformer Structure Enhanced Image Inpainting with Masking Positional Encoding Qiaole Dong Chenjie Cao Yanwei Fu CLL 28 138 0 02 Mar 2022
FastFold: Reducing AlphaFold Training Time from 11 Days to 67 Hours Shenggan Cheng Xuanlei Zhao Guangyang Lu Bin-Rui Li Zhongming Yu Tian Zheng R. Wu Xiwen Zhang Jian Peng Yang You AI4CE 24 30 0 02 Mar 2022
Transformer Quality in Linear Time Weizhe Hua Zihang Dai Hanxiao Liu Quoc V. Le 78 222 0 21 Feb 2022
Effective Training Strategies for Deep-learning-based Precipitation Nowcasting and Estimation Jihoon Ko Kyuhan Lee Hyun-Sun Hwang Seok-Geun Oh S. Son Kijung Shin AI4Cl 43 40 0 17 Feb 2022
Structured Time Series Prediction without Structural Prior Darko Drakulic J. Andreoli DiffM AI4TS 16 3 0 07 Feb 2022
ShapeFormer: Transformer-based Shape Completion via Sparse Representation Xingguang Yan Liqiang Lin Niloy J. Mitra Dani Lischinski Daniel Cohen-Or Hui Huang ViT 70 114 0 25 Jan 2022
U-shaped Transformer with Frequency-Band Aware Attention for Speech Enhancement Yi Li Yang Sun S. M. Naqvi 23 25 0 11 Dec 2021
Couplformer:Rethinking Vision Transformer with Coupling Attention Map Hai Lan Xihao Wang Xian Wei ViT 31 3 0 10 Dec 2021
Extending nn-UNet for brain tumor segmentation Huan Minh Luu Sung-Hong Park 24 102 0 09 Dec 2021
Make It Move: Controllable Image-to-Video Generation with Text Descriptions Yaosi Hu Chong Luo Zhenzhong Chen VGen 30 86 0 06 Dec 2021
Localized Feature Aggregation Module for Semantic Segmentation Ryouichi Furukawa Kazuhiro Hotta 43 2 0 03 Dec 2021
Sparse DETR: Efficient End-to-End Object Detection with Learnable Sparsity Byungseok Roh Jaewoong Shin Wuhyun Shin Saehoon Kim ViT 16 142 0 29 Nov 2021
NÜWA: Visual Synthesis Pre-training for Neural visUal World creAtion Chenfei Wu Jian Liang Lei Ji Fan Yang Yuejian Fang Daxin Jiang Nan Duan ViT VGen 18 292 0 24 Nov 2021
Adaptive Fourier Neural Operators: Efficient Token Mixers for Transformers John Guibas Morteza Mardani Zong-Yi Li Andrew Tao Anima Anandkumar Bryan Catanzaro 21 230 0 24 Nov 2021
Monocular Road Planar Parallax Estimation Haobo Yuan Teng Chen Wei Sui Jiafeng Xie Lefei Zhang Yuan Li Qian Zhang 10 4 0 22 Nov 2021
CpT: Convolutional Point Transformer for 3D Point Cloud Processing Chaitanya Kaul Joshua Mitton H. Dai Roderick Murray-Smith 3DPC 27 6 0 21 Nov 2021
MS-nowcasting: Operational Precipitation Nowcasting with Convolutional LSTMs at Microsoft Weather Sylwester Klocek Haiyu Dong M. Dixon Panashe Kanengoni Najeeb Kazmi Pete Luferenko Zhongjian Lv Shikhar Sharma Jonathan A. Weyn Siqi Xiang AI4Cl 37 22 0 18 Nov 2021
Searching for TrioNet: Combining Convolution with Local and Global Self-Attention Huaijin Pi Huiyu Wang Yingwei Li Zizhang Li Alan Yuille ViT 27 3 0 15 Nov 2021
Mixed Transformer U-Net For Medical Image Segmentation Hongyi Wang Shiao Xie Lanfen Lin Yutaro Iwamoto X. Han Yenwei Chen Ruofeng Tong ViT MedIm 30 244 0 08 Nov 2021
Hierarchical Transformers Are More Efficient Language Models Piotr Nawrot Szymon Tworkowski Michał Tyrolski Lukasz Kaiser Yuhuai Wu Christian Szegedy Henryk Michalewski 22 60 0 26 Oct 2021
Energon: Towards Efficient Acceleration of Transformers Using Dynamic Sparse Attention Zhe Zhou Junling Liu Zhenyu Gu Guangyu Sun 64 42 0 18 Oct 2021
Improving Transformers with Probabilistic Attention Keys Tam Nguyen T. Nguyen Dung D. Le Duy Khuong Nguyen Viet-Anh Tran Richard G. Baraniuk Nhat Ho Stanley J. Osher 53 32 0 16 Oct 2021
How Does Momentum Benefit Deep Neural Networks Architecture Design? A Few Case Studies Bao Wang Hedi Xia T. Nguyen Stanley Osher AI4CE 45 10 0 13 Oct 2021
DCT: Dynamic Compressive Transformer for Modeling Unbounded Sequence Kai-Po Chang Wei-Yun Ma 6 0 0 10 Oct 2021