Axial Attention in Multidimensional Transformers

20 December 2019

Papers citing "Axial Attention in Multidimensional Transformers"

50 / 287 papers shown

Title
High-level Feature Guided Decoding for Semantic Segmentation Ye Huang Di Kang Shenghua Gao Wen Li Lixin Duan 23 0 0 15 Mar 2023
Vision-Language Generative Model for View-Specific Chest X-ray Generation HyunGyung Lee Dayun Lee Wonjae Kim Jin-Hwa Kim Tackeun Kim Jihang Kim Leonard Sunwoo Edward Choi LM&MA MedIm 21 7 0 23 Feb 2023
Entity-Level Text-Guided Image Manipulation Yikai Wang Jianan Wang Guansong Lu Hang Xu Zhenguo Li Wei Zhang Yanwei Fu VGen 34 3 0 22 Feb 2023
Hyneter: Hybrid Network Transformer for Object Detection Dong Chen Duoqian Miao Xuepeng Zhao ViT 31 3 0 18 Feb 2023
A Unified View of Long-Sequence Models towards Modeling Million-Scale Dependencies Hongyu Hè Marko Kabić 25 2 0 13 Feb 2023
In-Context Learning with Many Demonstration Examples Mukai Li Shansan Gong Jiangtao Feng Yiheng Xu Jinchao Zhang Zhiyong Wu Lingpeng Kong 40 31 0 09 Feb 2023
Transformer-based Models for Long-Form Document Matching: Challenges and Empirical Analysis Akshita Jha Adithya Samavedhi Vineeth Rakesh J. Chandrashekar Chandan K. Reddy 11 0 0 07 Feb 2023
Deep Residual Axial Networks Nazmul Shahadat Anthony Maida 3DPC 27 4 0 11 Jan 2023
Deep Axial Hypercomplex Networks Nazmul Shahadat Anthony Maida 12 1 0 11 Jan 2023
CARD: Semantic Segmentation with Efficient Class-Aware Regularized Decoder Ye Huang Di Kang Liang Chen W. Jia Xiangjian He Lixin Duan Xuefei Zhe Linchao Bao 37 2 0 11 Jan 2023
Dynamic Grained Encoder for Vision Transformers Lin Song Songyang Zhang Songtao Liu Zeming Li Xuming He Hongbin Sun Jian Sun Nanning Zheng ViT 26 34 0 10 Jan 2023
JFP: Joint Future Prediction with Interactive Multi-Agent Modeling for Autonomous Driving Wenjie Luo C. Park Andre Cornman Benjamin Sapp Drago Anguelov 20 37 0 16 Dec 2022
Utilizing distilBert transformer model for sentiment classification of COVID-19's Persian open-text responses F. Masoumi M. Bahrani 11 2 0 16 Dec 2022
Mitigation of Spatial Nonstationarity with Vision Transformers Lei Liu Javier E. Santos Mavsa Prodanović Michael J. Pyrcz 12 4 0 09 Dec 2022
Axial-LOB: High-Frequency Trading with Axial Attention Damian Kisiel D. Gorse 15 6 0 04 Dec 2022
Protein Language Models and Structure Prediction: Connection and Progression Bozhen Hu Jun Xia Jiangbin Zheng Cheng Tan Yufei Huang Yongjie Xu Stan Z. Li 24 40 0 30 Nov 2022
GPT-Neo for commonsense reasoning -- a theoretical and practical lens Rohan Kashyap Vivek Kashyap Narendra C.P ReLM ELM LRM 36 7 0 28 Nov 2022
Medical Image Segmentation Review: The success of U-Net Reza Azad Ehsan Khodapanah Aghdam Amelie Rauland Yiwei Jia Atlas Haddadi Avval Afshin Bozorgpour Sanaz Karimijafarbigloo Joseph Paul Cohen Ehsan Adeli Dorit Merhof SSeg 28 265 0 27 Nov 2022
Deep representation learning: Fundamentals, Perspectives, Applications, and Open Challenges K. T. Baghaei Amirreza Payandeh Pooya Fayyazsanavi Shahram Rahimi Zhiqian Chen Somayeh Bakhtiari Ramezani FaML AI4TS 35 6 0 27 Nov 2022
Fast-iTPN: Integrally Pre-Trained Transformer Pyramid Network with Token Migration Yunjie Tian Lingxi Xie Jihao Qiu Jianbin Jiao Yaowei Wang Qi Tian Qixiang Ye ViT 39 6 0 23 Nov 2022
SimVP: Towards Simple yet Powerful Spatiotemporal Predictive Learning Cheng Tan Zhangyang Gao Siyuan Li Stan Z. Li VLM AI4TS 22 1 0 22 Nov 2022
Beyond the Field-of-View: Enhancing Scene Visibility and Perception with Clip-Recurrent Transformer Haowen Shi Zhijie Xu Kailun Yang Xiaoyue Yin Ze Wang Kaiwei Wang ViT 43 5 0 21 Nov 2022
Parameter-Efficient Transformer with Hybrid Axial-Attention for Medical Image Segmentation Yiyue Hu Lei Zhang Nan Mu Leijun Liu ViT MedIm 22 1 0 17 Nov 2022
Portmanteauing Features for Scene Text Recognition Yew Lee Tan Ernest Yu Kai Chew A. Kong Jung-jae Kim J. Lim 41 0 0 09 Nov 2022
Diffuser: Efficient Transformers with Multi-hop Attention Diffusion for Long Sequences Aosong Feng Irene Z Li Yuang Jiang Rex Ying 29 18 0 21 Oct 2022
Autoregressive Generative Modeling with Noise Conditional Maximum Likelihood Estimation Henry Li Y. Kluger 30 2 0 19 Oct 2022
Dense but Efficient VideoQA for Intricate Compositional Reasoning Jihyeon Janel Lee Wooyoung Kang Eun-Sol Kim CoGe 19 3 0 19 Oct 2022
Linear Video Transformer with Feature Fixation Kaiyue Lu Zexia Liu Jianyuan Wang Weixuan Sun Zhen Qin ... Xuyang Shen Huizhong Deng Xiaodong Han Yuchao Dai Yiran Zhong 30 4 0 15 Oct 2022
CAB: Comprehensive Attention Benchmarking on Long Sequence Modeling Jinchao Zhang Shuyang Jiang Jiangtao Feng Lin Zheng Lingpeng Kong 3DV 43 9 0 14 Oct 2022
ZITS++: Image Inpainting by Improving the Incremental Transformer on Structural Priors Chenjie Cao Qiaole Dong Yanwei Fu 38 30 0 12 Oct 2022
Less is More: Facial Landmarks can Recognize a Spontaneous Smile Md. Tahrim Faroque Yan Yang Md. Zakir Hossain S. M. Naim Nabeel Mohammed Shafin Rahman CVBM ViT 42 2 0 09 Oct 2022
Bird-Eye Transformers for Text Generation Models Lei Sha Yuhang Song Yordan Yordanov Tommaso Salvatori Thomas Lukasiewicz 30 0 0 08 Oct 2022
MOAT: Alternating Mobile Convolution and Attention Brings Strong Vision Models Chenglin Yang Siyuan Qiao Qihang Yu Xiaoding Yuan Yukun Zhu Alan Yuille Hartwig Adam Liang-Chieh Chen ViT MoE 39 58 0 04 Oct 2022
UniColor: A Unified Framework for Multi-Modal Colorization with Transformer Zhitong Huang Nanxuan Zhao Jing Liao ViT 20 16 0 22 Sep 2022
Revisiting Image Pyramid Structure for High Resolution Salient Object Detection Taehung Kim Kunhee Kim J. Lee D. Cha Ji-Heon Lee Daijin Kim 56 42 0 20 Sep 2022
Axially Expanded Windows for Local-Global Interaction in Vision Transformers Zhemin Zhang Xun Gong ViT 18 1 0 19 Sep 2022
Large-Scale Auto-Regressive Modeling Of Street Networks Michael Birsak Tom Kelly W. Para Peter Wonka GNN AI4TS 9 5 0 01 Sep 2022
NestedFormer: Nested Modality-Aware Transformer for Brain Tumor Segmentation Zhaohu Xing Lequan Yu Liang Wan Tong Han Lei Zhu ViT MedIm 20 61 0 31 Aug 2022
MAFormer: A Transformer Network with Multi-scale Attention Fusion for Visual Recognition Y. Wang H. Sun Xiaodi Wang Bin Zhang Chaonan Li Ying Xin Baochang Zhang Errui Ding Shumin Han ViT 31 9 0 31 Aug 2022
A Circular Window-based Cascade Transformer for Online Action Detection Shuyuan Cao Weihua Luo Bairui Wang Wei Emma Zhang Lin Ma 42 6 0 30 Aug 2022
MRL: Learning to Mix with Attention and Convolutions Shlok Mohta Hisahiro Suganuma Yoshiki Tanaka 28 2 0 30 Aug 2022
GEM-2: Next Generation Molecular Property Prediction Network by Modeling Full-range Many-body Interactions Lihang Liu Donglong He Xiaomin Fang Shanzhuo Zhang Fan Wang Jingzhou He Hua-Hong Wu 24 3 0 11 Aug 2022
Two-Stream Transformer Architecture for Long Video Understanding Edward Fish Jon Weinbren Andrew Gilbert ViT 30 6 0 02 Aug 2022
Momentum Transformer: Closing the Performance Gap Between Self-attention and Its Linearization T. Nguyen Richard G. Baraniuk Robert M. Kirby Stanley J. Osher Bao Wang 32 9 0 01 Aug 2022
Neural Architecture Search on Efficient Transformers and Beyond Zexiang Liu Dong Li Kaiyue Lu Zhen Qin Weixuan Sun Jiacheng Xu Yiran Zhong 35 19 0 28 Jul 2022
EleGANt: Exquisite and Locally Editable GAN for Makeup Transfer Chenyu Yang W. He Yingqing Xu Yang Gao DiffM 19 26 0 20 Jul 2022
NUWA-Infinity: Autoregressive over Autoregressive Generation for Infinite Visual Synthesis Chenfei Wu Jian Liang Xiaowei Hu Zhe Gan Jianfeng Wang Lijuan Wang Zicheng Liu Yuejian Fang Nan Duan VGen 27 72 0 20 Jul 2022
Vision Transformers: From Semantic Segmentation to Dense Prediction Li Zhang Jiachen Lu Sixiao Zheng Xinxuan Zhao Xiatian Zhu Yanwei Fu Tao Xiang Jianfeng Feng Philip H. S. Torr ViT 27 7 0 19 Jul 2022
Conditional DETR V2: Efficient Detection Transformer with Box Queries Xiaokang Chen Fangyun Wei Gang Zeng Jingdong Wang ViT 30 33 0 18 Jul 2022
Wayformer: Motion Forecasting via Simple & Efficient Attention Networks Nigamaa Nayakanti Rami Al-Rfou Aurick Zhou Kratarth Goel Khaled S. Refaat Benjamin Sapp AI4TS 44 235 0 12 Jul 2022