Axial Attention in Multidimensional Transformers

20 December 2019

Papers citing "Axial Attention in Multidimensional Transformers"

50 / 287 papers shown

Title
Harmonizing Code-mixed Conversations: Personality-assisted Code-mixed Response Generation in Dialogues Shivani Kumar Tanmoy Chakraborty 15 0 0 18 Jan 2024
Siamese Meets Diffusion Network: SMDNet for Enhanced Change Detection in High-Resolution RS Imagery Jia Jia Geunho Lee Zhibo Wang Zhi Lyu Yuchu He DiffM 37 7 0 17 Jan 2024
Sign Language Production with Latent Motion Transformer Pan Xie Taiying Peng Yao Du Qipeng Zhang SLR 27 3 0 20 Dec 2023
MCANet: Medical Image Segmentation with Multi-Scale Cross-Axis Attention Hao Shao Quansheng Zeng Qibin Hou Jufeng Yang 51 13 0 14 Dec 2023
A Simple Video Segmenter by Tracking Objects Along Axial Trajectories Ju He Qihang Yu Inkyu Shin XueQing Deng Alan L. Yuille Xiaohui Shen Liang-Chieh Chen VOS 38 2 0 30 Nov 2023
Linear Log-Normal Attention with Unbiased Concentration Yury Nahshan Dor-Joseph Kampeas E. Haleva 22 7 0 22 Nov 2023
Vision Big Bird: Random Sparsification for Full Attention Zhemin Zhang Xun Gong ViT 13 1 0 10 Nov 2023
A Hierarchical Spatial Transformer for Massive Point Samples in Continuous Space Wenchong He Zhe Jiang Tingsong Xiao Zelin Xu Shigang Chen Ronald Fick Miles Medina Christine Angelini 18 16 0 08 Nov 2023
P2AT: Pyramid Pooling Axial Transformer for Real-time Semantic Segmentation Mohammed A. M. Elhassan Changjun Zhou Amina Benabid Abuzar B. M. Adam ViT 33 11 0 23 Oct 2023
Attentive Multi-Layer Perceptron for Non-autoregressive Generation Shuyang Jiang Jinchao Zhang Jiangtao Feng Lin Zheng Lingpeng Kong 54 0 0 14 Oct 2023
Retrieval meets Long Context Large Language Models Peng-Tao Xu Ming-Yu Liu Xianchao Wu Lawrence C. McAfee Chen Zhu Zihan Liu Sandeep Subramanian Evelina Bakhturina M. Shoeybi Bryan Catanzaro RALM LRM 14 79 0 04 Oct 2023
Multiple Physics Pretraining for Physical Surrogate Models Michael McCabe Bruno Régaldo-Saint Blancard Liam Parker Ruben Ohana M. Cranmer ... Francois Lanusse Mariel Pettee Tiberiu Teşileanu Kyunghyun Cho Shirley Ho PINN AI4CE 40 52 0 04 Oct 2023
Delving into CLIP latent space for Video Anomaly Recognition Luca Zanella Benedetta Liberatori Willi Menapace Fabio Poiesi Yiming Wang Elisa Ricci 28 22 0 04 Oct 2023
SlowFormer: Universal Adversarial Patch for Attack on Compute and Energy Efficiency of Inference Efficient Vision Transformers K. Navaneet Soroush Abbasi Koohpayegani Essam Sleiman Hamed Pirsiavash AAML ViT 13 1 0 04 Oct 2023
TransRadar: Adaptive-Directional Transformer for Real-Time Multi-View Radar Semantic Segmentation Yahia Dalbah Jean Lahoud Hisham Cholakkal 19 7 0 03 Oct 2023
Learning the Efficient Frontier Philippe Chatigny Ivan Sergienko Ryan Ferguson Jordan Weir Maxime Bergeron 19 1 0 27 Sep 2023
UniHead: Unifying Multi-Perception for Detection Heads Hantao Zhou Rui Yang Yachao Zhang Haoran Duan Yawen Huang R. Hu Xiu Li Yefeng Zheng 31 12 0 23 Sep 2023
SG-Former: Self-guided Transformer with Evolving Token Reallocation Sucheng Ren Xingyi Yang Songhua Liu Xinchao Wang ViT 27 41 0 23 Aug 2023
How Much Temporal Long-Term Context is Needed for Action Segmentation? Emad Bahrami Rad Gianpiero Francesca Juergen Gall ViT 24 25 0 22 Aug 2023
A Lightweight Transformer for Faster and Robust EBSD Data Collection Harry Dong S. Donegan M. Shah Yuejie Chi 32 2 0 18 Aug 2023
Isomer: Isomerous Transformer for Zero-shot Video Object Segmentation Yichen Yuan Yifan Wang Lijun Wang Xiaoqi Zhao Huchuan Lu Yu Wang Wei Su Lei Zhang VOS 24 7 0 13 Aug 2023
PARTNER: Level up the Polar Representation for LiDAR 3D Object Detection Mingyan Nie Yujing Xue Chunwei Wang Chao Ye Hang Xu Xinge Zhu Qingqiu Huang Michael Bi Mi Xinchao Wang Li Zhang 3DPC 24 8 0 08 Aug 2023
Scalable Deep Learning for RNA Secondary Structure Prediction Jörg Franke Frederic Runge Frank Hutter DRL 13 10 0 14 Jul 2023
Video-FocalNets: Spatio-Temporal Focal Modulation for Video Action Recognition Syed Talal Wasim Muhammad Uzair Khattak Muzammal Naseer Salman Khan M. Shah F. Khan ViT 54 19 0 13 Jul 2023
Transformers in Reinforcement Learning: A Survey Pranav Agarwal A. Rahman P. St-Charles Simon J. D. Prince Samira Ebrahimi Kahou OffRL 24 18 0 12 Jul 2023
Understanding the Efficacy of U-Net & Vision Transformer for Groundwater Numerical Modelling M. L. Taccari O. Ovadia He-Nan Wang Adar Kahana Xiaohui Chen P. Jimack 35 2 0 08 Jul 2023
SEEDS: Emulation of Weather Forecast Ensembles with Diffusion Models Lizao Li Rob Carver I. Lopez‐Gomez Fei Sha John R. Anderson DiffM 25 19 0 24 Jun 2023
Enhancing the Protein Tertiary Structure Prediction by Multiple Sequence Alignment Generation Le Zhang Jiayang Chen Tao Shen Yu-Hu Li S. Sun 19 5 0 02 Jun 2023
Hierarchical Attention Encoder Decoder Asier Mujika BDL 22 3 0 01 Jun 2023
Blockwise Parallel Transformer for Large Context Models Hao Liu Pieter Abbeel 49 11 0 30 May 2023
Geometric Algebra Transformer Johann Brehmer P. D. Haan S. Behrends Taco S. Cohen 39 26 0 28 May 2023
Scalable Transformer for PDE Surrogate Modeling Zijie Li Dule Shu A. Farimani 35 67 0 27 May 2023
Towards Consistent Video Editing with Text-to-Image Diffusion Models Zicheng Zhang Bonan Li Xuecheng Nie Congying Han Tiande Guo Luoqi Liu DiffM 20 24 0 27 May 2023
Segmented Recurrent Transformer: An Efficient Sequence-to-Sequence Model Yinghan Long Sayeed Shafayet Chowdhury Kaushik Roy 40 1 0 24 May 2023
Fourier Transformer: Fast Long Range Modeling by Removing Sequence Redundancy with FFT Operator Ziwei He Meng-Da Yang Minwei Feng Jingcheng Yin Xinbing Wang Jingwen Leng Zhouhan Lin ViT 35 11 0 24 May 2023
Evolution: A Unified Formula for Feature Operators from a High-level Perspective Zhicheng Cai 11 0 0 23 May 2023
FIT: Far-reaching Interleaved Transformers Ting-Li Chen Lala Li 26 12 0 22 May 2023
Hybrid and Collaborative Passage Reranking Zongmeng Zhang Wen-gang Zhou Jiaxin Shi Houqiang Li 27 0 0 16 May 2023
Cross-Shaped Windows Transformer with Self-supervised Pretraining for Clinically Significant Prostate Cancer Detection in Bi-parametric MRI Yuheng Li Jacob F. Wynne Jing Wang Richard L. J. Qiu J. Roper ... A. Jani Tian Liu P. Patel H. Mao Xiaofeng Yang OOD ViT MedIm 30 10 0 30 Apr 2023
Detection of Pavement Cracks by Deep Learning Models of Transformer and UNet Yu Zhang Lin Zhang UQCV MedIm ViT 30 10 0 25 Apr 2023
RSIR Transformer: Hierarchical Vision Transformer using Random Sampling Windows and Important Region Windows Zhemin Zhang Xun Gong ViT 15 1 0 13 Apr 2023
WOMD-LiDAR: Raw Sensor Dataset Benchmark for Motion Forecasting K. Chen Runzhou Ge Hang Qiu Rami Ai-Rfou C. Qi ... Mustafa A. Mustafa Ivan Bogun Weiyue Wang Mingxing Tan Drago Anguelov 29 20 0 07 Apr 2023
DIR-AS: Decoupling Individual Identification and Temporal Reasoning for Action Segmentation Peiyao Wang Haibin Ling 15 2 0 04 Apr 2023
Scalable and Accurate Self-supervised Multimodal Representation Learning without Aligned Video and Text Data Vladislav Lialin Stephen Rawls David M. Chan Shalini Ghosh Anna Rumshisky Wael Hamza VLM AI4TS 28 6 0 04 Apr 2023
Zero-Shot Video Editing Using Off-The-Shelf Image Diffusion Models Wen Wang Yan Jiang K. Xie Zide Liu Hao Chen Yue Cao Xinlong Wang Chunhua Shen DiffM VGen 34 112 0 30 Mar 2023
Sparsifiner: Learning Sparse Instance-Dependent Attention for Efficient Vision Transformers Cong Wei Brendan Duke R. Jiang P. Aarabi Graham W. Taylor Florian Shkurti ViT 46 14 0 24 Mar 2023
Multiscale Attention via Wavelet Neural Operators for Vision Transformers Anahita Nekoozadeh M. Ahmadzadeh Zahra Mardani ViT 32 2 0 22 Mar 2023
Towards End-to-End Generative Modeling of Long Videos with Memory-Efficient Bidirectional Transformers Jaehoon Yoo Semin Kim Doyup Lee Chiheon Kim Seunghoon Hong 31 3 0 20 Mar 2023
CerviFormer: A Pap-smear based cervical cancer classification method using cross attention and latent transformer Bhaswati Singha Deo M. Pal P. Panigrahi A. Pradhan MedIm 36 22 0 17 Mar 2023
BiFormer: Vision Transformer with Bi-Level Routing Attention Lei Zhu Xinjiang Wang Zhanghan Ke Wayne Zhang Rynson W. H. Lau 134 480 0 15 Mar 2023