Understanding Self-attention Mechanism via Dynamical System Perspective

19 August 2023

Papers citing "Understanding Self-attention Mechanism via Dynamical System Perspective"

8 / 8 papers shown

Title
CurveFormer++: 3D Lane Detection by Curve Propagation with Temporal Curve Queries and Attention Yifeng Bai Zhirong Chen Pengpeng Liang Erkang Cheng Erkang Cheng ViT 36 8 0 09 Feb 2024
Deep spatial context: when attention-based models meet spatial regression Paulina Tomaszewska El.zbieta Sienkiewicz Mai P. Hoang Przemysław Biecek 19 1 0 18 Jan 2024
A Generic Shared Attention Mechanism for Various Backbone Neural Networks Zhongzhan Huang Senwei Liang Mingfu Liang Liang Lin 39 6 0 27 Oct 2022
Switchable Self-attention Module Shan Zhong Wushao Wen Jinghui Qin 31 7 0 13 Sep 2022
MLP-Mixer: An all-MLP Architecture for Vision Ilya O. Tolstikhin N. Houlsby Alexander Kolesnikov Lucas Beyer Xiaohua Zhai ... Andreas Steiner Daniel Keysers Jakob Uszkoreit Mario Lucic Alexey Dosovitskiy 271 2,603 0 04 May 2021
Visformer: The Vision-friendly Transformer Zhengsu Chen Lingxi Xie Jianwei Niu Xuefeng Liu Longhui Wei Qi Tian ViT 120 209 0 26 Apr 2021
Symplectic Recurrent Neural Networks Zhengdao Chen Jianyu Zhang Martín Arjovsky Léon Bottou 149 220 0 29 Sep 2019
Aggregated Residual Transformations for Deep Neural Networks Saining Xie Ross B. Girshick Piotr Dollár Z. Tu Kaiming He 297 10,220 0 16 Nov 2016