Learning to Encode Position for Transformer with Continuous Dynamical Model

13 March 2020

Inderjit Dhillon

Papers citing "Learning to Encode Position for Transformer with Continuous Dynamical Model"

21 / 21 papers shown

Title
POET: Prompt Offset Tuning for Continual Human Action Adaptation Prachi Garg Joseph K J V. Balasubramanian Necati Cihan Camgöz Chengde Wan Kenrick Kin Weiguang Si Shugao Ma Fernando de la Torre 66 0 0 25 Apr 2025
Key-value memory in the brain Samuel J. Gershman Ila Fiete Kazuki Irie 34 7 0 06 Jan 2025
Ex3: Automatic Novel Writing by Extracting, Excelsior and Expanding Lei Huang Jiaming Guo Guanhua He Xishan Zhang Rui Zhang Shaohui Peng Shaoli Liu Tianshi Chen 31 2 0 16 Aug 2024
AnyPose: Anytime 3D Human Pose Forecasting via Neural Ordinary Differential Equations Zixing Wang A. H. Qureshi 3DH 22 1 0 09 Sep 2023
Neural Delay Differential Equations: System Reconstruction and Image Classification Qunxi Zhu Yao Guo Wei Lin 22 31 0 11 Apr 2023
Encoding Sentence Position in Context-Aware Neural Machine Translation with Concatenation Lorenzo Lupo Marco Dinarelli Laurent Besacier 31 9 0 13 Feb 2023
PulseImpute: A Novel Benchmark Task for Pulsative Physiological Signal Imputation Maxwell A. Xu Alexander Moreno Supriya Nagesh V. Aydemir D. Wetter Santosh Kumar James M. Rehg AI4TS 24 7 0 14 Dec 2022
Sequence and Circle: Exploring the Relationship Between Patches Zhengyang Yu Jochen Triesch ViT 25 0 0 18 Oct 2022
Learning Object Placement via Dual-path Graph Completion Siyuan Zhou Liu Liu Li Niu Liqing Zhang 33 24 0 23 Jul 2022
Multi-branch Cascaded Swin Transformers with Attention to k-space Sampling Pattern for Accelerated MRI Reconstruction Mevan Ekanayake Kamlesh Pawar Mehrtash Harandi Gary Egan Zhaolin Chen ViT MedIm 24 7 0 18 Jul 2022
Trading Positional Complexity vs. Deepness in Coordinate Networks Jianqiao Zheng Sameera Ramasinghe Xueqian Li Simon Lucey 28 18 0 18 May 2022
Attention Mechanism in Neural Networks: Where it Comes and Where it Goes Derya Soydaner 3DV 44 149 0 27 Apr 2022
Learning Positional Embeddings for Coordinate-MLPs Sameera Ramasinghe Simon Lucey 27 10 0 21 Dec 2021
PESTO: Switching Point based Dynamic and Relative Positional Encoding for Code-Mixed Languages Mohsin Ali K. S. Teja Sumanth Manduru Parth Patwa Amitava Das 20 3 0 12 Nov 2021
Conformer-based End-to-end Speech Recognition With Rotary Position Embedding Shengqiang Li Menglong Xu Xiao-Lei Zhang 18 9 0 13 Jul 2021
A Survey of Transformers Tianyang Lin Yuxin Wang Xiangyang Liu Xipeng Qiu ViT 50 1,088 0 08 Jun 2021
Relative Positional Encoding for Transformers with Linear Complexity Antoine Liutkus Ondřej Cífka Shih-Lun Wu Umut Simsekli Yi-Hsuan Yang Gaël Richard 33 44 0 18 May 2021
Hierarchical RNNs-Based Transformers MADDPG for Mixed Cooperative-Competitive Environments Xiaolong Wei Lifang Yang Xianglin Huang Gang Cao Zhulin Tao Zhengyang Du Jing An 29 6 0 11 May 2021
RoFormer: Enhanced Transformer with Rotary Position Embedding Jianlin Su Yu Lu Shengfeng Pan Ahmed Murtadha Bo Wen Yunfeng Liu 38 2,176 0 20 Apr 2021
SAPE: Spatially-Adaptive Progressive Encoding for Neural Optimization Amir Hertz Or Perel Raja Giryes O. Sorkine-Hornung Daniel Cohen-Or 28 67 0 19 Apr 2021
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 297 6,959 0 20 Apr 2018