Encoding word order in complex embeddings

27 December 2019

Papers citing "Encoding word order in complex embeddings"

21 / 21 papers shown

Title
Comply: Learning Sentences with Complex Weights inspired by Fruit Fly Olfaction Alexei Figueroa Justus Westerhoff Golzar Atefi Dennis Fast B. Winter Felix Alexader Gers Alexander Loser Wolfang Nejdl 57 0 0 03 Feb 2025
Building Blocks for a Complex-Valued Transformer Architecture Florian Eilers Xiaoyi Jiang ViT 32 7 0 16 Jun 2023
Adapting Pre-trained Language Models for Quantum Natural Language Processing Qiuchi Li Benyou Wang Yudong Zhu Christina Lioma Qun Liu AI4CE 29 4 0 24 Feb 2023
Document-aware Positional Encoding and Linguistic-guided Encoding for Abstractive Multi-document Summarization Congbo Ma Wei Emma Zhang Pitawelayalage Dasun Dileepa Pitawela Yutong Qu Haojie Zhuang Hu Wang 34 3 0 13 Sep 2022
Trading Positional Complexity vs. Deepness in Coordinate Networks Jianqiao Zheng Sameera Ramasinghe Xueqian Li Simon Lucey 31 18 0 18 May 2022
FastRPB: a Scalable Relative Positional Encoding for Long Sequence Tasks Maksim Zubkov Daniil Gavrilov 27 0 0 23 Feb 2022
Learning Positional Embeddings for Coordinate-MLPs Sameera Ramasinghe Simon Lucey 27 10 0 21 Dec 2021
Ultra-high Resolution Image Segmentation via Locality-aware Context Fusion and Alternating Local Enhancement Wenxi Liu Qi Li Xin Lin Weixiang Yang Shengfeng He Yuanlong Yu 29 7 0 06 Sep 2021
Conformer-based End-to-end Speech Recognition With Rotary Position Embedding Shengqiang Li Menglong Xu Xiao-Lei Zhang 18 9 0 13 Jul 2021
Rethinking Positional Encoding Jianqiao Zheng Sameera Ramasinghe Simon Lucey 27 51 0 06 Jul 2021
A Survey of Transformers Tianyang Lin Yuxin Wang Xiangyang Liu Xipeng Qiu ViT 53 1,088 0 08 Jun 2021
Relative Positional Encoding for Transformers with Linear Complexity Antoine Liutkus Ondřej Cífka Shih-Lun Wu Umut Simsekli Yi-Hsuan Yang Gaël Richard 33 44 0 18 May 2021
RoFormer: Enhanced Transformer with Rotary Position Embedding Jianlin Su Yu Lu Shengfeng Pan Ahmed Murtadha Bo Wen Yunfeng Liu 38 2,190 0 20 Apr 2021
Investigating the Limitations of Transformers with Simple Arithmetic Tasks Rodrigo Nogueira Zhiying Jiang Jimmy J. Li LRM 24 123 0 25 Feb 2021
Position Information in Transformers: An Overview Philipp Dufter Martin Schmitt Hinrich Schütze 13 139 0 22 Feb 2021
Multi-Head Self-Attention with Role-Guided Masks Dongsheng Wang Casper Hansen Lucas Chaves Lima Christian B. Hansen Maria Maistro J. Simonsen Christina Lioma 26 1 0 22 Dec 2020
Denmark's Participation in the Search Engine TREC COVID-19 Challenge: Lessons Learned about Searching for Precise Biomedical Scientific Information on COVID-19 Lucas Chaves Lima Casper Hansen Christian B. Hansen Dongsheng Wang Maria Maistro Birger Larsen J. Simonsen Christina Lioma 27 2 0 25 Nov 2020
Neural Proof Nets Konstantinos Kogkalidis M. Moortgat R. Moot 20 11 0 26 Sep 2020
Quantum Language Model with Entanglement Embedding for Question Answering Yiwei Chen Yu Pan D. Dong 36 31 0 23 Aug 2020
Learning to Encode Position for Transformer with Continuous Dynamical Model Xuanqing Liu Hsiang-Fu Yu Inderjit Dhillon Cho-Jui Hsieh 16 107 0 13 Mar 2020
Convolutional Neural Networks for Sentence Classification Yoon Kim AILaw VLM 273 13,368 0 25 Aug 2014