Towards Incremental Transformers: An Empirical Analysis of Transformer
Models for Incremental NLU

v1v2 (latest)

Towards Incremental Transformers: An Empirical Analysis of Transformer Models for Incremental NLU

15 September 2021

Patrick Kahardipraja

Brielen Madureira

David Schlangen

ArXiv (abs)PDF HTML

Papers citing "Towards Incremental Transformers: An Empirical Analysis of Transformer Models for Incremental NLU"

7 / 7 papers shown

Title
Finetuning Pretrained Transformers into RNNs Jungo Kasai Hao Peng Yizhe Zhang Dani Yogatama Gabriel Ilharco Nikolaos Pappas Yi Mao Weizhu Chen Noah A. Smith 91 67 0 24 Mar 2021
Future-Guided Incremental Transformer for Simultaneous Translation Shaolei Zhang Yang Feng Liangyou Li CLL 64 42 0 23 Dec 2020
Rethinking Attention with Performers K. Choromanski Valerii Likhosherstov David Dohan Xingyou Song Andreea Gane ... Afroz Mohiuddin Lukasz Kaiser David Belanger Lucy J. Colwell Adrian Weller 186 1,600 0 30 Sep 2020
Transformers are RNNs: Fast Autoregressive Transformers with Linear Attention Angelos Katharopoulos Apoorv Vyas Nikolaos Pappas Franccois Fleuret 203 1,786 0 29 Jun 2020
A Novel Bi-directional Interrelated Model for Joint Intent Detection and Slot Filling Haihong E Peiqing Niu Zhongfu Chen Meina Song 49 242 0 30 Jun 2019
Snips Voice Platform: an embedded Spoken Language Understanding system for private-by-design voice interfaces A. Coucke Alaa Saade Adrien Ball Théodore Bluche A. Caulier ... Thibault Gisselbrecht F. Caltagirone Thibaut Lavril Maël Primet Joseph Dureau SyDa 115 827 0 25 May 2018
Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs) Djork-Arné Clevert Thomas Unterthiner Sepp Hochreiter 305 5,534 0 23 Nov 2015

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.