SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processing

19 August 2018

Papers citing "SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processing"

50 / 1,950 papers shown

Title
Leveraging Lead Bias for Zero-shot Abstractive News Summarization Chenguang Zhu Ziyi Yang R. Gmyr Michael Zeng Xuedong Huang 60 19 0 25 Dec 2019
BERTje: A Dutch BERT Model Wietse de Vries Andreas van Cranenburgh Arianna Bisazza Tommaso Caselli Gertjan van Noord Malvina Nissim VLM SSeg 95 295 0 19 Dec 2019
Multilingual is not enough: BERT for Finnish Antti Virtanen Jenna Kanerva Rami Ilo Jouni Luoma Juhani Luotolahti T. Salakoski Filip Ginter S. Pyysalo 88 281 0 15 Dec 2019
Personalized Patent Claim Generation and Measurement Jieh-Sheng Lee 22 4 0 07 Dec 2019
Neural Machine Translation: A Review and Survey Felix Stahlberg 3DV AI4TS MedIm 131 332 0 04 Dec 2019
Using Sequence-to-Sequence Learning for Repairing C Vulnerabilities Zimin Chen Steve Kommrusch Monperrus Martin 33 5 0 04 Dec 2019
Leveraging Contextual Embeddings for Detecting Diachronic Semantic Shift Matej Martinc Petra Kralj Novak Senja Pollak 70 72 0 02 Dec 2019
Fiction Sentence Expansion and Enhancement via Focused Objective and Novelty Curve Sampling Yuri Safovich A. Azaria 58 7 0 02 Dec 2019
Jejueo Datasets for Machine Translation and Speech Synthesis Kyubyong Park Yo Joong Choe Jiyeon Ham 19 5 0 27 Nov 2019
Simultaneous Neural Machine Translation using Connectionist Temporal Classification Katsuki Chousa Katsuhito Sudoh Satoshi Nakamura 38 5 0 27 Nov 2019
JParaCrawl: A Large Scale Web-Based English-Japanese Parallel Corpus Makoto Morishita Jun Suzuki Masaaki Nagata LRM 100 67 0 25 Nov 2019
End-to-end ASR: from Supervised to Semi-Supervised Learning with Modern Architectures Gabriel Synnaeve Qiantong Xu Jacob Kahn Tatiana Likhomanenko Edouard Grave Vineel Pratap Anuroop Sriram Vitaliy Liptchinsky R. Collobert SSL AI4TS 134 248 0 19 Nov 2019
The Eighth Dialog System Technology Challenge Seokhwan Kim Michel Galley Chulaka Gunasekara Sungjin Lee Adam Atkinson ... Tim K. Marks Abhinav Rastogi Xiaoxue Zang Srinivas Sunkara Raghav Gupta VLM 71 65 0 14 Nov 2019
CCMatrix: Mining Billions of High-Quality Parallel Sentences on the WEB Holger Schwenk Guillaume Wenzek Sergey Edunov Edouard Grave Armand Joulin 96 263 0 10 Nov 2019
A Bilingual Generative Transformer for Semantic Sentence Embedding John Wieting Graham Neubig Taylor Berg-Kirkpatrick 69 29 0 10 Nov 2019
CamemBERT: a Tasty French Language Model Louis Martin Benjamin Muller Pedro Ortiz Suarez Yoann Dupont Laurent Romary Eric Villemonte de la Clergerie Djamé Seddah Benoît Sagot 134 981 0 10 Nov 2019
CCAligned: A Massive Collection of Cross-Lingual Web-Document Pairs Ahmed El-Kishky Vishrav Chaudhary Francisco Guzman Philipp Koehn 112 200 0 10 Nov 2019
Enforcing Encoder-Decoder Modularity in Sequence-to-Sequence Models Siddharth Dalmia Abdel-rahman Mohamed M. Lewis Florian Metze Luke Zettlemoyer 55 11 0 09 Nov 2019
A Simplified Fully Quantized Transformer for End-to-end Speech Recognition Alex Bie Bharat Venkitesh João Monteiro Md. Akmal Haidar Mehdi Rezagholizadeh MQ 139 27 0 09 Nov 2019
Unsupervised Cross-lingual Representation Learning at Scale Alexis Conneau Kartikay Khandelwal Naman Goyal Vishrav Chaudhary Guillaume Wenzek Francisco Guzmán Edouard Grave Myle Ott Luke Zettlemoyer Veselin Stoyanov 230 6,614 0 05 Nov 2019
RNN-T For Latency Controlled ASR With Improved Beam Search Mahaveer Jain Kjell Schubert Jay Mahadeokar Ching-Feng Yeh Kaustubh Kalgaonkar Anuroop Sriram Christian Fuegen M. Seltzer 80 45 0 05 Nov 2019
Machine Translation of Restaurant Reviews: New Corpus for Domain Adaptation and Robustness Alexandre Berard Ioan Calapodescu Marc Dymetman Claude Roux Jean-Luc Meunier Vassilina Nikoulina 79 27 0 31 Oct 2019
Naver Labs Europe's Systems for the Document-Level Generation and Translation Task at WNGT 2019 Fahimeh Saleh Alexandre Berard Ioan Calapodescu Laurent Besacier VLM 58 14 0 31 Oct 2019
Fill in the Blanks: Imputing Missing Sentences for Larger-Context Neural Machine Translation Sébastien Jean Ankur Bapna Orhan Firat 73 7 0 30 Oct 2019
Transformer-based Cascaded Multimodal Speech Translation Zixiu "Alex" Wu Ozan Caglayan Julia Ive Josiah Wang Lucia Specia 53 7 0 29 Oct 2019
Big Bidirectional Insertion Representations for Documents Lala Li William Chan 42 4 0 29 Oct 2019
Transformer-Transducer: End-to-End Speech Recognition with Self-Attention Ching-Feng Yeh Jay Mahadeokar Kaustubh Kalgaonkar Yongqiang Wang Duc Le Mahaveer Jain Kjell Schubert Christian Fuegen M. Seltzer 95 150 0 28 Oct 2019
Evaluating Lottery Tickets Under Distributional Shifts Shrey Desai Hongyuan Zhan Ahmed Aly UQCV OOD 81 41 0 28 Oct 2019
Modeling Inter-Speaker Relationship in XLNet for Contextual Spoken Language Understanding Jonggu Kim Jong-Hyeok Lee 18 1 0 28 Oct 2019
Training ASR models by Generation of Contextual Information Kritika Singh Dmytro Okhonko Jun Liu Yongqiang Wang Frank Zhang ... Sergey Edunov Fuchun Peng Yatharth Saraf Geoffrey Zweig Abdel-rahman Mohamed 61 7 0 27 Oct 2019
On the Cross-lingual Transferability of Monolingual Representations Mikel Artetxe Sebastian Ruder Dani Yogatama 234 801 0 25 Oct 2019
Exploring Lexicon-Free Modeling Units for End-to-End Korean and Korean-English Code-Switching Speech Recognition Jisung Wang Jihwan Kim Sangki Kim Yeha Lee 48 5 0 25 Oct 2019
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer Colin Raffel Noam M. Shazeer Adam Roberts Katherine Lee Sharan Narang Michael Matena Yanqi Zhou Wei Li Peter J. Liu AIMat 560 20,418 0 23 Oct 2019
Sticking to the Facts: Confident Decoding for Faithful Data-to-Text Generation Ran Tian Shashi Narayan Thibault Sellam Ankur P. Parikh HILM 110 96 0 19 Oct 2019
End-to-End Speech Recognition: A review for the French Language Florian Boyer Jean-Luc Rouas AI4TS 60 10 0 18 Oct 2019
Using Whole Document Context in Neural Machine Translation Valentin Macé Christophe Servan 58 27 0 16 Oct 2019
Facebook AI's WAT19 Myanmar-English Translation Task Submission Peng-Jen Chen Jiajun Shen Matt Le Vishrav Chaudhary Ahmed El-Kishky Guillaume Wenzek Myle Ott MarcÁurelio Ranzato 38 29 0 15 Oct 2019
Novel Applications of Factored Neural Machine Translation P. Wilken E. Matusov AAML 57 13 0 09 Oct 2019
On Leveraging the Visual Modality for Neural Machine Translation Vikas Raunak Sang Keun Choe Quanyang Lu Yi Xu Florian Metze 35 11 0 07 Oct 2019
Controllable Sentence Simplification Louis Martin Benoît Sagot Eric Villemonte de la Clergerie Antoine Bordes 81 147 0 07 Oct 2019
Improving Word Embedding Factorization for Compression Using Distilled Nonlinear Neural Decomposition Vasileios Lioutas Ahmad Rashid Krtin Kumar Md. Akmal Haidar Mehdi Rezagholizadeh 75 9 0 02 Oct 2019
Simple and Effective Paraphrastic Similarity from Parallel Translations John Wieting Kevin Gimpel Graham Neubig Taylor Berg-Kirkpatrick 87 49 0 30 Sep 2019
The Source-Target Domain Mismatch Problem in Machine Translation Jiajun Shen Peng-Jen Chen Matt Le Junxian He Jiatao Gu Myle Ott Michael Auli MarcÁurelio Ranzato 68 26 0 28 Sep 2019
ALBERT: A Lite BERT for Self-supervised Learning of Language Representations Zhenzhong Lan Mingda Chen Sebastian Goodman Kevin Gimpel Piyush Sharma Radu Soricut SSL AIMat 411 6,479 0 26 Sep 2019
Portuguese Named Entity Recognition using BERT-CRF Fábio Souza Rodrigo Nogueira R. Lotufo 73 258 0 23 Sep 2019
Self-Training for End-to-End Speech Recognition Jacob Kahn Ann Lee Awni Y. Hannun SSL 65 236 0 19 Sep 2019
Simple, Scalable Adaptation for Neural Machine Translation Ankur Bapna N. Arivazhagan Orhan Firat AI4CE 121 417 0 18 Sep 2019
Harnessing Indirect Training Data for End-to-End Automatic Speech Translation: Tricks of the Trade J. Pino Liezl Puzon Jiatao Gu Xutai Ma Arya D. McCarthy D. Gopinath 25 3 0 14 Sep 2019
A Comparative Study on Transformer vs RNN in Speech Applications Shigeki Karita Nanxin Chen Tomoki Hayashi Takaaki Hori Hirofumi Inaguma ... Ryuichi Yamamoto Xiao-fei Wang Shinji Watanabe Takenori Yoshimura Wangyou Zhang 92 722 0 13 Sep 2019
Interactive Fiction Games: A Colossal Adventure Matthew J. Hausknecht Prithviraj Ammanabrolu Marc-Alexandre Côté Xingdi Yuan LLMAG LM&Ro AI4CE 80 197 0 11 Sep 2019