SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processing

19 August 2018

Papers citing "SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processing"

50 / 1,950 papers shown

Title
HYBRIDFORMER: improving SqueezeFormer with hybrid attention and NSR mechanism Yuguang Yang Yu Pan Jingjing Yin Jiangyu Han Lei Ma Heng Lu 48 11 0 15 Mar 2023
Learning Cross-lingual Visual Speech Representations Andreas Zinonos A. Haliassos Pingchuan Ma Stavros Petridis Maja Pantic SSL 48 8 0 14 Mar 2023
Adapting Offline Speech Translation Models for Streaming with Future-Aware Distillation and Inference Biao Fu Minpeng Liao Kai Fan Zhongqiang Huang Boxing Chen Yidong Chen Xiaodon Shi 75 8 0 14 Mar 2023
Scaling Vision-Language Models with Sparse Mixture of Experts Sheng Shen Z. Yao Chunyuan Li Trevor Darrell Kurt Keutzer Yuxiong He VLM MoE 77 68 0 13 Mar 2023
Beyond Single Items: Exploring User Preferences in Item Sets with the Conversational Playlist Curation Dataset Arun Tejasvi Chaganty Megan Leszczynski Shu Zhen Zhang Ravi Ganti K. Balog Filip Radlinski 125 10 0 13 Mar 2023
Proactive Prioritization of App Issues via Contrastive Learning Moghis Fereidouni A. Mosharrof Umar Farooq A.B. Siddique 73 6 0 12 Mar 2023
Unsupervised Language agnostic WER Standardization Satarupa Guha Rahul Ambavat Ankur Gupta Manish Gupta R. Mehta 23 0 0 09 Mar 2023
Spelling convention sensitivity in neural language models Elizabeth Nielsen Christo Kirov Brian Roark 35 1 0 06 Mar 2023
Exploiting Language Relatedness in Machine Translation Through Domain Adaptation Techniques Amit Kumar Rupjyoti Baruah A. Pratap Mayank Swarnkar Anil Kumar Singh 40 1 0 03 Mar 2023
Synthetic Cross-accent Data Augmentation for Automatic Speech Recognition P. Klumpp Pooja Chitkara Leda Sari Prashant Serai Jilong Wu Irina-Elena Veliche Rongqing Huang Qing He 58 4 0 01 Mar 2023
How to DP-fy ML: A Practical Guide to Machine Learning with Differential Privacy Natalia Ponomareva Hussein Hazimeh Alexey Kurakin Zheng Xu Carson E. Denison H. B. McMahan Sergei Vassilvitskii Steve Chien Abhradeep Thakurta 156 183 0 01 Mar 2023
Are More Layers Beneficial to Graph Transformers? Haiteng Zhao Shuming Ma Dongdong Zhang Zhi-Hong Deng Furu Wei 67 14 0 01 Mar 2023
EvoPrompting: Language Models for Code-Level Neural Architecture Search Angelica Chen David Dohan David R. So VLM LRM 118 91 0 28 Feb 2023
A Token-Wise Beam Search Algorithm for RNN-T Gil Keren 71 3 0 28 Feb 2023
Vid2Seq: Large-Scale Pretraining of a Visual Language Model for Dense Video Captioning Antoine Yang Arsha Nagrani Paul Hongsuck Seo Antoine Miech Jordi Pont-Tuset Ivan Laptev Josef Sivic Cordelia Schmid AI4TS VLM 173 241 0 27 Feb 2023
Language Is Not All You Need: Aligning Perception with Language Models Shaohan Huang Li Dong Wenhui Wang Y. Hao Saksham Singhal ... Johan Bjorck Vishrav Chaudhary Subhojit Som Xia Song Furu Wei VLM LRM MLLM 137 566 0 27 Feb 2023
LLaMA: Open and Efficient Foundation Language Models Hugo Touvron Thibaut Lavril Gautier Izacard Xavier Martinet Marie-Anne Lachaux ... Faisal Azhar Aurelien Rodriguez Armand Joulin Edouard Grave Guillaume Lample ALM PILM 1.6K 13,533 0 27 Feb 2023
MoLE : Mixture of Language Experts for Multi-Lingual Automatic Speech Recognition Yoohwan Kwon Soo-Whan Chung MoE 81 18 0 27 Feb 2023
Deep Visual Forced Alignment: Learning to Align Transcription with Talking Face Video Minsu Kim Chae Won Kim Y. Ro CVBM DiffM 78 3 0 27 Feb 2023
Elementwise Language Representation Du-Yeong Kim Jeeeun Kim 67 0 0 27 Feb 2023
Improving Massively Multilingual ASR With Auxiliary CTC Objectives William Chen Brian Yan Jiatong Shi Yifan Peng Soumi Maiti Shinji Watanabe 91 40 0 24 Feb 2023
Cross-Lingual Transfer of Cognitive Processing Complexity C. Pouw Nora Hollenstein Lisa Beinborn 99 3 0 24 Feb 2023
Impact of Subword Pooling Strategy on Cross-lingual Event Detection Shantanu Agarwal Steven Fincke Chris Jenkins Scott Miller Elizabeth Boschee 71 2 0 22 Feb 2023
Gradient Remedy for Multi-Task Learning in End-to-End Noise-Robust Speech Recognition Yuchen Hu Chen Chen Ruizhe Li Qiu-shi Zhu Eng Siong Chng 91 15 0 22 Feb 2023
Topic-switch adapted Japanese Dialogue System based on PLATO-2 Donghuo Zeng Jianming Wu Yanan Wang Kazunori Matsumoto Gen Hattori K. Ikeda 76 0 0 22 Feb 2023
Learning to Play Text-based Adventure Games with Maximum Entropy Reinforcement Learning Weichen Li R. Devidze Sophie Fellenz 132 3 0 21 Feb 2023
Deep Transformers without Shortcuts: Modifying Self-attention for Faithful Signal Propagation Bobby He James Martens Guodong Zhang Aleksandar Botev Andy Brock Samuel L. Smith Yee Whye Teh 85 30 0 20 Feb 2023
Zero and Few-Shot Localization of Task-Oriented Dialogue Agents with a Distilled Representation M. Moradshahi Sina J. Semnani M. Lam 66 7 0 18 Feb 2023
RETVec: Resilient and Efficient Text Vectorizer Elie Bursztein Marina Zhang Owen Vallis Xinyu Jia Alexey Kurakin VLM 82 4 0 18 Feb 2023
Entry Separation using a Mixed Visual and Textual Language Model: Application to 19th century French Trade Directories Bertrand Duménieu Edwin Carlinet N. Abadie Joseph Chazalon 54 0 0 17 Feb 2023
Lip-to-Speech Synthesis in the Wild with Multi-task Learning Minsu Kim Joanna Hong Y. Ro 101 24 0 17 Feb 2023
E2E Spoken Entity Extraction for Virtual Agents Karan Singla Yeon-Jun Kim S. Bangalore 73 1 0 16 Feb 2023
Meeting the Needs of Low-Resource Languages: The Value of Automatic Alignments via Pretrained Models Abteen Ebrahimi Arya D. McCarthy Arturo Oncevay Luis Chiruzzo J. Ortega Gustavo A. Giménez-Lugo Rolando A. Coto Solano Katharina Kann 70 6 0 15 Feb 2023
Scaling Vision Transformers to 22 Billion Parameters Mostafa Dehghani Josip Djolonga Basil Mustafa Piotr Padlewski Jonathan Heek ... Mario Luvcić Xiaohua Zhai Daniel Keysers Jeremiah Harmsen N. Houlsby MLLM 184 613 0 10 Feb 2023
PATCorrect: Non-autoregressive Phoneme-augmented Transformer for ASR Error Correction Zi Xuan Zhang Zhehui Wang R. Kamma S. Eswaran Narayanan Sadagopan KELM 64 5 0 10 Feb 2023
Language-Aware Multilingual Machine Translation with Self-Supervised Learning Haoran Xu Jean Maillard Vedanuj Goswami LRM 64 4 0 10 Feb 2023
AutoNMT: A Framework to Streamline the Research of Seq2Seq Models Salvador Carrión F. Casacuberta 47 2 0 09 Feb 2023
Measuring The Impact Of Programming Language Distribution Gabriel Orlanski Kefan Xiao Xavier Garcia Jeffrey Hui Joshua Howland J. Malmaud Jacob Austin Rishah Singh Michele Catasta 167 33 0 03 Feb 2023
The unreasonable effectiveness of few-shot learning for machine translation Xavier Garcia Yamini Bansal Colin Cherry George F. Foster M. Krikun Fan Feng Melvin Johnson Orhan Firat 115 108 0 02 Feb 2023
KNNs of Semantic Encodings for Rating Prediction Leo Laugier Raghuram Vadapalli Thomas Bonald Lucas Dixon 22 2 0 01 Feb 2023
Adaptive Machine Translation with Large Language Models Yasmin Moslem Rejwanul Haque John D. Kelleher Andy Way AI4CE 87 82 0 30 Jan 2023
Adaptive Computation with Elastic Input Sequence Fuzhao Xue Valerii Likhosherstov Anurag Arnab N. Houlsby Mostafa Dehghani Yang You 92 21 0 30 Jan 2023
Pre-training for Speech Translation: CTC Meets Optimal Transport Hang Le Hongyu Gong Changhan Wang J. Pino Benjamin Lecouteux D. Schwab OT 102 26 0 27 Jan 2023
Open Problems in Applied Deep Learning M. Raissi AI4CE 115 2 0 26 Jan 2023
XLM-V: Overcoming the Vocabulary Bottleneck in Multilingual Masked Language Models Davis Liang Hila Gonen Yuning Mao Rui Hou Naman Goyal Marjan Ghazvininejad Luke Zettlemoyer Madian Khabsa 87 80 0 25 Jan 2023
Ensemble Transfer Learning for Multilingual Coreference Resolution T. Lai Heng Ji 43 1 0 22 Jan 2023
REDAffectiveLM: Leveraging Affect Enriched Embedding and Transformer-based Neural Language Model for Readers' Emotion Detection Anoop Kadan Deepak P Manjary P.Gangan Savitha Sam Abraham L. LajishV. 117 1 0 21 Jan 2023
Language Agnostic Data-Driven Inverse Text Normalization Szu-Jui Chen Debjyoti Paul Yutong Pang Peng Su Xuedong Zhang 31 0 0 20 Jan 2023
BayesSpeech: A Bayesian Transformer Network for Automatic Speech Recognition Will Rieger BDL UQCV 41 0 0 16 Jan 2023
Using External Off-Policy Speech-To-Text Mappings in Contextual End-To-End Automated Speech Recognition David M. Chan Shalini Ghosh Ariya Rastrow Björn Hoffmeister OffRL 76 6 0 06 Jan 2023