Subword Regularization: Improving Neural Network Translation Models with Multiple Subword Candidates

29 April 2018

Papers citing "Subword Regularization: Improving Neural Network Translation Models with Multiple Subword Candidates"

50 / 628 papers shown

Title
From Words to Music: A Study of Subword Tokenization Techniques in Symbolic Music Generation Adarsh Kumar Pedro Sarmento 71 4 0 18 Apr 2023
Dual-Attention Neural Transducers for Efficient Wake Word Spotting in Speech Recognition Saumya Yashmohini Sahai Jing Liu Thejaswi Muniyappa Kanthashree Mysore Sathyendra Anastasios Alexandridis ... Ross McGowan Ariya Rastrow Feng-Ju Chang Athanasios Mouchtaris Siegfried Kunzmann 74 5 0 03 Apr 2023
Vision Transformers with Mixed-Resolution Tokenization Tomer Ronen Omer Levy A. Golbert ViT 87 21 0 01 Apr 2023
Dialog act guided contextual adapter for personalized speech recognition Feng-Ju Chang Thejaswi Muniyappa Kanthashree Mysore Sathyendra Kailin Wei Grant P. Strimel Ross McGowan 53 5 0 31 Mar 2023
BloombergGPT: A Large Language Model for Finance Shijie Wu Ozan Irsoy Steven Lu Vadim Dabravolski Mark Dredze Sebastian Gehrmann P. Kambadur David S. Rosenberg Gideon Mann AIFin 248 855 0 30 Mar 2023
SynthVSR: Scaling Up Visual Speech Recognition With Synthetic Supervision Xubo Liu Egor Lakomkin Konstantinos Vougioukas Pingchuan Ma Honglie Chen ... Niko Moritz J. Kolár Stavros Petridis Maja Pantic Christian Fuegen 128 19 0 30 Mar 2023
TreePiece: Faster Semantic Parsing via Tree Tokenization Sida I. Wang Akshat Shrivastava S. Livshits 61 5 0 30 Mar 2023
Exploring Natural Language Processing Methods for Interactive Behaviour Modelling Guanhua Zhang Matteo Bortoletto Zhiming Hu Lei Shi Mihai Bâce Andreas Bulling 44 3 0 28 Mar 2023
Auto-AVSR: Audio-Visual Speech Recognition with Automatic Labels Pingchuan Ma A. Haliassos Adriana Fernandez-Lopez Honglie Chen Stavros Petridis Maja Pantic 94 115 0 25 Mar 2023
SwissBERT: The Multilingual Language Model for Switzerland Jannis Vamvas Johannes Graen Rico Sennrich 81 7 0 23 Mar 2023
Language Model Behavior: A Comprehensive Survey Tyler A. Chang Benjamin Bergen VLM LRM LM&MA 115 109 0 20 Mar 2023
On-the-fly Text Retrieval for End-to-End ASR Adaptation Bolaji Yusuf Aditya Gourav Ankur Gandhe I. Bulyko KELM RALM 72 4 0 20 Mar 2023
An Overview on Language Models: Recent Developments and Outlook Chengwei Wei Yun Cheng Wang Bin Wang C.-C. Jay Kuo 93 47 0 10 Mar 2023
The BigScience ROOTS Corpus: A 1.6TB Composite Multilingual Dataset Hugo Laurenccon Lucile Saulnier Thomas Wang Christopher Akiki Albert Villanova del Moral ... Violette Lepercq Suzana Ilić Margaret Mitchell Sasha Luccioni Yacine Jernite AI4CE AILaw 75 169 0 07 Mar 2023
Practice of the conformer enhanced AUDIO-VISUAL HUBERT on Mandarin and English Xiaoming Ren Chao Li Shenjian Wang Biao Li 56 0 0 28 Feb 2023
UML: A Universal Monolingual Output Layer for Multilingual ASR Chaoyang Zhang Yue Liu Tara N. Sainath Trevor Strohman Shuo-yiin Chang 73 7 0 22 Feb 2023
Scaling Laws for Multilingual Neural Machine Translation Patrick Fernandes Behrooz Ghorbani Xavier Garcia Markus Freitag Orhan Firat 109 30 0 19 Feb 2023
Transformadores: Fundamentos teoricos y Aplicaciones J. D. L. Torre 171 0 0 18 Feb 2023
AV-data2vec: Self-supervised Learning of Audio-Visual Speech Representations with Contextualized Target Representations Jiachen Lian Alexei Baevski Wei-Ning Hsu Michael Auli SSL 150 34 0 10 Feb 2023
Training-free Lexical Backdoor Attacks on Language Models Yujin Huang Terry Yue Zhuo Xingliang Yuan Han Hu Lizhen Qu Chunyang Chen SILM 97 46 0 08 Feb 2023
Efficiently Upgrading Multilingual Machine Translation Models to Support More Languages Simeng Sun Maha Elbayad Anna Y. Sun James Cross CLL LRM 93 3 0 07 Feb 2023
Byte Pair Encoding for Symbolic Music Nathan Fradet Nicolas Gutowski F. Chhel Jean-Pierre Briot 70 17 0 27 Jan 2023
Talk the Walk: Synthetic Data Generation for Conversational Music Recommendation Megan Leszczynski Shu Zhen Zhang Ravi Ganti K. Balog Filip Radlinski Fernando Pereira Arun Tejasvi Chaganty 80 8 0 27 Jan 2023
Open Problems in Applied Deep Learning M. Raissi AI4CE 115 2 0 26 Jan 2023
HIT-SCIR at MMNLU-22: Consistency Regularization for Multilingual Spoken Language Understanding Bo Zheng Zhouyang Li Fuxuan Wei Qiguang Chen Libo Qin Wanxiang Che 47 4 0 05 Jan 2023
Memory Augmented Lookup Dictionary based Language Modeling for Automatic Speech Recognition Yukun Feng Ming Tu Rui Xia Chuanzeng Huang Yuxuan Wang RALM 86 0 0 30 Dec 2022
Macro-block dropout for improved regularization in training end-to-end speech recognition models Chanwoo Kim Sathish Indurti Jinhwan Park Wonyong Sung 56 0 0 29 Dec 2022
Cramming: Training a Language Model on a Single GPU in One Day Jonas Geiping Tom Goldstein MoE 117 91 0 28 Dec 2022
What Makes for Good Tokenizers in Vision Transformer? Shengju Qian Yi Zhu Wenbo Li Mu Li Jiaya Jia ViT 91 14 0 21 Dec 2022
Tokenization Consistency Matters for Generative Models on Extractive NLP Tasks Kaiser Sun Peng Qi Yuhao Zhang Lan Liu William Yang Wang Zhiheng Huang 80 9 0 19 Dec 2022
Inducing Character-level Structure in Subword-based Language Models with Type-level Interchange Intervention Training Jing-ling Huang Zhengxuan Wu Kyle Mahowald Christopher Potts 83 14 0 19 Dec 2022
UnitY: Two-pass Direct Speech-to-speech Translation with Discrete Units Hirofumi Inaguma Sravya Popuri Ilia Kulikov Peng-Jen Chen Changhan Wang Yu-An Chung Yun Tang Ann Lee Shinji Watanabe J. Pino 119 61 0 15 Dec 2022
MANTa: Efficient Gradient-Based Tokenization for Robust End-to-End Language Modeling Nathan Godey Roman Castagné Eric Villemonte de la Clergerie Benoît Sagot 45 3 0 14 Dec 2022
ERNIE-Code: Beyond English-Centric Cross-lingual Pretraining for Programming Languages Yekun Chai Shuohuan Wang Chao Pang Yu Sun Hao Tian Hua Wu 93 38 0 13 Dec 2022
Democratizing Neural Machine Translation with OPUS-MT Jörg Tiedemann Mikko Aulamo Daria Bakshandaeva M. Boggia Stig-Arne Gronroos Tommi Nieminen Alessandro Raganato Yves Scherrer Raúl Vázquez Sami Virpioja 124 32 0 04 Dec 2022
Extending the Subwording Model of Multilingual Pretrained Models for New Languages K. Imamura Eiichiro Sumita VLM 87 3 0 29 Nov 2022
Continuous diffusion for categorical data Sander Dieleman Laurent Sartran Arman Roshannai Nikolay Savinov Yaroslav Ganin ... Conor Durkan Curtis Hawthorne Rémi Leblond Will Grathwohl J. Adler DiffM 121 106 0 28 Nov 2022
Breaking the Representation Bottleneck of Chinese Characters: Neural Machine Translation with Stroke Sequence Modeling Zhijun Wang Xuebo Liu Min Zhang 132 11 0 23 Nov 2022
Pragmatic Constraint on Distributional Semantics Elizaveta Zhemchuzhina Nikolai Filippov Ivan P. Yamshchikov 16 0 0 20 Nov 2022
CoLI-Machine Learning Approaches for Code-mixed Language Identification at the Word Level in Kannada-English Texts H. Shashirekha F. Balouchzahi M. D. Anusha G. Sidorov 69 15 0 17 Nov 2022
Efficient Transformers with Dynamic Token Pooling Piotr Nawrot J. Chorowski Adrian Lañcucki Edoardo Ponti 83 46 0 17 Nov 2022
AutoTemplate: A Simple Recipe for Lexically Constrained Text Generation Hayate Iso 83 8 0 15 Nov 2022
Massively Multilingual ASR on 70 Languages: Tokenization, Architecture, and Generalization Capabilities Andros Tjandra Nayan Singhal David C. Zhang Ozlem Kalinli Abdel-rahman Mohamed Duc Le M. Seltzer 99 13 0 10 Nov 2022
Streaming Audio-Visual Speech Recognition with Alignment Regularization Pingchuan Ma Niko Moritz Stavros Petridis Christian Fuegen Maja Pantic 64 2 0 03 Nov 2022
Probing Statistical Representations For End-To-End ASR A. Ollerenshaw Md. Asif Jalal Thomas Hain 55 2 0 03 Nov 2022
Phonetic-assisted Multi-Target Units Modeling for Improving Conformer-Transducer ASR system Li Li Dongxing Xu Haoran Wei Yanhua Long 105 2 0 03 Nov 2022
Factorized Blank Thresholding for Improved Runtime Efficiency of Neural Transducers Duc Le Frank Seide Yuhao Wang Yongbin Li Kjell Schubert Ozlem Kalinli M. Seltzer 66 6 0 02 Nov 2022
InterMPL: Momentum Pseudo-Labeling with Intermediate CTC Loss Yosuke Higuchi Tetsuji Ogawa Tetsunori Kobayashi Shinji Watanabe 74 1 0 02 Nov 2022
BECTRA: Transducer-based End-to-End ASR with BERT-Enhanced Encoder Yosuke Higuchi Tetsuji Ogawa Tetsunori Kobayashi Shinji Watanabe 169 13 0 02 Nov 2022
BERT Meets CTC: New Formulation of End-to-End Speech Recognition with Pre-trained Masked Language Model Yosuke Higuchi Brian Yan Siddhant Arora Tetsuji Ogawa Tetsunori Kobayashi Shinji Watanabe 118 26 0 29 Oct 2022