Neural Lattice Language Models

Neural Lattice Language Models

13 March 2018

Graham Neubig

ArXiv (abs)PDF HTML

Papers citing "Neural Lattice Language Models"

18 / 18 papers shown

Title
Where is the signal in tokenization space? Renato Lui Geh Honghua Zhang Kareem Ahmed Benjie Wang Guy Van den Broeck 74 7 0 16 Aug 2024
Enhance Robustness of Language Models Against Variation Attack through Graph Integration Ziteng Xiong Lizhi Qing Yangyang Kang Jiawei Liu Hongsong Li Changlong Sun Xiaozhong Liu Wei Lu 59 2 0 18 Apr 2024
LatticeGen: A Cooperative Framework which Hides Generated Text in a Lattice for Privacy-Aware Generation on Cloud Mengke Zhang Tianxing He Tianle Wang Lu Mi Fatemehsadat Mireshghallah Binyi Chen Hao Wang Yulia Tsvetkov 75 0 0 29 Sep 2023
Should you marginalize over possible tokenizations? Nadezhda Chirkova Germán Kruszewski Jos Rozen Marc Dymetman 94 12 0 30 Jun 2023
Between words and characters: A Brief History of Open-Vocabulary Modeling and Tokenization in NLP Sabrina J. Mielke Zaid Alyafeai Elizabeth Salesky Colin Raffel Manan Dey ... Arun Raja Chenglei Si Wilson Y. Lee Benoît Sagot Samson Tan 109 151 0 20 Dec 2021
Massive-scale Decoding for Text Generation using Lattices Jiacheng Xu Siddhartha Reddy Jonnalagadda Greg Durrett AI4CE 91 8 0 14 Dec 2021
You should evaluate your language model on marginal likelihood over tokenisations Kris Cao Laura Rimell 101 26 0 06 Sep 2021
Turn the Combination Lock: Learnable Textual Backdoor Attacks via Word Substitution Fanchao Qi Yuan Yao Sophia Xu Zhiyuan Liu Maosong Sun SILM 75 132 0 11 Jun 2021
Lattice-BERT: Leveraging Multi-Granularity Representations in Chinese Pre-trained Language Models Yuxuan Lai Yijia Liu Yansong Feng Songfang Huang Dongyan Zhao VLM AI4CE 70 38 0 15 Apr 2021
Learning a Word-Level Language Model with Sentence-Level Noise Contrastive Estimation for Contextual Sentence Probability Estimation Heewoong Park Sukhyun Cho Jonghun Park 32 0 0 14 Mar 2021
CANINE: Pre-training an Efficient Tokenization-Free Encoder for Language Representation J. Clark Dan Garrette Iulia Turc John Wieting 121 224 0 11 Mar 2021
Learning Spoken Language Representations with Neural Lattice Language Modeling Chao-Wei Huang Yun-Nung Vivian 37 10 0 06 Jul 2020
Latent Relation Language Models Hiroaki Hayashi Zecong Hu Chenyan Xiong Graham Neubig KELM 77 43 0 21 Aug 2019
Lattice Transformer for Speech Translation Pei Zhang Boxing Chen Niyu Ge Kai Fan 80 50 0 13 Jun 2019
Confusion2Vec: Towards Enriching Vector Space Word Representations with Representational Ambiguities K. K. Thekumparampil Zinan Lin 61 23 0 08 Nov 2018
Adaptive Input Representations for Neural Language Modeling Alexei Baevski Michael Auli 158 390 0 28 Sep 2018
Tangent: Automatic differentiation using source-code transformation for dynamically typed array programming B. V. Merrienboer D. Moldovan Alexander B. Wiltschko 63 31 0 25 Sep 2018
Interpretable Textual Neuron Representations for NLP Nina Poerner Benjamin Roth Hinrich Schütze FAtt AI4CE MILM 57 27 0 19 Sep 2018