v1v2v3v4v5 (latest)

MASS: Masked Sequence to Sequence Pre-training for Language Generation

7 May 2019

Xu Tan

Papers citing "MASS: Masked Sequence to Sequence Pre-training for Language Generation"

47 / 47 papers shown

Title
A Survey on Music Generation from Single-Modal, Cross-Modal, and Multi-Modal Perspectives Shuyu Li Shulei Ji Zihao Wang Songruoyao Wu Jiaxing Yu Kai Zhang MGen VGen 265 1 0 01 Apr 2025
Towards Making Flowchart Images Machine Interpretable Shivalika Singh Prajwal Gatti Yogesh Kumar Vikash Yadav Anand Mishra 75 6 0 29 Jan 2025
LangSAMP: Language-Script Aware Multilingual Pretraining Yihong Liu Haotian Ye Chunlan Ma Mingyang Wang Hinrich Schütze VLM 195 0 0 26 Sep 2024
Large Language Models: A Survey Shervin Minaee Tomas Mikolov Narjes Nikzad M. Asgari-Chenaghlu R. Socher Xavier Amatriain Jianfeng Gao ALM LM&MA ELM 206 417 0 09 Feb 2024
Unsupervised Pivot Translation for Distant Languages Yichong Leng Xu Tan Tao Qin Xiang-Yang Li Tie-Yan Liu 51 30 0 06 Jun 2019
Almost Unsupervised Text to Speech and Automatic Speech Recognition Yi Ren Xu Tan Tao Qin Sheng Zhao Zhou Zhao Tie-Yan Liu 74 102 0 13 May 2019
Multilingual Neural Machine Translation with Knowledge Distillation Xu Tan Yi Ren Di He Tao Qin Zhou Zhao Tie-Yan Liu 79 250 0 27 Feb 2019
Cross-lingual Language Model Pretraining Guillaume Lample Alexis Conneau 104 2,748 0 22 Jan 2019
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.8K 95,175 0 11 Oct 2018
Unsupervised Statistical Machine Translation Mikel Artetxe Gorka Labaka Eneko Agirre 45 248 0 04 Sep 2018
Double Path Networks for Sequence to Sequence Learning Kaitao Song Xu Tan Di He Jianfeng Lu Tao Qin Tie-Yan Liu 54 14 0 13 Jun 2018
Dense Information Flow for Neural Machine Translation Yanyao Shen Xu Tan Di He Tao Qin Tie-Yan Liu AI4CE 70 34 0 03 Jun 2018
Unsupervised Neural Machine Translation with Weight Sharing Zhen-Le Yang Wei Chen Feng Wang Bo Xu 46 128 0 24 Apr 2018
Phrase-Based & Neural Unsupervised Machine Translation Guillaume Lample Myle Ott Alexis Conneau Ludovic Denoyer MarcÁurelio Ranzato 91 682 0 20 Apr 2018
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 1.1K 7,196 0 20 Apr 2018
Achieving Human Parity on Automatic Chinese to English News Translation Hany Hassan Anthony Aue Chang Chen Vishal Chowdhary Jonathan Clark ... Shuangzhi Wu Yingce Xia Dongdong Zhang Zhirui Zhang Ming Zhou 73 606 0 15 Mar 2018
An efficient framework for learning sentence representations Lajanugen Logeswaran Honglak Lee 85 544 0 07 Mar 2018
Deep contextualized word representations Matthew E. Peters Mark Neumann Mohit Iyyer Matt Gardner Christopher Clark Kenton Lee Luke Zettlemoyer NAI 230 11,566 0 15 Feb 2018
MaskGAN: Better Text Generation via Filling in the______ W. Fedus Ian Goodfellow Andrew M. Dai 87 470 0 23 Jan 2018
Unsupervised Machine Translation Using Monolingual Corpora Only Guillaume Lample Alexis Conneau Ludovic Denoyer MarcÁurelio Ranzato SSL 133 1,097 0 31 Oct 2017
Unsupervised Neural Machine Translation Mikel Artetxe Gorka Labaka Eneko Agirre Kyunghyun Cho 95 772 0 30 Oct 2017
Learned in Translation: Contextualized Word Vectors Bryan McCann James Bradbury Caiming Xiong R. Socher 121 909 0 01 Aug 2017
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 730 132,363 0 12 Jun 2017
Convolutional Sequence to Sequence Learning Jonas Gehring Michael Auli David Grangier Denis Yarats Yann N. Dauphin AIMat 171 3,289 0 08 May 2017
Machine Comprehension by Text-to-Text Neural Question Generation Xingdi Yuan Tong Wang Çağlar Gülçehre Alessandro Sordoni Philip Bachman Sandeep Subramanian Saizheng Zhang Adam Trischler OOD 97 187 0 04 May 2017
Cutting-off Redundant Repeating Generations for Neural Abstractive Summarization Jun Suzuki Masaaki Nagata 84 77 0 31 Dec 2016
Unsupervised Pretraining for Sequence to Sequence Learning Prajit Ramachandran Peter J. Liu Quoc V. Le SSL AIMat 102 282 0 08 Nov 2016
Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation Yonghui Wu M. Schuster Zhiwen Chen Quoc V. Le Mohammad Norouzi ... Alex Rudnick Oriol Vinyals G. Corrado Macduff Hughes J. Dean AIMat 911 6,796 0 26 Sep 2016
SQuAD: 100,000+ Questions for Machine Comprehension of Text Pranav Rajpurkar Jian Zhang Konstantin Lopyrev Percy Liang RALM 314 8,169 0 16 Jun 2016
Zero-Resource Translation with Multi-Lingual Neural Machine Translation Orhan Firat B. Sankaran Yaser Al-Onaizan Fatoş T. Yarman Vural Kyunghyun Cho 72 275 0 13 Jun 2016
Transfer Learning for Low-Resource Neural Machine Translation Barret Zoph Deniz Yuret Jonathan May Kevin Knight 78 857 0 08 Apr 2016
Neural Headline Generation with Sentence-wise Optimization Ayana Shiqi Shen Yu Zhao Zhiyuan Liu Maosong Sun 74 55 0 07 Apr 2016
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 2.2K 194,426 0 10 Dec 2015
Semi-supervised Sequence Learning Andrew M. Dai Quoc V. Le SSL 132 1,234 0 04 Nov 2015
Neural Machine Translation of Rare Words with Subword Units Rico Sennrich Barry Haddow Alexandra Birch 228 7,757 0 31 Aug 2015
A large annotated corpus for learning natural language inference Samuel R. Bowman Gabor Angeli Christopher Potts Christopher D. Manning 324 4,293 0 21 Aug 2015
Skip-Thought Vectors Ryan Kiros Yukun Zhu Ruslan Salakhutdinov R. Zemel Antonio Torralba R. Urtasun Sanja Fidler SSL 219 2,412 0 22 Jun 2015
A Neural Conversational Model Oriol Vinyals Quoc V. Le BDL 141 1,768 0 19 Jun 2015
Neural Responding Machine for Short-Text Conversation Lifeng Shang Zhengdong Lu Hang Li 119 1,146 0 09 Mar 2015
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 2.0K 150,312 0 22 Dec 2014
Going Deeper with Convolutions Christian Szegedy Wei Liu Yangqing Jia P. Sermanet Scott E. Reed Dragomir Anguelov D. Erhan Vincent Vanhoucke Andrew Rabinovich 485 43,694 0 17 Sep 2014
Neural Machine Translation by Jointly Learning to Align and Translate Dzmitry Bahdanau Kyunghyun Cho Yoshua Bengio AIMat 575 27,327 0 01 Sep 2014
Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation Kyunghyun Cho B. V. Merrienboer Çağlar Gülçehre Dzmitry Bahdanau Fethi Bougares Holger Schwenk Yoshua Bengio AIMat 1.1K 23,388 0 03 Jun 2014
Distributed Representations of Sentences and Documents Quoc V. Le Tomas Mikolov FaML 259 9,247 0 16 May 2014
Rich feature hierarchies for accurate object detection and semantic segmentation Ross B. Girshick Jeff Donahue Trevor Darrell Jitendra Malik ObjD 289 26,211 0 11 Nov 2013
Distributed Representations of Words and Phrases and their Compositionality Tomas Mikolov Ilya Sutskever Kai Chen G. Corrado J. Dean NAI OCL 402 33,560 0 16 Oct 2013
Chameleons in imagined conversations: A new approach to understanding coordination of linguistic style in dialogs Cristian Danescu-Niculescu-Mizil Lillian Lee 97 428 0 15 Jun 2011