Pretrained Language Models for Text Generation: A Survey

21 May 2021

Papers citing "Pretrained Language Models for Text Generation: A Survey"

50 / 53 papers shown

Title
CT-AGRG: Automated Abnormality-Guided Report Generation from 3D Chest CT Volumes Theo Di Piazza 41 1 0 21 Aug 2024
What Is Missing in Multilingual Visual Reasoning and How to Fix It Yueqi Song Simran Khanuja Graham Neubig VLM LRM 122 6 0 03 Mar 2024
Exploring the Frontiers of LLMs in Psychological Applications: A Comprehensive Review Luoma Ke Song Tong Peng Cheng Kaiping Peng OffRL LM&MA 78 21 0 03 Jan 2024
Few-shot Knowledge Graph-to-Text Generation with Pretrained Language Models Junyi Li Tianyi Tang Wayne Xin Zhao Zhicheng Wei N. Yuan Ji-Rong Wen 41 48 0 03 Jun 2021
Knowledge-based Review Generation by Coherence Enhanced Text Planning Junyi Li Wayne Xin Zhao Zhicheng Wei Nicholas Jing Yuan Ji-Rong Wen 48 21 0 09 May 2021
A Short Survey of Pre-trained Language Models for Conversational AI-A NewAge in NLP Munazza Zaib Quan Z. Sheng W. Zhang 29 67 0 22 Apr 2021
TextBox: A Unified, Modularized, and Extensible Framework for Text Generation Junyi Li Tianyi Tang Gaole He Jinhao Jiang Xiaoxuan Hu Puzhao Xie Zhipeng Chen Zhuohao Yu Wayne Xin Zhao Ji-Rong Wen 51 25 0 06 Jan 2021
A Simple and Efficient Multi-Task Learning Approach for Conditioned Dialogue Generation Yan Zeng J. Nie 34 5 0 21 Oct 2020
Knowledge-Grounded Dialogue Generation with Pre-trained Language Models Xueliang Zhao Wei Wu Can Xu Chongyang Tao Dongyan Zhao Rui Yan 217 192 0 17 Oct 2020
Unsupervised Extractive Summarization by Pre-training Hierarchical Transformers Shusheng Xu Xingxing Zhang Yi Wu Furu Wei Ming Zhou 68 44 0 16 Oct 2020
Pre-training Multilingual Neural Machine Translation by Leveraging Alignment Information Zehui Lin Xiao Pan Mingxuan Wang Xipeng Qiu Jiangtao Feng Hao Zhou Lei Li 31 125 0 07 Oct 2020
Knowledge-Enhanced Personalized Review Generation with Capsule Graph Neural Network Junyi Li Siqing Li Wayne Xin Zhao Gaole He Zhicheng Wei Nicholas Jing Yuan Ji-Rong Wen 32 39 0 04 Oct 2020
Code-switching pre-training for neural machine translation Zhen Yang Bojie Hu Ambyera Han Shen Huang Qi Ju 38 71 0 17 Sep 2020
Investigating Pretrained Language Models for Graph-to-Text Generation Leonardo F. R. Ribeiro Martin Schmitt Hinrich Schütze Iryna Gurevych 31 218 0 16 Jul 2020
PLATO-2: Towards Building an Open-Domain Chatbot via Curriculum Learning Siqi Bao H. He Fan Wang Hua Wu Haifeng Wang Wenquan Wu Zhen Guo Zhibin Liu Xinchao Xu 47 137 0 30 Jun 2020
Language Models are Few-Shot Learners Tom B. Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared Kaplan ... Christopher Berner Sam McCandlish Alec Radford Ilya Sutskever Dario Amodei BDL 346 41,106 0 28 May 2020
GPT-too: A language-model-first approach for AMR-to-text generation Manuel Mager Ramón Fernández Astudillo Tahira Naseem Md Arafat Sultan Young-Suk Lee Radu Florian Salim Roukos 37 100 0 18 May 2020
A Tailored Pre-Training Model for Task-Oriented Dialog Generation Jing Gu Qingyang Wu Chongruo Wu Weiyan Shi Zhou Yu 30 17 0 24 Apr 2020
Pretrained Transformers Improve Out-of-Distribution Robustness Dan Hendrycks Xiaoyuan Liu Eric Wallace Adam Dziedzic R. Krishnan D. Song OOD 88 430 0 13 Apr 2020
Pre-trained Models for Natural Language Processing: A Survey Xipeng Qiu Tianxiang Sun Yige Xu Yunfan Shao Ning Dai Xuanjing Huang LM&MA VLM 309 1,471 0 18 Mar 2020
XGPT: Cross-modal Generative Pre-Training for Image Captioning Qiaolin Xia Haoyang Huang Nan Duan Dongdong Zhang Lei Ji Zhifang Sui Edward Cui Taroon Bharti Xin Liu Ming Zhou MLLM VLM 50 74 0 03 Mar 2020
TED: A Pretrained Unsupervised Summarization Model with Theme Modeling and Denoising Ziyi Yang Chenguang Zhu R. Gmyr Michael Zeng Xuedong Huang Eric Darve 42 61 0 03 Jan 2020
DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generation Yizhe Zhang Siqi Sun Michel Galley Yen-Chun Chen Chris Brockett Xiang Gao Jianfeng Gao Jingjing Liu W. Dolan VLM 133 1,513 0 01 Nov 2019
Discourse-Aware Neural Extractive Text Summarization Jiacheng Xu Zhe Gan Yu Cheng Jingjing Liu BDL 115 279 0 30 Oct 2019
BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension M. Lewis Yinhan Liu Naman Goyal Marjan Ghazvininejad Abdel-rahman Mohamed Omer Levy Veselin Stoyanov Luke Zettlemoyer AIMat VLM 83 10,720 0 29 Oct 2019
Unsupervised pre-training for sequence to sequence speech recognition Zhiyun Fan Shiyu Zhou Bo Xu SSL AI4TS 4 16 0 28 Oct 2019
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer Colin Raffel Noam M. Shazeer Adam Roberts Katherine Lee Sharan Narang Michael Matena Yanqi Zhou Wei Li Peter J. Liu AIMat 191 19,824 0 23 Oct 2019
DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter Victor Sanh Lysandre Debut Julien Chaumond Thomas Wolf 68 7,386 0 02 Oct 2019
ALBERT: A Lite BERT for Self-supervised Learning of Language Representations Zhenzhong Lan Mingda Chen Sebastian Goodman Kevin Gimpel Piyush Sharma Radu Soricut SSL AIMat 221 6,420 0 26 Sep 2019
Unified Vision-Language Pre-Training for Image Captioning and VQA Luowei Zhou Hamid Palangi Lei Zhang Houdong Hu Jason J. Corso Jianfeng Gao MLLM VLM 313 930 0 24 Sep 2019
CTRL: A Conditional Transformer Language Model for Controllable Generation N. Keskar Bryan McCann Lav Varshney Caiming Xiong R. Socher AI4CE 83 1,239 0 11 Sep 2019
Text Summarization with Pretrained Encoders Yang Liu Mirella Lapata MILM 369 1,439 0 22 Aug 2019
Leveraging Pre-trained Checkpoints for Sequence Generation Tasks S. Rothe Shashi Narayan Aliaksei Severyn SILM 81 434 0 29 Jul 2019
Learning Video Representations using Contrastive Bidirectional Transformer Chen Sun Fabien Baradel Kevin Patrick Murphy Cordelia Schmid SSL ViT 90 133 0 13 Jun 2019
Generating Long and Informative Reviews with Aspect-Aware Coarse-to-Fine Decoding Junyi Li Wayne Xin Zhao Ji-Rong Wen Yang Song 29 37 0 11 Jun 2019
Sentence Centrality Revisited for Unsupervised Summarization Hao Zheng Mirella Lapata 27 169 0 08 Jun 2019
ERNIE: Enhanced Language Representation with Informative Entities Zhengyan Zhang Xu Han Zhiyuan Liu Xin Jiang Maosong Sun Qun Liu 61 1,390 0 17 May 2019
HIBERT: Document Level Pre-training of Hierarchical Bidirectional Transformers for Document Summarization Xingxing Zhang Furu Wei M. Zhou 53 377 0 16 May 2019
Unified Language Model Pre-training for Natural Language Understanding and Generation Li Dong Nan Yang Wenhui Wang Furu Wei Xiaodong Liu Yu Wang Jianfeng Gao M. Zhou H. Hon ELM AI4CE 110 1,553 0 08 May 2019
MASS: Masked Sequence to Sequence Pre-training for Language Generation Kaitao Song Xu Tan Tao Qin Jianfeng Lu Tie-Yan Liu 72 962 0 07 May 2019
Few-Shot NLG with Pre-Trained Language Model Zhiyu Zoey Chen H. Eavani Wenhu Chen Yinyin Liu William Yang Wang LMTD 35 141 0 21 Apr 2019
VideoBERT: A Joint Model for Video and Language Representation Learning Chen Sun Austin Myers Carl Vondrick Kevin Patrick Murphy Cordelia Schmid VLM SSL 26 1,238 0 03 Apr 2019
Pretraining-Based Natural Language Generation for Text Summarization Haoyu Zhang Jianjun Xu Ji Wang 34 208 0 25 Feb 2019
TransferTransfo: A Transfer Learning Approach for Neural Network Based Conversational Agents Thomas Wolf Victor Sanh Julien Chaumond Clement Delangue 57 495 0 23 Jan 2019
Cross-lingual Language Model Pretraining Guillaume Lample Alexis Conneau 41 2,727 0 22 Jan 2019
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 681 93,936 0 11 Oct 2018
Unsupervised Cross-lingual Word Embedding by Multilingual Neural Language Models Takashi Wada Tomoharu Iwata 32 27 0 07 Sep 2018
Improving Abstraction in Text Summarization Wojciech Kry'sciñski Romain Paulus Caiming Xiong R. Socher 33 147 0 23 Aug 2018
Deep contextualized word representations Matthew E. Peters Mark Neumann Mohit Iyyer Matt Gardner Christopher Clark Kenton Lee Luke Zettlemoyer NAI 62 11,520 0 15 Feb 2018
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 268 129,831 0 12 Jun 2017