PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarization

18 December 2019

Mohammad Saleh

Papers citing "PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarization"

49 / 999 papers shown

Title
Summarizing Utterances from Japanese Assembly Minutes using Political Sentence-BERT-based Method for QA Lab-PoliInfo-2 Task of NTCIR-15 Daiki Shirafuji Hiromichi Kameya Rafal Rzepka K. Araki 30 4 0 22 Oct 2020
Topic-Guided Abstractive Text Summarization: a Joint Learning Approach Chujie Zheng Kunpeng Zhang Harry J. Wang Ling Fan Zhe Wang BDL 6 5 0 20 Oct 2020
Dimsum @LaySumm 20: BART-based Approach for Scientific Document Summarization Tiezheng Yu Dan Su Wenliang Dai Pascale Fung 33 5 0 19 Oct 2020
Compressive Summarization with Plausibility and Salience Modeling Shrey Desai Jiacheng Xu Greg Durrett 28 18 0 15 Oct 2020
Understanding Neural Abstractive Summarization Models via Uncertainty Jiacheng Xu Shrey Desai Greg Durrett UQLM 14 47 0 15 Oct 2020
Pretrained Transformers for Text Ranking: BERT and Beyond Jimmy J. Lin Rodrigo Nogueira Andrew Yates VLM 244 612 0 13 Oct 2020
Improving Text Generation Evaluation with Batch Centering and Tempered Word Mover Distance Xi Chen Nan Ding Tomer Levinboim Radu Soricut 14 5 0 13 Oct 2020
CDEvalSumm: An Empirical Study of Cross-Dataset Evaluation for Neural Summarization Systems Yiran Chen Pengfei Liu Ming Zhong Zi-Yi Dou Danqing Wang Xipeng Qiu Xuanjing Huang ELM 33 24 0 11 Oct 2020
TeaForN: Teacher-Forcing with N-grams Sebastian Goodman Nan Ding Radu Soricut 24 19 0 07 Oct 2020
Multi-Fact Correction in Abstractive Text Summarization Yue Dong Shuohang Wang Zhe Gan Yu Cheng Jackie C.K. Cheung Jingjing Liu KELM HILM 17 118 0 06 Oct 2020
Improving AMR Parsing with Sequence-to-Sequence Pre-training Dong Xu Junhui Li Muhua Zhu Min Zhang Guodong Zhou AIMat 18 68 0 05 Oct 2020
Multi-document Summarization with Maximal Marginal Relevance-guided Reinforcement Learning Yuning Mao Yanru Qu Yiqing Xie Xiang Ren Jiawei Han AI4TS 23 46 0 30 Sep 2020
Text Generation by Learning from Demonstrations Richard Yuanzhe Pang He He OffRL 37 80 0 16 Sep 2020
Global-aware Beam Search for Neural Abstractive Summarization Ye Ma Zixun Lan Lu Zong Kaizhu Huang 28 12 0 15 Sep 2020
Literal Encoding: Text is a first-class data encoding R. Brath AI4CE 6 2 0 04 Sep 2020
Learning to summarize from human feedback Nisan Stiennon Long Ouyang Jeff Wu Daniel M. Ziegler Ryan J. Lowe Chelsea Voss Alec Radford Dario Amodei Paul Christiano ALM 65 2,002 0 02 Sep 2020
Generating (Factual?) Narrative Summaries of RCTs: Experiments with Neural Multi-Document Summarization Byron C. Wallace Sayantani Saha Frank Soboczenski Iain J. Marshall HILM 19 77 0 25 Aug 2020
Better Fine-Tuning by Reducing Representational Collapse Armen Aghajanyan Akshat Shrivastava Anchit Gupta Naman Goyal Luke Zettlemoyer S. Gupta AAML 47 209 0 06 Aug 2020
Big Bird: Transformers for Longer Sequences Manzil Zaheer Guru Guruganesh Kumar Avinava Dubey Joshua Ainslie Chris Alberti ... Philip Pham Anirudh Ravula Qifan Wang Li Yang Amr Ahmed VLM 288 2,028 0 28 Jul 2020
SummEval: Re-evaluating Summarization Evaluation Alexander R. Fabbri Wojciech Kry'sciñski Bryan McCann Caiming Xiong R. Socher Dragomir R. Radev HILM 38 691 0 24 Jul 2020
Semi-Supervised Learning Approach to Discover Enterprise User Insights from Feedback and Support Xin Deng Ross Smith Genevieve Quintin 18 3 0 18 Jul 2020
Abstractive and mixed summarization for long-single documents Roger Barrull Jugal Kalita 26 0 0 03 Jul 2020
SEAL: Segment-wise Extractive-Abstractive Long-form Text Summarization Yao-Min Zhao Mohammad Saleh Peter J. Liu RALM 37 25 0 18 Jun 2020
CO-Search: COVID-19 Information Retrieval with Semantic Search, Question Answering, and Abstractive Summarization A. Esteva Anuprit Kale Romain Paulus Kazuma Hashimoto Wenpeng Yin Dragomir R. Radev R. Socher 29 64 0 17 Jun 2020
Mathematical Reasoning via Self-supervised Skip-tree Training M. Rabe Dennis Lee Kshitij Bansal Christian Szegedy ReLM LRM 11 2 0 08 Jun 2020
ColdGANs: Taming Language GANs with Cautious Sampling Strategies Thomas Scialom Paul-Alexis Dray Sylvain Lamprier Benjamin Piwowarski Jacopo Staiano GAN SyDa 25 18 0 08 Jun 2020
Catching Attention with Automatic Pull Quote Selection Tanner A. Bohn Charles X. Ling 64 4 0 27 May 2020
Adversarial NLI for Factual Correctness in Text Summarisation Models Mario Barrantes Benedikt Herudek Richard Wang 17 17 0 24 May 2020
Discourse-Aware Unsupervised Summarization of Long Scientific Documents Yue Dong Andrei Mircea Jackie C.K. Cheung 24 8 0 01 May 2020
TLDR: Extreme Summarization of Scientific Documents Isabel Cachola Kyle Lo Arman Cohan Daniel S. Weld 21 223 0 30 Apr 2020
Self-Supervised and Controlled Multi-Document Opinion Summarization Hady ElSahar Maximin Coavoux Matthias Gallé Jos Rozen 29 48 0 30 Apr 2020
Longformer: The Long-Document Transformer Iz Beltagy Matthew E. Peters Arman Cohan RALM VLM 33 3,944 0 10 Apr 2020
Rapformer: Conditional Rap Lyrics Generation with Denoising Autoencoders Nikola I. Nikolov Eric Malmi Curtis G. Northcutt Loreto Parisi AI4CE 26 6 0 08 Apr 2020
A Hierarchical Network for Abstractive Meeting Summarization with Cross-Domain Pretraining Chenguang Zhu Ruochen Xu Michael Zeng Xuedong Huang BDL AI4TS 26 18 0 04 Apr 2020
Abstractive Summarization with Combination of Pre-trained Sequence-to-Sequence and Saliency Models Itsumi Saito Kyosuke Nishida Kosuke Nishida J. Tomita 28 28 0 29 Mar 2020
Pre-trained Models for Natural Language Processing: A Survey Xipeng Qiu Tianxiang Sun Yige Xu Yunfan Shao Ning Dai Xuanjing Huang LM&MA VLM 246 1,454 0 18 Mar 2020
Document Ranking with a Pretrained Sequence-to-Sequence Model Rodrigo Nogueira Zhiying Jiang Jimmy J. Lin 31 560 0 14 Mar 2020
The growing amplification of social media: Measuring temporal and social contagion dynamics for over 150 languages on Twitter for 2009-2020 T. Alshaabi D. R. Dewhurst J. Minot M. V. Arnold J. L. Adams C. Danforth P. Dodds 24 18 0 07 Mar 2020
Modelling Latent Skills for Multitask Language Generation Kris Cao Dani Yogatama 14 3 0 21 Feb 2020
Learning by Semantic Similarity Makes Abstractive Summarization Better Wonjin Yoon Yoonsun Yeo Minbyul Jeong Bong-Jun Yi Jaewoo Kang 11 16 0 18 Feb 2020
ERNIE-GEN: An Enhanced Multi-Flow Pre-training and Fine-tuning Framework for Natural Language Generation Dongling Xiao Han Zhang Yukun Li Yu Sun Hao Tian Hua Wu Haifeng Wang 31 126 0 26 Jan 2020
ProphetNet: Predicting Future N-gram for Sequence-to-Sequence Pre-training Weizhen Qi Yu Yan Yeyun Gong Dayiheng Liu Nan Duan Jiusheng Chen Ruofei Zhang Ming Zhou AI4TS 27 446 0 13 Jan 2020
Leveraging Lead Bias for Zero-shot Abstractive News Summarization Chenguang Zhu Ziyi Yang R. Gmyr Michael Zeng Xuedong Huang 18 19 0 25 Dec 2019
On Extractive and Abstractive Neural Document Summarization with Transformer Language Models Sandeep Subramanian Raymond Li Jonathan Pilault C. Pal 248 215 0 07 Sep 2019
Facet-Aware Evaluation for Extractive Summarization Yuning Mao Liyuan Liu Qi Zhu Xiang Ren Jiawei Han CVBM 19 20 0 27 Aug 2019
Neural Abstractive Text Summarization with Sequence-to-Sequence Models Tian Shi Yaser Keneshloo Naren Ramakrishnan Chandan K. Reddy 33 226 0 05 Dec 2018
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 304 7,005 0 20 Apr 2018
SummaRuNNer: A Recurrent Neural Network based Sequence Model for Extractive Summarization of Documents Ramesh Nallapati Feifei Zhai Bowen Zhou 207 1,255 0 14 Nov 2016
Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation Yonghui Wu M. Schuster Zhehuai Chen Quoc V. Le Mohammad Norouzi ... Alex Rudnick Oriol Vinyals G. Corrado Macduff Hughes J. Dean AIMat 718 6,750 0 26 Sep 2016