PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarization

18 December 2019

Mohammad Saleh

Papers citing "PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarization"

50 / 999 papers shown

Title
Attention Head Masking for Inference Time Content Selection in Abstractive Summarization Shuyang Cao Lu Wang CVBM 32 11 0 06 Apr 2021
Efficient Attentions for Long Document Summarization L. Huang Shuyang Cao Nikolaus Nova Parulian Heng Ji Lu Wang 73 275 0 05 Apr 2021
Rethinking Perturbations in Encoder-Decoders for Fast Training Sho Takase Shun Kiyono 33 45 0 05 Apr 2021
A New Approach to Overgenerating and Scoring Abstractive Summaries Kaiqiang Song Bingqing Wang Z. Feng Fei Liu 22 17 0 05 Apr 2021
Inference Time Style Control for Summarization Shuyang Cao Lu Wang AI4TS 29 15 0 05 Apr 2021
Humor@IITK at SemEval-2021 Task 7: Large Language Models for Quantifying Humor and Offensiveness Aishwarya Gupta Avik Pal Bholeshwar Khurana Lakshay Tyagi Ashutosh Modi 24 6 0 02 Apr 2021
A Pseudo-Metric between Probability Distributions based on Depth-Trimmed Regions Guillaume Staerman Pavlo Mozharovskyi Pierre Colombo Stéphan Clémenccon Florence dÁlché-Buc OOD 69 17 0 23 Mar 2021
QuestEval: Summarization Asks for Fact-based Evaluation Thomas Scialom Paul-Alexis Dray Patrick Gallinari Sylvain Lamprier Benjamin Piwowarski Jacopo Staiano Alex Jinpeng Wang HILM 28 268 0 23 Mar 2021
GLM: General Language Model Pretraining with Autoregressive Blank Infilling Zhengxiao Du Yujie Qian Xiao Liu Ming Ding J. Qiu Zhilin Yang Jie Tang BDL AI4CE 51 1,492 0 18 Mar 2021
Team Phoenix at WASSA 2021: Emotion Analysis on News Stories with Pre-Trained Language Models Yash Butala Kanishk Singh Adarsh Kumar Shrey Shrivastava 17 10 0 10 Mar 2021
Select, Substitute, Search: A New Benchmark for Knowledge-Augmented Visual Question Answering Aman Jain Mayank Kothyari Vishwajeet Kumar Preethi Jyothi Ganesh Ramakrishnan Soumen Chakrabarti 27 34 0 09 Mar 2021
Empathetic BERT2BERT Conversational Model: Learning Arabic Language Generation with Little Data Tarek Naous Wissam Antoun Reem A. Mahmoud Hazem M. Hajj 44 18 0 07 Mar 2021
Neural networks can understand compositional functions that humans do not, in the context of emergent communication Hugh Perkins 31 4 0 06 Mar 2021
Meta-Transfer Learning for Low-Resource Abstractive Summarization Yi-Syuan Chen Hong-Han Shuai CLL OffRL 48 38 0 18 Feb 2021
Entity-level Factual Consistency of Abstractive Text Summarization Feng Nan Ramesh Nallapati Zhiguo Wang Cicero Nogueira dos Santos Henghui Zhu Dejiao Zhang Kathleen McKeown Bing Xiang HILM 144 158 0 18 Feb 2021
Quiz-Style Question Generation for News Stories Á. Lelkes Vinh Q. Tran Cong Yu 35 42 0 18 Feb 2021
Conceptual 12M: Pushing Web-Scale Image-Text Pre-Training To Recognize Long-Tail Visual Concepts Soravit Changpinyo P. Sharma Nan Ding Radu Soricut VLM 302 1,086 0 17 Feb 2021
Unsupervised Extractive Summarization using Pointwise Mutual Information Vishakh Padmakumar He He 13 46 0 11 Feb 2021
Text Compression-aided Transformer Encoding Z. Li ZhuoSheng Zhang Hai Zhao Rui Wang Kehai Chen Masao Utiyama Eiichiro Sumita AI4CE 27 45 0 11 Feb 2021
Toward Improving Coherence and Diversity of Slogan Generation Yiping Jin Akshay Bhatia Dittaya Wanvarie Phu T. V. Le 19 5 0 11 Feb 2021
CSS-LM: A Contrastive Framework for Semi-supervised Fine-tuning of Pre-trained Language Models Yusheng Su Xu Han Yankai Lin Zhengyan Zhang Zhiyuan Liu Peng Li Jie Zhou Maosong Sun 19 10 0 07 Feb 2021
The GEM Benchmark: Natural Language Generation, its Evaluation and Metrics Sebastian Gehrmann Tosin Adewumi Karmanya Aggarwal Pawan Sasanka Ammanamanchi Aremu Anuoluwapo ... Nishant Subramani Wei Xu Diyi Yang Akhila Yerukola Jiawei Zhou VLM 260 285 0 02 Feb 2021
DOC2PPT: Automatic Presentation Slides Generation from Scientific Documents Tsu-Jui Fu Wenjie Wang Daniel J. McDuff Yale Song 22 50 0 28 Jan 2021
Open-Domain Conversational Search Assistant with Transformers Rafael Ferreira Mariana Leite David Semedo João Magalhães 16 11 0 20 Jan 2021
GENIE: Toward Reproducible and Standardized Human Evaluation for Text Generation Daniel Khashabi Gabriel Stanovsky Jonathan Bragg Nicholas Lourie Jungo Kasai Yejin Choi Noah A. Smith Daniel S. Weld 26 20 0 17 Jan 2021
LIME: Learning Inductive Bias for Primitives of Mathematical Reasoning Yuhuai Wu M. Rabe Wenda Li Jimmy Ba Roger C. Grosse Christian Szegedy AIMat LRM 75 52 0 15 Jan 2021
The Expando-Mono-Duo Design Pattern for Text Ranking with Pretrained Sequence-to-Sequence Models Ronak Pradeep Rodrigo Nogueira Jimmy J. Lin MoE 67 167 0 14 Jan 2021
Robustness Gym: Unifying the NLP Evaluation Landscape Karan Goel Nazneen Rajani Jesse Vig Samson Tan Jason M. Wu Stephan Zheng Caiming Xiong Joey Tianyi Zhou Christopher Ré AAML OffRL OOD 154 137 0 13 Jan 2021
CDLM: Cross-Document Language Modeling Avi Caciularu Arman Cohan Iz Beltagy Matthew E. Peters Arie Cattan Ido Dagan VLM 35 32 0 02 Jan 2021
Studying Strategically: Learning to Mask for Closed-book QA Qinyuan Ye Belinda Z. Li Sinong Wang Benjamin Bolte Hao Ma Wen-tau Yih Xiang Ren Madian Khabsa OffRL 27 11 0 31 Dec 2020
BANG: Bridging Autoregressive and Non-autoregressive Generation with Large Scale Pretraining Weizhen Qi Yeyun Gong Jian Jiao Yu Yan Weizhu Chen ... Houqiang Li Jiusheng Chen Ruofei Zhang Ming Zhou Nan Duan 37 46 0 31 Dec 2020
Understanding and Improving Encoder Layer Fusion in Sequence-to-Sequence Learning Xuebo Liu Longyue Wang Derek F. Wong Liang Ding Lidia S. Chao Zhaopeng Tu AI4CE 27 35 0 29 Dec 2020
On Generating Extended Summaries of Long Documents Sajad Sotudeh Arman Cohan Nazli Goharian 27 17 0 28 Dec 2020
Few-Shot Text Generation with Pattern-Exploiting Training Timo Schick Hinrich Schütze 39 145 0 22 Dec 2020
Contrastive Learning with Adversarial Perturbations for Conditional Text Generation Seanie Lee Dong Bok Lee Sung Ju Hwang 27 106 0 14 Dec 2020
Cross-lingual Transfer of Abstractive Summarizer to Less-resource Language Aleš Žagar Marko Robnik-Šikonja 36 9 0 08 Dec 2020
CTRLsum: Towards Generic Controllable Text Summarization Junxian He Wojciech Kry'sciñski Bryan McCann Nazneen Rajani Caiming Xiong 216 138 0 08 Dec 2020
FFCI: A Framework for Interpretable Automatic Evaluation of Summarization Fajri Koto Timothy Baldwin Jey Han Lau HILM 32 37 0 27 Nov 2020
GLGE: A New General Language Generation Evaluation Benchmark Dayiheng Liu Yu Yan Yeyun Gong Weizhen Qi Hang Zhang ... Jiancheng Lv Ruofei Zhang Winnie Wu Ming Zhou Nan Duan ELM 40 66 0 24 Nov 2020
A Two-Phase Approach for Abstractive Podcast Summarization Chujie Zheng Kunpeng Zhang Harry J. Wang Ling Fan 9 11 0 16 Nov 2020
Open4Business(O4B): An Open Access Dataset for Summarizing Business Documents Amanpreet Singh Niranjan Balasubramanian VLM 26 0 0 15 Nov 2020
Multi-document Summarization via Deep Learning Techniques: A Survey Congbo Ma W. Zhang Mingyu Guo Hu Wang Quan Z. Sheng 13 126 0 10 Nov 2020
Sound Natural: Content Rephrasing in Dialog Systems Arash Einolghozati Anchit Gupta K. Diedrick S. Gupta 31 6 0 03 Nov 2020
Liputan6: A Large-scale Indonesian Dataset for Text Summarization Fajri Koto Jey Han Lau Timothy Baldwin 22 46 0 02 Nov 2020
IndoLEM and IndoBERT: A Benchmark Dataset and Pre-trained Language Model for Indonesian NLP Fajri Koto Afshin Rahimi Jey Han Lau Timothy Baldwin 19 255 0 02 Nov 2020
Pre-trained Summarization Distillation Sam Shleifer Alexander M. Rush 26 98 0 24 Oct 2020
ReadOnce Transformers: Reusable Representations of Text for Transformers Shih-Ting Lin Ashish Sabharwal Tushar Khot 43 3 0 24 Oct 2020
Improving Zero and Few-Shot Abstractive Summarization with Intermediate Fine-tuning and Data Augmentation Alexander R. Fabbri Simeng Han Haoyuan Li Haoran Li Marjan Ghazvininejad Chenyu You Dragomir R. Radev Yashar Mehdad 123 95 0 24 Oct 2020
Constrained Abstractive Summarization: Preserving Factual Consistency with Constrained Generation Yuning Mao Xiang Ren Heng Ji Jiawei Han HILM 125 38 0 24 Oct 2020
AQuaMuSe: Automatically Generating Datasets for Query-Based Multi-Document Summarization Sayali Kulkarni Sheide Chammas Wan Zhu Fei Sha Eugene Ie RALM 64 52 0 23 Oct 2020