v1v2 (latest)

Summarize, Outline, and Elaborate: Long-Text Generation via Hierarchical Supervision from Extractive Summaries

14 October 2020

Jiwei Li

Papers citing "Summarize, Outline, and Elaborate: Long-Text Generation via Hierarchical Supervision from Extractive Summaries"

50 / 67 papers shown

Title
Learning to Explore and Select for Coverage-Conditioned Retrieval-Augmented Generation Takyoung Kim Kyungjae Lee Y. Jang Ji Yong Cho Gangwoo Kim Minseok Cho Moontae Lee 260 1 0 28 Jan 2025
Navigating the Path of Writing: Outline-guided Text Generation with Large Language Models Yukyung Lee Soonwon Ka Bokyung Son Pilsung Kang Jaewook Kang LLMAG 134 6 0 22 Apr 2024
Big Bird: Transformers for Longer Sequences Manzil Zaheer Guru Guruganesh Kumar Avinava Dubey Joshua Ainslie Chris Alberti ... Philip Pham Anirudh Ravula Qifan Wang Li Yang Amr Ahmed VLM 556 2,099 0 28 Jul 2020
Progressive Generation of Long Text with Pretrained Language Models Bowen Tan Zichao Yang Maruan Al-Shedivat Eric Xing Zhiting Hu 41 23 0 28 Jun 2020
Language Models are Few-Shot Learners Tom B. Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared Kaplan ... Christopher Berner Sam McCandlish Alec Radford Ilya Sutskever Dario Amodei BDL 877 42,379 0 28 May 2020
Synthesizer: Rethinking Self-Attention in Transformer Models Yi Tay Dara Bahri Donald Metzler Da-Cheng Juan Zhe Zhao Che Zheng 61 338 0 02 May 2020
Extractive Summarization as Text Matching Ming Zhong Pengfei Liu Yiran Chen Danqing Wang Xipeng Qiu Xuanjing Huang 143 462 0 19 Apr 2020
Longformer: The Long-Document Transformer Iz Beltagy Matthew E. Peters Arman Cohan RALM VLM 179 4,092 0 10 Apr 2020
Optimus: Organizing Sentences via Pre-trained Modeling of a Latent Space Chunyuan Li Xiang Gao Yuan Li Baolin Peng Xiujun Li Yizhe Zhang Jianfeng Gao SSL DRL 84 182 0 05 Apr 2020
SAC: Accelerating and Structuring Self-Attention via Sparse Adaptive Connection Xiaoya Li Yuxian Meng Mingxin Zhou Qinghong Han Leilei Gan Jiwei Li 68 20 0 22 Mar 2020
UniLMv2: Pseudo-Masked Language Models for Unified Language Model Pre-Training Hangbo Bao Li Dong Furu Wei Wenhui Wang Nan Yang ... Yu Wang Songhao Piao Jianfeng Gao Ming Zhou H. Hon AI4CE 88 394 0 28 Feb 2020
Blank Language Models T. Shen Victor Quach Regina Barzilay Tommi Jaakkola 266 73 0 08 Feb 2020
Reformer: The Efficient Transformer Nikita Kitaev Lukasz Kaiser Anselm Levskaya VLM 201 2,332 0 13 Jan 2020
ProphetNet: Predicting Future N-gram for Sequence-to-Sequence Pre-training Weizhen Qi Yu Yan Yeyun Gong Dayiheng Liu Nan Duan Jiusheng Chen Ruofei Zhang Ming Zhou AI4TS 93 450 0 13 Jan 2020
Paraphrase Generation with Latent Bag of Words Yao Fu Yansong Feng John P. Cunningham BDL 63 92 0 07 Jan 2020
BP-Transformer: Modelling Long-Range Context via Binary Partitioning Zihao Ye Qipeng Guo Quan Gan Xipeng Qiu Zheng Zhang 78 77 0 11 Nov 2019
Sentence-Level Content Planning and Style Specification for Neural Text Generation Xinyu Hua Lu Wang 55 51 0 02 Sep 2019
Adaptively Sparse Transformers Gonçalo M. Correia Vlad Niculae André F. T. Martins 93 256 0 30 Aug 2019
Improving Neural Story Generation by Targeted Common Sense Grounding H. H. Mao Bodhisattwa Prasad Majumder Julian McAuley G. Cottrell LRM 63 46 0 26 Aug 2019
Text Summarization with Pretrained Encoders Yang Liu Mirella Lapata MILM 456 1,452 0 22 Aug 2019
RoBERTa: A Robustly Optimized BERT Pretraining Approach Yinhan Liu Myle Ott Naman Goyal Jingfei Du Mandar Joshi Danqi Chen Omer Levy M. Lewis Luke Zettlemoyer Veselin Stoyanov AIMat 677 24,541 0 26 Jul 2019
XLNet: Generalized Autoregressive Pretraining for Language Understanding Zhilin Yang Zihang Dai Yiming Yang J. Carbonell Ruslan Salakhutdinov Quoc V. Le AI4CE 236 8,447 0 19 Jun 2019
Hierarchical Transformers for Multi-Document Summarization Yang Liu Mirella Lapata 114 297 0 30 May 2019
Defending Against Neural Fake News Rowan Zellers Ari Holtzman Hannah Rashkin Yonatan Bisk Ali Farhadi Franziska Roesner Yejin Choi AAML 128 1,030 0 29 May 2019
Adaptive Attention Span in Transformers Sainbayar Sukhbaatar Edouard Grave Piotr Bojanowski Armand Joulin 76 286 0 19 May 2019
Generating Long Sequences with Sparse Transformers R. Child Scott Gray Alec Radford Ilya Sutskever 129 1,915 0 23 Apr 2019
BERTScore: Evaluating Text Generation with BERT Tianyi Zhang Varsha Kishore Felix Wu Kilian Q. Weinberger Yoav Artzi 352 5,860 0 21 Apr 2019
Jointly Measuring Diversity and Quality in Text Generation Models Ehsan Montahaei Danial Alihosseini M. Baghshah 61 77 0 08 Apr 2019
Step-by-Step: Separating Planning from Realization in Neural Data-to-Text Generation Amit Moryossef Yoav Goldberg Ido Dagan 57 184 0 06 Apr 2019
Star-Transformer Qipeng Guo Xipeng Qiu Pengfei Liu Yunfan Shao Xiangyang Xue Zheng Zhang 80 263 0 25 Feb 2019
Towards Generating Long and Coherent Text with Multi-Level Latent Variable Models Dinghan Shen Asli Celikyilmaz Yizhe Zhang Liqun Chen Xin Eric Wang Jianfeng Gao Lawrence Carin DRL 56 53 0 01 Feb 2019
Transformer-XL: Attentive Language Models Beyond a Fixed-Length Context Zihang Dai Zhilin Yang Yiming Yang J. Carbonell Quoc V. Le Ruslan Salakhutdinov VLM 257 3,745 0 09 Jan 2019
Plan-And-Write: Towards Better Automatic Storytelling Lili Yao Nanyun Peng R. Weischedel Kevin Knight Dongyan Zhao Rui Yan 89 412 0 14 Nov 2018
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.8K 95,175 0 11 Oct 2018
End-to-End Content and Plan Selection for Data-to-Text Generation Sebastian Gehrmann Falcon Z. Dai H. Elder Alexander M. Rush 60 71 0 10 Oct 2018
Data-to-Text Generation with Content Selection and Planning Ratish Puduppully Li Dong Mirella Lapata 70 302 0 03 Sep 2018
Bottom-Up Abstractive Summarization Sebastian Gehrmann Yuntian Deng Alexander M. Rush CVBM 165 689 0 31 Aug 2018
Learning Neural Templates for Text Generation Sam Wiseman Stuart M. Shieber Alexander M. Rush 116 200 0 30 Aug 2018
Story Ending Generation with Incremental Encoding and Commonsense Knowledge Jian Guan Yansen Wang Minlie Huang LRM 94 161 0 30 Aug 2018
Don't Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarization Shashi Narayan Shay B. Cohen Mirella Lapata AILaw 146 1,683 0 27 Aug 2018
A Skeleton-Based Model for Promoting Coherence Among Sentences in Narrative Story Generation Jingjing Xu Xuancheng Ren Yanzhe Zhang Qi Zeng Xiaoyan Cai Xu Sun LRM 49 106 0 21 Aug 2018
Neural Document Summarization by Jointly Learning to Score and Select Sentences Qingyu Zhou Nan Yang Furu Wei Shaohan Huang M. Zhou Tiejun Zhao 149 322 0 06 Jul 2018
Hierarchical Neural Story Generation Angela Fan M. Lewis Yann N. Dauphin DiffM 183 1,626 0 13 May 2018
Deep contextualized word representations Matthew E. Peters Mark Neumann Mohit Iyyer Matt Gardner Christopher Clark Kenton Lee Luke Zettlemoyer NAI 233 11,566 0 15 Feb 2018
Generating Wikipedia by Summarizing Long Sequences Peter J. Liu Mohammad Saleh Etienne Pot Ben Goodrich Ryan Sepassi Lukasz Kaiser Noam M. Shazeer CVBM 208 801 0 30 Jan 2018
Long Text Generation via Adversarial Training with Leaked Information Jiaxian Guo Sidi Lu Han Cai Weinan Zhang Yong Yu Jun Wang GAN 79 498 0 24 Sep 2017
Order-Planning Neural Text Generation From Structured Data Lei Sha Lili Mou Tianyu Liu Pascal Poupart Sujian Li Baobao Chang Zhifang Sui LMTD 84 114 0 01 Sep 2017
Challenges in Data-to-Document Generation Sam Wiseman Stuart M. Shieber Alexander M. Rush 188 591 0 25 Jul 2017
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 786 132,363 0 12 Jun 2017
Discourse-Based Objectives for Fast Unsupervised Sentence Representation Learning Yacine Jernite Samuel R. Bowman David Sontag 80 111 0 23 Apr 2017