SLM: Learning a Discourse Language Representation with Sentence Unshuffling

30 October 2020

Papers citing "SLM: Learning a Discourse Language Representation with Sentence Unshuffling"

9 / 9 papers shown

Title
DEPTH: Discourse Education through Pre-Training Hierarchically Zachary Bamberger Ofek Glick Chaim Baskin Yonatan Belinkov 94 0 0 13 May 2024
Pretraining with Contrastive Sentence Objectives Improves Discourse Performance of Language Models Dan Iter Kelvin Guu L. Lansing Dan Jurafsky 27 78 0 20 May 2020
ALBERT: A Lite BERT for Self-supervised Learning of Language Representations Zhenzhong Lan Mingda Chen Sebastian Goodman Kevin Gimpel Piyush Sharma Radu Soricut SSL AIMat 268 6,420 0 26 Sep 2019
StructBERT: Incorporating Language Structures into Pre-training for Deep Language Understanding Wei Wang Bin Bi Ming Yan Chen Henry Wu Zuyi Bao Jiangnan Xia Liwei Peng Luo Si 47 260 0 13 Aug 2019
SpanBERT: Improving Pre-training by Representing and Predicting Spans Mandar Joshi Danqi Chen Yinhan Liu Daniel S. Weld Luke Zettlemoyer Omer Levy 120 1,953 0 24 Jul 2019
MASS: Masked Sequence to Sequence Pre-training for Language Generation Kaitao Song Xu Tan Tao Qin Jianfeng Lu Tie-Yan Liu 92 962 0 07 May 2019
CoQA: A Conversational Question Answering Challenge Siva Reddy Danqi Chen Christopher D. Manning RALM HAI 84 1,197 0 21 Aug 2018
Know What You Don't Know: Unanswerable Questions for SQuAD Pranav Rajpurkar Robin Jia Percy Liang RALM ELM 192 2,830 0 11 Jun 2018
Learning Generic Sentence Representations Using Convolutional Neural Networks Zhe Gan Yunchen Pu Ricardo Henao Chunyuan Li Xiaodong He Lawrence Carin SSL 62 98 0 23 Nov 2016