SpanBERT: Improving Pre-training by Representing and Predicting Spans

24 July 2019

Luke Zettlemoyer

Papers citing "SpanBERT: Improving Pre-training by Representing and Predicting Spans"

50 / 950 papers shown

Title
A Graph Reasoning Network for Multi-turn Response Selection via Customized Pre-training Yongkang Liu Shi Feng Daling Wang Kaisong Song Feiliang Ren Yifei Zhang LRM 21 21 0 21 Dec 2020
Learning from Mistakes: Using Mis-predictions as Harm Alerts in Language Pre-Training Chen Xing Wenhao Liu Caiming Xiong 29 0 0 16 Dec 2020
Trex: Learning Execution Semantics from Micro-Traces for Binary Similarity Kexin Pei Zhou Xuan Junfeng Yang Suman Jana Baishakhi Ray 27 89 0 16 Dec 2020
GDPNet: Refining Latent Multi-View Graph for Relation Extraction Fuzhao Xue Aixin Sun Hao Zhang Eng Siong Chng 29 86 0 12 Dec 2020
Improving Relation Extraction by Leveraging Knowledge Graph Link Prediction George Stoica Emmanouil Antonios Platanios Barnabas Poczos ReLM 14 3 0 09 Dec 2020
CrossNER: Evaluating Cross-Domain Named Entity Recognition Zihan Liu Yan Xu Tiezheng Yu Wenliang Dai Ziwei Ji Samuel Cahyawijaya Andrea Madotto Pascale Fung 78 146 0 08 Dec 2020
Facts2Story: Controlling Text Generation by Key Facts Eyal Orbach Yoav Goldberg 25 16 0 08 Dec 2020
CTRLsum: Towards Generic Controllable Text Summarization Junxian He Wojciech Kry'sciñski Bryan McCann Nazneen Rajani Caiming Xiong 216 138 0 08 Dec 2020
KgPLM: Knowledge-guided Language Model Pre-training via Generative and Discriminative Learning Bin He Xin Jiang Jinghui Xiao Qun Liu 37 18 0 07 Dec 2020
Data-Efficient Methods for Dialogue Systems Igor Shalyminov 14 0 0 05 Dec 2020
RPT: Relational Pre-trained Transformer Is Almost All You Need towards Democratizing Data Preparation Nan Tang Ju Fan Fangyi Li Jianhong Tu Xiaoyong Du Guoliang Li Samuel Madden M. Ouzzani 31 74 0 04 Dec 2020
Self-Explaining Structures Improve NLP Models Zijun Sun Chun Fan Qinghong Han Xiaofei Sun Yuxian Meng Fei Wu Jiwei Li MILM XAI LRM FAtt 46 38 0 03 Dec 2020
Evaluating Explanations: How much do explanations from the teacher aid students? Danish Pruthi Rachit Bansal Bhuwan Dhingra Livio Baldini Soares Michael Collins Zachary Chase Lipton Graham Neubig William W. Cohen FAtt XAI 17 108 0 01 Dec 2020
Intrinsic Knowledge Evaluation on Chinese Language Models Zhiruo Wang Renfen Hu KELM ELM 16 1 0 29 Nov 2020
Enhancing deep neural networks with morphological information Matej Klemen Luka Krsnik Marko Robnik-Šikonja 39 12 0 24 Nov 2020
Generalizing Cross-Document Event Coreference Resolution Across Multiple Corpora M. Bugert Nils Reimers Iryna Gurevych 29 17 0 24 Nov 2020
Entity Recognition and Relation Extraction from Scientific and Technical Texts in Russian E. Bruches Alexey Pauls Tatiana Batura Vladimir Isachenko 19 7 0 19 Nov 2020
A Hierarchical Multi-Modal Encoder for Moment Localization in Video Corpus Bowen Zhang Hexiang Hu Joonseok Lee Mingde Zhao Sheide Chammas Vihan Jain Eugene Ie Fei Sha 25 30 0 18 Nov 2020
Neural Semi-supervised Learning for Text Classification Under Large-Scale Pretraining Zijun Sun Chun Fan Xiaofei Sun Yuxian Meng Fei Wu Jiwei Li 29 9 0 17 Nov 2020
MVP-BERT: Redesigning Vocabularies for Chinese BERT and Multi-Vocab Pretraining Wei-wei Zhu VLM 16 6 0 17 Nov 2020
CapWAP: Captioning with a Purpose Adam Fisch Kenton Lee Ming-Wei Chang J. Clark Regina Barzilay 10 11 0 09 Nov 2020
Context-Aware Answer Extraction in Question Answering Yeon Seonwoo Ji-Hoon Kim Jung-Woo Ha Alice Oh 12 27 0 05 Nov 2020
A Benchmark of Rule-Based and Neural Coreference Resolution in Dutch Novels and News Corben Poot Andreas van Cranenburgh 31 16 0 03 Nov 2020
Exploring Question-Specific Rewards for Generating Deep Questions Yuxi Xie Liangming Pan Dongzhe Wang Min-Yen Kan Yansong Feng 53 27 0 02 Nov 2020
Emergent Communication Pretraining for Few-Shot Machine Translation Yaoyiran Li Edoardo Ponti Ivan Vulić Anna Korhonen 27 19 0 02 Nov 2020
MixKD: Towards Efficient Distillation of Large-scale Language Models Kevin J. Liang Weituo Hao Dinghan Shen Yufan Zhou Weizhu Chen Changyou Chen Lawrence Carin 21 73 0 01 Nov 2020
Neural Coreference Resolution for Arabic Abdulrahman Aloraini Juntao Yu Massimo Poesio 19 14 0 31 Oct 2020
Free the Plural: Unrestricted Split-Antecedent Anaphora Resolution Juntao Yu N. Moosavi Silviu Paun Massimo Poesio 35 14 0 31 Oct 2020
SLM: Learning a Discourse Language Representation with Sentence Unshuffling Haejun Lee Drew A. Hudson Kangwook Lee Christopher D. Manning SSL 25 50 0 30 Oct 2020
RuREBus: a Case Study of Joint Named Entity Recognition and Relation Extraction from e-Government Domain V. Ivanin Ekaterina Artemova Tatiana Batura V. Ivanov V. Sarkisyan E. Tutubalina I. Smurov 16 0 0 29 Oct 2020
CopyNext: Explicit Span Copying and Alignment in Sequence to Sequence Models Abhinav Singh Patrick Xia Guanghui Qin M. Yarmohammadi Benjamin Van Durme SyDa 17 2 0 28 Oct 2020
A Comprehensive Survey on Word Representation Models: From Classical to State-Of-The-Art Word Representation Language Models Usman Naseem Imran Razzak S. Khan M. Prasad 16 156 0 28 Oct 2020
HarperValleyBank: A Domain-Specific Spoken Dialog Corpus Mike Wu J. Nafziger A. Scodary Andrew L. Maas 31 17 0 26 Oct 2020
Accelerating Training of Transformer-Based Language Models with Progressive Layer Dropping Minjia Zhang Yuxiong He AI4CE 13 100 0 26 Oct 2020
Two-stage Textual Knowledge Distillation for End-to-End Spoken Language Understanding Seongbin Kim Gyuwan Kim Seongjin Shin Sangmin Lee VLM 18 19 0 25 Oct 2020
Deep Clustering of Text Representations for Supervision-free Probing of Syntax Vikram Gupta Haoyue Shi Kevin Gimpel Mrinmaya Sachan 37 9 0 24 Oct 2020
Unsupervised Multi-hop Question Answering by Question Generation Liangming Pan Wenhu Chen Wenhan Xiong Min-Yen Kan William Yang Wang 37 59 0 23 Oct 2020
ERNIE-Gram: Pre-Training with Explicitly N-Gram Masked Language Modeling for Natural Language Understanding Dongling Xiao Yukun Li Han Zhang Yu Sun Hao Tian Hua Wu Haifeng Wang 27 38 0 23 Oct 2020
Knowledge Distillation for BERT Unsupervised Domain Adaptation Minho Ryu K. Lee 18 35 0 22 Oct 2020
MAM: Masked Acoustic Modeling for End-to-End Speech-to-Text Translation Junkun Chen Mingbo Ma Renjie Zheng Liang Huang 24 21 0 22 Oct 2020
Bootleg: Chasing the Tail with Self-Supervised Named Entity Disambiguation Laurel J. Orr Megan Leszczynski Simran Arora Sen Wu Neel Guha Xiao Ling Christopher Ré 143 48 0 20 Oct 2020
A Graph Representation of Semi-structured Data for Web Question Answering Xingyao Zhang Linjun Shou J. Pei Ming Gong Lijie Wen Daxin Jiang LMTD 18 14 0 14 Oct 2020
CAPT: Contrastive Pre-Training for Learning Denoised Sequence Representations Fuli Luo Pengcheng Yang Shicheng Li Xuancheng Ren Xu Sun VLM SSL 21 16 0 13 Oct 2020
Model Selection for Cross-Lingual Transfer Yang Chen Alan Ritter 25 12 0 13 Oct 2020
TextHide: Tackling Data Privacy in Language Understanding Tasks Yangsibo Huang Zhao Song Danqi Chen Keqin Li Sanjeev Arora FedML 16 56 0 12 Oct 2020
Improving Self-supervised Pre-training via a Fully-Explored Masked Language Model Ming Zheng Dinghan Shen Yelong Shen Weizhu Chen Lin Xiao SSL 24 4 0 12 Oct 2020
Using Type Information to Improve Entity Coreference Resolution Sopan Khosla Carolyn Rose NAI 14 18 0 12 Oct 2020
Relation Classification as Two-way Span-Prediction Amir D. N. Cohen Shachar Rosenman Yoav Goldberg 19 18 0 09 Oct 2020
Exposing Shallow Heuristics of Relation Extraction Models with Challenge Data Shachar Rosenman Alon Jacovi Yoav Goldberg 19 28 0 07 Oct 2020
Improving the Efficiency of Grammatical Error Correction with Erroneous Span Detection and Correction M. Chen Tao Ge Xingxing Zhang Furu Wei M. Zhou 27 46 0 07 Oct 2020