v1v2v3 (latest)

SpanBERT: Improving Pre-training by Representing and Predicting Spans

24 July 2019

Luke Zettlemoyer

Papers citing "SpanBERT: Improving Pre-training by Representing and Predicting Spans"

50 / 955 papers shown

Title
TextHide: Tackling Data Privacy in Language Understanding Tasks Yangsibo Huang Zhao Song Danqi Chen Keqin Li Sanjeev Arora FedML 51 56 0 12 Oct 2020
Improving Self-supervised Pre-training via a Fully-Explored Masked Language Model Ming Zheng Dinghan Shen Yelong Shen Weizhu Chen Lin Xiao SSL 29 4 0 12 Oct 2020
Using Type Information to Improve Entity Coreference Resolution Sopan Khosla Carolyn Rose NAI 49 18 0 12 Oct 2020
Relation Classification as Two-way Span-Prediction Amir D. N. Cohen Shachar Rosenman Yoav Goldberg 79 18 0 09 Oct 2020
Exposing Shallow Heuristics of Relation Extraction Models with Challenge Data Shachar Rosenman Alon Jacovi Yoav Goldberg 77 29 0 07 Oct 2020
Improving the Efficiency of Grammatical Error Correction with Erroneous Span Detection and Correction M. Chen Tao Ge Xingxing Zhang Furu Wei M. Zhou 87 47 0 07 Oct 2020
Learning to Ignore: Long Document Coreference with Bounded Memory Neural Networks Shubham Toshniwal Sam Wiseman Allyson Ettinger Karen Livescu Kevin Gimpel 158 49 0 06 Oct 2020
Neural Mask Generator: Learning to Generate Adaptive Word Maskings for Language Model Adaptation Minki Kang Moonsu Han Sung Ju Hwang OOD 73 18 0 06 Oct 2020
PMI-Masking: Principled masking of correlated spans Yoav Levine Barak Lenz Opher Lieber Omri Abend Kevin Leyton-Brown Moshe Tennenholtz Y. Shoham 66 73 0 05 Oct 2020
On Losses for Modern Language Models Stephane Aroca-Ouellette Frank Rudzicz 81 32 0 04 Oct 2020
LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attention Ikuya Yamada Akari Asai Hiroyuki Shindo Hideaki Takeda Yuji Matsumoto 135 676 0 02 Oct 2020
Unsupervised Text Style Transfer with Padded Masked Language Models Eric Malmi Aliaksei Severyn S. Rothe 62 12 0 02 Oct 2020
Which *BERT? A Survey Organizing Contextualized Encoders Patrick Xia Shijie Wu Benjamin Van Durme 62 50 0 02 Oct 2020
MaP: A Matrix-based Prediction Approach to Improve Span Extraction in Machine Reading Comprehension Huaishao Luo Yu Shi Ming Gong Linjun Shou Tianrui Li 26 4 0 29 Sep 2020
CokeBERT: Contextual Knowledge Selection and Embedding towards Enhanced Pre-Trained Language Models Yusheng Su Xu Han Zhengyan Zhang Peng Li Zhiyuan Liu Yankai Lin Jie Zhou Maosong Sun ODL 80 25 0 29 Sep 2020
A Simple but Tough-to-Beat Data Augmentation Approach for Natural Language Understanding and Generation Dinghan Shen Ming Zheng Yelong Shen Yanru Qu Weizhu Chen AAML 99 132 0 29 Sep 2020
Incomplete Utterance Rewriting as Semantic Segmentation Qian Liu Bei Chen Jian-Guang Lou Bin Zhou Dongmei Zhang 79 56 0 28 Sep 2020
SPARTA: Efficient Open-Domain Question Answering via Sparse Transformer Matching Retrieval Tiancheng Zhao Xiaopeng Lu Kyusong Lee RALM 96 87 0 28 Sep 2020
Unsupervised Pre-training for Biomedical Question Answering Vaishnavi Kommaraju K. Gunasekaran Kun Li Trapit Bansal Andrew McCallum Ivana Williams Ana-Maria Istrate SSL MedIm 50 18 0 27 Sep 2020
A Brief Survey and Comparative Study of Recent Development of Pronoun Coreference Resolution Hongming Zhang Xinran Zhao Yangqiu Song 73 10 0 27 Sep 2020
Revealing the Myth of Higher-Order Inference in Coreference Resolution Liyan Xu Jinho Choi 83 101 0 25 Sep 2020
MinTL: Minimalist Transfer Learning for Task-Oriented Dialogue Systems Zhaojiang Lin Andrea Madotto Genta Indra Winata Pascale Fung 81 173 0 25 Sep 2020
Type B Reflexivization as an Unambiguous Testbed for Multilingual Multi-Task Gender Bias Ana Valeria González Maria Barrett Rasmus Hvingelby Kellie Webster Anders Søgaard 56 27 0 24 Sep 2020
Streamlining Cross-Document Coreference Resolution: Evaluation and Modeling Arie Cattan Alon Eirew Gabriel Stanovsky Mandar Joshi Ido Dagan 89 35 0 23 Sep 2020
AutoRC: Improving BERT Based Relation Classification Models via Architecture Search Wei-wei Zhu Xipeng Qiu Yuan Ni Guotong Xie 53 18 0 22 Sep 2020
Latin BERT: A Contextual Language Model for Classical Philology David Bamman P. Burns 41 79 0 21 Sep 2020
Improving Robustness and Generality of NLP Models Using Disentangled Representations Jiawei Wu Xiaoya Li Xiang Ao Yuxian Meng Leilei Gan Jiwei Li OOD DRL 36 11 0 21 Sep 2020
Understanding Mention Detector-Linker Interaction in Neural Coreference Resolution Zhaofeng Wu Matt Gardner 43 9 0 20 Sep 2020
Knowledge Transfer via Pre-training for Recommendation: A Review and Prospect Zheni Zeng Chaojun Xiao Yuan Yao Ruobing Xie Zhiyuan Liu Fen Lin Leyu Lin Maosong Sun VLM 70 41 0 19 Sep 2020
Conditionally Adaptive Multi-Task Learning: Improving Transfer Learning in NLP Using Fewer Parameters & Less Data Jonathan Pilault Amine Elhattami C. Pal CLL MoE 90 91 0 19 Sep 2020
Improving Coreference Resolution by Leveraging Entity-Centric Features with Graph Neural Networks and Second-order Inference Lu Liu Zhenqiao Song Xiaoqing Zheng Jun He 38 6 0 10 Sep 2020
QED: A Framework and Dataset for Explanations in Question Answering Matthew Lamm J. Palomaki Chris Alberti D. Andor Eunsol Choi Livio Baldini Soares Michael Collins 70 69 0 08 Sep 2020
E-BERT: A Phrase and Product Knowledge Enhanced Language Model for E-commerce Denghui Zhang Zixuan Yuan Yanchi Liu Fuzhen Zhuang Haifeng Chen Hui Xiong 84 34 0 07 Sep 2020
Attention Flows: Analyzing and Comparing Attention Mechanisms in Language Models Joseph F DeRose Jiayao Wang M. Berger 65 84 0 03 Sep 2020
Entity and Evidence Guided Relation Extraction for DocRED Kevin Huang Guangtao Wang Tengyu Ma Jing Huang 71 9 0 27 Aug 2020
AMBERT: A Pre-trained Language Model with Multi-Grained Tokenization Xinsong Zhang Pengshuai Li Hang Li 95 52 0 27 Aug 2020
syrapropa at SemEval-2020 Task 11: BERT-based Models Design For Propagandistic Technique and Span Detection Jinfen Li Lu Xiao 44 8 0 24 Aug 2020
ConvBERT: Improving BERT with Span-based Dynamic Convolution Zihang Jiang Weihao Yu Daquan Zhou Yunpeng Chen Jiashi Feng Shuicheng Yan 135 162 0 06 Aug 2020
A Survey on Text Classification: From Shallow to Deep Learning Qian Li Hao Peng Jianxin Li Congyin Xia Renyu Yang Lichao Sun Philip S. Yu Lifang He VLM 174 358 0 02 Aug 2020
On Learning Universal Representations Across Languages Xiangpeng Wei Rongxiang Weng Yue Hu Luxi Xing Heng Yu Weihua Luo SSL VLM 99 87 0 31 Jul 2020
Big Bird: Transformers for Longer Sequences Manzil Zaheer Guru Guruganesh Kumar Avinava Dubey Joshua Ainslie Chris Alberti ... Philip Pham Anirudh Ravula Qifan Wang Li Yang Amr Ahmed VLM 611 2,109 0 28 Jul 2020
Multi-task learning for natural language processing in the 2020s: where are we going? Joseph Worsham Jugal Kalita AIMat 73 81 0 22 Jul 2020
IITK-RSA at SemEval-2020 Task 5: Detecting Counterfactuals Anirudh Ojha Rohin Garg Shashank Gupta Ashutosh Modi 34 6 0 21 Jul 2020
newsSweeper at SemEval-2020 Task 11: Context-Aware Rich Feature Representations For Propaganda Classification Paramansh Singh Siraj Sandhu Subham Kumar Ashutosh Modi 16 9 0 21 Jul 2020
What's in a Name? Are BERT Named Entity Representations just as Good for any other Name? S. Balasubramanian Naman Jain G. Jindal Abhijeet Awasthi Sunita Sarawagi OOD 98 26 0 14 Jul 2020
LMVE at SemEval-2020 Task 4: Commonsense Validation and Explanation using Pretraining Language Model Shilei Liu Yu Guo Bochao Li Feiliang Ren LRM 81 4 0 06 Jul 2020
EmotionGIF-Yankee: A Sentiment Classifier with Robust Model Based Ensemble Methods Wei-Yao Wang Kai-Shiang Chang Yu-Chien Tang 23 4 0 05 Jul 2020
A Survey on Self-supervised Pre-training for Sequential Transfer Learning in Neural Networks H. H. Mao BDL SSL 72 50 0 01 Jul 2020
Iterative Paraphrastic Augmentation with Discriminative Span Alignment Ryan Culkin J. E. Hu Elias Stengel-Eskin Guanghui Qin Benjamin Van Durme 50 6 0 01 Jul 2020
Exploring Software Naturalness through Neural Language Models Luca Buratti Saurabh Pujar Mihaela A. Bornea Scott McCarley Yunhui Zheng ... Alessandro Morari Jim Laredo Veronika Thost Yufan Zhuang Giacomo Domeniconi 89 98 0 22 Jun 2020