v1v2v3 (latest)

SpanBERT: Improving Pre-training by Representing and Predicting Spans

24 July 2019

Luke Zettlemoyer

Papers citing "SpanBERT: Improving Pre-training by Representing and Predicting Spans"

50 / 955 papers shown

Title
A New Approach to Overgenerating and Scoring Abstractive Summaries Kaiqiang Song Bingqing Wang Z. Feng Fei Liu 110 17 0 05 Apr 2021
A Context-Dependent Gated Module for Incorporating Symbolic Semantics into Event Coreference Resolution T. Lai Heng Ji Trung Bui Quan Hung Tran Franck Dernoncourt Walter Chang 56 28 0 04 Apr 2021
Normal vs. Adversarial: Salience-based Analysis of Adversarial Samples for Relation Extraction Luoqiu Li Xiang Chen Zhen Bi Xin Xie Shumin Deng Ningyu Zhang Chuanqi Tan Mosha Chen Huajun Chen AAML 112 7 0 01 Apr 2021
Deep Neural Approaches to Relation Triplets Extraction: A Comprehensive Survey Tapas Nayak Navonil Majumder Pawan Goyal Soujanya Poria ViT 62 52 0 31 Mar 2021
InsertGNN: Can Graph Neural Networks Outperform Humans in TOEFL Sentence Insertion Problem? Fan Wu X. Bai GNN 18 3 0 28 Mar 2021
Predicting Directionality in Causal Relations in Text Pedram Hosseini David A. Broniatowski Mona T. Diab CML 45 11 0 25 Mar 2021
The NLP Cookbook: Modern Recipes for Transformer based Deep Learning Architectures Sushant Singh A. Mahmood AI4TS 111 95 0 23 Mar 2021
BERT: A Review of Applications in Natural Language Processing and Understanding M. V. Koroteev VLM 134 225 0 22 Mar 2021
Self-Supervised Test-Time Learning for Reading Comprehension Pratyay Banerjee Tejas Gokhale Chitta Baral SSL 59 29 0 20 Mar 2021
GLM: General Language Model Pretraining with Autoregressive Blank Infilling Zhengxiao Du Yujie Qian Xiao Liu Ming Ding J. Qiu Zhilin Yang Jie Tang BDL AI4CE 162 1,565 0 18 Mar 2021
Structure Inducing Pre-Training Matthew B. A. McDermott Brendan Yap Peter Szolovits Marinka Zitnik 93 21 0 18 Mar 2021
Cooperative Self-training of Machine Reading Comprehension Hongyin Luo Shang-Wen Li Ming Gao Seunghak Yu James R. Glass SyDa RALM 37 12 0 12 Mar 2021
FairFil: Contrastive Neural Debiasing Method for Pretrained Text Encoders Pengyu Cheng Weituo Hao Siyang Yuan Shijing Si Lawrence Carin 77 105 0 11 Mar 2021
Select, Substitute, Search: A New Benchmark for Knowledge-Augmented Visual Question Answering Aman Jain Mayank Kothyari Vishwajeet Kumar Preethi Jyothi Ganesh Ramakrishnan Soumen Chakrabarti 68 36 0 09 Mar 2021
OAG-BERT: Towards A Unified Backbone Language Model For Academic Knowledge Services Xiao Liu Da Yin Jingnan Zheng Xingjian Zhang Peng Zhang Hongxia Yang Yuxiao Dong Jie Tang VLM 102 32 0 03 Mar 2021
NLRG at SemEval-2021 Task 5: Toxic Spans Detection Leveraging BERT-based Token Classification and Span Prediction Techniques Gunjan Chhablani Abheesht Sharma Harshit Pandey Yash Bhartia S. Suthaharan 33 14 0 24 Feb 2021
Using Prior Knowledge to Guide BERT's Attention in Semantic Textual Matching Tasks Tingyu Xia Yue Wang Yuan Tian Yi-Ju Chang 65 51 0 22 Feb 2021
WebRED: Effective Pretraining And Finetuning For Relation Extraction On The Web Róbert Ormándi Mohammad Saleh Erin Winter Vinay Rao 51 11 0 18 Feb 2021
MUDES: Multilingual Detection of Offensive Spans Tharindu Ranasinghe Marcos Zampieri 83 41 0 18 Feb 2021
Less is More: Pre-train a Strong Text Encoder for Dense Retrieval Using a Weak Decoder Shuqi Lu Di He Chenyan Xiong Guolin Ke Waleed Malik Zhicheng Dou Paul N. Bennett Tie-Yan Liu Arnold Overwijk RALM 118 11 0 18 Feb 2021
COCO-LM: Correcting and Contrasting Text Sequences for Language Model Pretraining Yu Meng Chenyan Xiong Payal Bajaj Saurabh Tiwary Paul N. Bennett Jiawei Han Xia Song 182 205 0 16 Feb 2021
Boosting Low-Resource Biomedical QA via Entity-Aware Masking Strategies Gabriele Pergola E. Kochkina Lin Gui Maria Liakata Yulan He 145 32 0 16 Feb 2021
DOBF: A Deobfuscation Pre-Training Objective for Programming Languages Baptiste Roziere Marie-Anne Lachaux Marc Szafraniec Guillaume Lample AI4CE 148 141 0 15 Feb 2021
Decontextualization: Making Sentences Stand-Alone Eunsol Choi J. Palomaki Matthew Lamm Tom Kwiatkowski Dipanjan Das Michael Collins 65 100 0 09 Feb 2021
CSS-LM: A Contrastive Framework for Semi-supervised Fine-tuning of Pre-trained Language Models Yusheng Su Xu Han Yankai Lin Zhengyan Zhang Zhiyuan Liu Peng Li Jie Zhou Maosong Sun 73 10 0 07 Feb 2021
Do Question Answering Modeling Improvements Hold Across Benchmarks? Nelson F. Liu Tony Lee Robin Jia Percy Liang 86 13 0 01 Feb 2021
CD2CR: Co-reference Resolution Across Documents and Domains James Ravenscroft Arie Cattan A. Clare Ido Dagan Maria Liakata 134 8 0 29 Jan 2021
LOME: Large Ontology Multilingual Extraction Patrick Xia Guanghui Qin Siddharth Vashishtha Yunmo Chen Tongfei Chen Chandler May Craig Harman Kyle Rawlins A. White Benjamin Van Durme 97 42 0 28 Jan 2021
Modeling Context in Answer Sentence Selection Systems on a Latency Budget Rujun Han Luca Soldaini Alessandro Moschitti 83 14 0 28 Jan 2021
BENDR: using transformers and a contrastive self-supervised learning task to learn from massive amounts of EEG data Demetres Kostas Stephane Aroca-Ouellette Frank Rudzicz SSL 120 210 0 28 Jan 2021
KoreALBERT: Pretraining a Lite BERT Model for Korean Language Understanding HyunJae Lee Jaewoong Yoon Bonggyu Hwang Seongho Joe Seungjai Min Youngjune Gwon SSeg 58 16 0 27 Jan 2021
Joint Coreference Resolution and Character Linking for Multiparty Conversation Jiaxin Bai Hongming Zhang Yangqiu Song Kun Xu 80 7 0 27 Jan 2021
WangchanBERTa: Pretraining transformer-based Thai Language Models Lalita Lowphansirikul Charin Polpanumas Nawat Jantrakulchai Sarana Nutanong 56 76 0 24 Jan 2021
LIME: Learning Inductive Bias for Primitives of Mathematical Reasoning Yuhuai Wu M. Rabe Wenda Li Jimmy Ba Roger C. Grosse Christian Szegedy AIMat LRM 142 57 0 15 Jan 2021
Structured Prediction as Translation between Augmented Natural Languages Giovanni Paolini Ben Athiwaratkun Jason Krone Jie Ma Alessandro Achille Rishita Anubhai Cicero Nogueira dos Santos Bing Xiang Stefano Soatto 90 295 0 14 Jan 2021
BERT & Family Eat Word Salad: Experiments with Text Understanding Ashim Gupta Giorgi Kvernadze Vivek Srikumar 258 73 0 10 Jan 2021
SF-QA: Simple and Fair Evaluation Library for Open-domain Question Answering Xiaopeng Lu Kyusong Lee Tiancheng Zhao 43 0 0 06 Jan 2021
EfficientQA : a RoBERTa Based Phrase-Indexed Question-Answering System Sofian Chaybouti Achraf Saghe A. Shabou RALM 137 8 0 06 Jan 2021
Retrieving and Reading: A Comprehensive Survey on Open-domain Question Answering Fengbin Zhu Wenqiang Lei Chao Wang Jianming Zheng Soujanya Poria Tat-Seng Chua RALM 277 257 0 04 Jan 2021
Few-Shot Question Answering by Pretraining Span Selection Ori Ram Yuval Kirstain Jonathan Berant Amir Globerson Omer Levy 104 98 0 02 Jan 2021
Coreference Resolution without Span Representations Yuval Kirstain Ori Ram Omer Levy 86 72 0 02 Jan 2021
Improving Sequence-to-Sequence Pre-training via Sequence Span Rewriting Wangchunshu Zhou Tao Ge Canwen Xu Ke Xu Furu Wei LRM 83 16 0 02 Jan 2021
BanglaBERT: Language Model Pretraining and Benchmarks for Low-Resource Language Understanding Evaluation in Bangla Abhik Bhattacharjee Tahmid Hasan Wasi Uddin Ahmad Kazi Samin Mubasshir Md. Saiful Islam Anindya Iqbal M. Rahman Rifat Shahriyar SSL VLM 101 180 0 01 Jan 2021
Studying Strategically: Learning to Mask for Closed-book QA Qinyuan Ye Belinda Z. Li Sinong Wang Benjamin Bolte Hao Ma Wen-tau Yih Xiang Ren Madian Khabsa OffRL 79 12 0 31 Dec 2020
MiniLMv2: Multi-Head Self-Attention Relation Distillation for Compressing Pretrained Transformers Wenhui Wang Hangbo Bao Shaohan Huang Li Dong Furu Wei MQ 127 274 0 31 Dec 2020
CoCoLM: COmplex COmmonsense Enhanced Language Model with Discourse Relations Changlong Yu Hongming Zhang Yangqiu Song Wilfred Ng 117 21 0 31 Dec 2020
UNIMO: Towards Unified-Modal Understanding and Generation via Cross-Modal Contrastive Learning Wei Li Can Gao Guocheng Niu Xinyan Xiao Hao Liu Jiachen Liu Hua Wu Haifeng Wang 142 381 0 31 Dec 2020
CMV-BERT: Contrastive multi-vocab pretraining of BERT Wei-wei Zhu Daniel Cheung SSL VLM 72 0 0 29 Dec 2020
BURT: BERT-inspired Universal Representation from Learning Meaningful Segment Yian Li Hai Zhao SSL 35 0 0 28 Dec 2020
An Embarrassingly Simple Model for Dialogue Relation Extraction Fuzhao Xue Aixin Sun Hao Zhang Jinjie Ni Eng Siong Chng 69 28 0 27 Dec 2020