SpanBERT: Improving Pre-training by Representing and Predicting Spans

24 July 2019

Luke Zettlemoyer

Papers citing "SpanBERT: Improving Pre-training by Representing and Predicting Spans"

50 / 950 papers shown

Title
CIDER: Commonsense Inference for Dialogue Explanation and Reasoning Deepanway Ghosal Pengfei Hong Siqi Shen Navonil Majumder Rada Mihalcea Soujanya Poria 55 22 0 01 Jun 2021
PIGLeT: Language Grounding Through Neuro-Symbolic Interaction in a 3D World Rowan Zellers Ari Holtzman Matthew E. Peters Roozbeh Mottaghi Aniruddha Kembhavi Ali Farhadi Yejin Choi 27 68 0 01 Jun 2021
HiddenCut: Simple Data Augmentation for Natural Language Understanding with Better Generalization Jiaao Chen Dinghan Shen Weizhu Chen Diyi Yang BDL 27 47 0 31 May 2021
Training ELECTRA Augmented with Multi-word Selection Jiaming Shen Jialu Liu Tianqi Liu Cong Yu Jiawei Han 31 9 0 31 May 2021
Pre-training Universal Language Representation Yian Li Hai Zhao SSL 35 8 0 30 May 2021
Is Sluice Resolution really just Question Answering? Peratham Wiriyathammabhum 17 0 0 29 May 2021
Cisco at SemEval-2021 Task 5: What's Toxic?: Leveraging Transformers for Multiple Toxic Span Extraction from Online Comments Sreyan Ghosh Sonal Kumar 38 8 0 28 May 2021
Domain-Adaptive Pretraining Methods for Dialogue Understanding Han Wu Kun Xu Linfeng Song Lifeng Jin Haisong Zhang Linqi Song AI4CE 9 17 0 28 May 2021
IntelliCAT: Intelligent Machine Translation Post-Editing with Quality Estimation and Translation Suggestion Dongjun Lee Junhyeong Ahn Heesoo Park Jaemin Jo 12 18 0 25 May 2021
PTR: Prompt Tuning with Rules for Text Classification Xu Han Weilin Zhao Ning Ding Zhiyuan Liu Maosong Sun VLM 43 514 0 24 May 2021
Killing One Bird with Two Stones: Model Extraction and Attribute Inference Attacks against BERT-based APIs Chen Chen Xuanli He Lingjuan Lyu Fangzhao Wu SILM MIACV 65 7 0 23 May 2021
CEREC: A Corpus for Entity Resolution in Email Conversations Parag Dakle D. Moldovan 23 4 0 21 May 2021
CREAD: Combined Resolution of Ellipses and Anaphora in Dialogues Bo-Hsiang Tseng Shruti Bhargava Jiarui Lu Joel Ruben Antony Moniz Dhivya Piraviperumal Lin Li Hong-ye Yu 17 16 0 20 May 2021
Improving Adverse Drug Event Extraction with SpanBERT on Different Text Typologies Beatrice Portelli Daniele Passabi Edoardo Lenzi G. Serra Enrico Santus Emmanuele Chersoni MedIm 16 13 0 19 May 2021
Relation Classification with Entity Type Restriction Shengfei Lyu Huanhuan Chen 30 68 0 18 May 2021
Improving Lexically Constrained Neural Machine Translation with Source-Conditioned Masked Span Prediction Gyubok Lee Soyoung Yang Edward Choi 37 6 0 12 May 2021
REPT: Bridging Language Models and Machine Reading Comprehension via Retrieval-Based Pre-training Fangkai Jiao Yangyang Guo Yilin Niu Feng Ji Feng-Lin Li Liqiang Nie LRM 34 12 0 10 May 2021
GraphFormers: GNN-nested Transformers for Representation Learning on Textual Graph Junhan Yang Zheng Liu Shitao Xiao Chaozhuo Li Defu Lian Sanjay Agrawal Amit Singh Guangzhong Sun Xing Xie AI4CE 19 149 0 06 May 2021
HerBERT: Efficiently Pretrained Transformer-based Language Model for Polish Robert Mroczkowski Piotr Rybak Alina Wróblewska Ireneusz Gawlik 36 81 0 04 May 2021
ZEN 2.0: Continue Training and Adaption for N-gram Enhanced Text Encoders Yan Song Tong Zhang Yonggang Wang Kai-Fu Lee 46 43 0 04 May 2021
When to Foldém: How to answer Unanswerable questions Marshall Ho Zhipeng Zhou J. He 36 2 0 01 May 2021
An analysis of full-size Russian complexly NER labelled corpus of Internet user reviews on the drugs based on deep learning and language neural nets A. Sboev S. Sboeva I. Moloshnikov A. Gryaznov R. Rybka A. Naumov A. Selivanov Gleb Rylkov Viacheslav Ilyin 31 3 0 30 Apr 2021
SoT: Delving Deeper into Classification Head for Transformer Jiangtao Xie Rui Zeng Qilong Wang Ziqi Zhou P. Li ViT 36 12 0 22 Apr 2021
Evaluating the Impact of a Hierarchical Discourse Representation on Entity Coreference Resolution Performance Sopan Khosla James Fiacco Carolyn Rose 15 3 0 20 Apr 2021
Enhancing Cognitive Models of Emotions with Representation Learning Yuting Guo Jinho Choi 33 5 0 20 Apr 2021
On the Influence of Masking Policies in Intermediate Pre-training Qinyuan Ye Belinda Z. Li Sinong Wang Benjamin Bolte Hao Ma Wen-tau Yih Xiang Ren Madian Khabsa 15 12 0 18 Apr 2021
Zero-shot Slot Filling with DPR and RAG Michael R. Glass Gaetano Rossiello A. Gliozzo 29 1 0 17 Apr 2021
Moving on from OntoNotes: Coreference Resolution Model Transfer Patrick Xia Benjamin Van Durme 33 30 0 17 Apr 2021
Neural Path Hunter: Reducing Hallucination in Dialogue Systems via Path Grounding Nouha Dziri Andrea Madotto Osmar Zaiane A. Bose HILM 28 132 0 17 Apr 2021
Three-level Hierarchical Transformer Networks for Long-sequence and Multiple Clinical Documents Classification Yuqi Si Kirk Roberts 27 9 0 17 Apr 2021
Re-TACRED: Addressing Shortcomings of the TACRED Dataset George Stoica Emmanouil Antonios Platanios Barnabas Poczos 41 113 0 16 Apr 2021
AMMU : A Survey of Transformer-based Biomedical Pretrained Language Models Katikapalli Subramanyam Kalyan A. Rajasekharan S. Sangeetha LM&MA MedIm 31 164 0 16 Apr 2021
How to Train BERT with an Academic Budget Peter Izsak Moshe Berchansky Omer Levy 23 114 0 15 Apr 2021
KnowPrompt: Knowledge-aware Prompt-tuning with Synergistic Optimization for Relation Extraction Xiang Chen Ningyu Zhang Xin Xie Shumin Deng Yunzhi Yao Chuanqi Tan Fei Huang Luo Si Huajun Chen 43 402 0 15 Apr 2021
Adapting Coreference Resolution Models through Active Learning Michelle Yuan Patrick Xia Chandler May Benjamin Van Durme Jordan L. Boyd-Graber 20 20 0 15 Apr 2021
Lattice-BERT: Leveraging Multi-Granularity Representations in Chinese Pre-trained Language Models Yuxuan Lai Yijia Liu Yansong Feng Songfang Huang Dongyan Zhao VLM AI4CE 40 37 0 15 Apr 2021
Few-shot Intent Classification and Slot Filling with Retrieved Examples Dian Yu Luheng He Yuan Zhang Xinya Du Panupong Pasupat Qi Li VLM 33 50 0 12 Apr 2021
Stay Together: A System for Single and Split-antecedent Anaphora Resolution Juntao Yu N. Moosavi Silviu Paun Massimo Poesio 24 14 0 12 Apr 2021
UTNLP at SemEval-2021 Task 5: A Comparative Analysis of Toxic Span Detection using Attention-based, Named Entity Recognition, and Ensemble Models Alireza Salemi Nazanin Sabri Emad Kebriaei B. Bahrak A. Shakery 14 3 0 10 Apr 2021
WLV-RIT at SemEval-2021 Task 5: A Neural Transformer Framework for Detecting Toxic Spans Tharindu Ranasinghe Diptanu Sarkar Marcos Zampieri Alexander Ororbia MedIm 27 13 0 09 Apr 2021
UPB at SemEval-2021 Task 8: Extracting Semantic Information on Measurements as Multi-Turn Question Answering Andrei-Marius Avram George-Eduard Zaharia Dumitru-Clementin Cercel M. Dascalu 27 2 0 09 Apr 2021
Video Question Answering with Phrases via Semantic Roles Arka Sadhu Kan Chen Ram Nevatia 16 15 0 08 Apr 2021
A New Approach to Overgenerating and Scoring Abstractive Summaries Kaiqiang Song Bingqing Wang Z. Feng Fei Liu 22 17 0 05 Apr 2021
A Context-Dependent Gated Module for Incorporating Symbolic Semantics into Event Coreference Resolution T. Lai Heng Ji Trung Bui Quan Hung Tran Franck Dernoncourt Walter Chang 35 27 0 04 Apr 2021
Normal vs. Adversarial: Salience-based Analysis of Adversarial Samples for Relation Extraction Luoqiu Li Xiang Chen Zhen Bi Xin Xie Shumin Deng Ningyu Zhang Chuanqi Tan Mosha Chen Huajun Chen AAML 39 7 0 01 Apr 2021
Deep Neural Approaches to Relation Triplets Extraction: A Comprehensive Survey Tapas Nayak Navonil Majumder Pawan Goyal Soujanya Poria ViT 21 49 0 31 Mar 2021
InsertGNN: Can Graph Neural Networks Outperform Humans in TOEFL Sentence Insertion Problem? Fan Wu X. Bai GNN 8 3 0 28 Mar 2021
Predicting Directionality in Causal Relations in Text Pedram Hosseini David A. Broniatowski Mona T. Diab CML 22 11 0 25 Mar 2021
The NLP Cookbook: Modern Recipes for Transformer based Deep Learning Architectures Sushant Singh A. Mahmood AI4TS 60 94 0 23 Mar 2021
BERT: A Review of Applications in Natural Language Processing and Understanding M. V. Koroteev VLM 25 197 0 22 Mar 2021