ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 1907.10529
  4. Cited By
SpanBERT: Improving Pre-training by Representing and Predicting Spans
v1v2v3 (latest)

SpanBERT: Improving Pre-training by Representing and Predicting Spans

24 July 2019
Mandar Joshi
Danqi Chen
Yinhan Liu
Daniel S. Weld
Luke Zettlemoyer
Omer Levy
ArXiv (abs)PDFHTML

Papers citing "SpanBERT: Improving Pre-training by Representing and Predicting Spans"

50 / 956 papers shown
Title
Should We Rely on Entity Mentions for Relation Extraction? Debiasing
  Relation Extraction with Counterfactual Analysis
Should We Rely on Entity Mentions for Relation Extraction? Debiasing Relation Extraction with Counterfactual Analysis
Yiwei Wang
Muhao Chen
Wenxuan Zhou
Yujun Cai
Yuxuan Liang
Dayiheng Liu
Baosong Yang
Juncheng Liu
Bryan Hooi
CML
50
53
0
08 May 2022
KECP: Knowledge Enhanced Contrastive Prompting for Few-shot Extractive
  Question Answering
KECP: Knowledge Enhanced Contrastive Prompting for Few-shot Extractive Question Answering
Jiadong Wang
Chengyu Wang
Minghui Qiu
Qiuhui Shi
Hongbin Wang
Jun Huang
Ming Gao
RALM
57
17
0
06 May 2022
Assistive Recipe Editing through Critiquing
Assistive Recipe Editing through Critiquing
Diego Antognini
Shuyang Li
Boi Faltings
Julian McAuley
67
2
0
05 May 2022
Relation Extraction as Open-book Examination: Retrieval-enhanced Prompt
  Tuning
Relation Extraction as Open-book Examination: Retrieval-enhanced Prompt Tuning
Xiang Chen
Lei Li
Ningyu Zhang
Chuanqi Tan
Fei Huang
Luo Si
Huajun Chen
RALMVLM
80
40
0
04 May 2022
Modeling Task Interactions in Document-Level Joint Entity and Relation
  Extraction
Modeling Task Interactions in Document-Level Joint Entity and Relation Extraction
Liyan Xu
Jinho Choi
50
7
0
04 May 2022
Go Back in Time: Generating Flashbacks in Stories with Event Temporal
  Prompts
Go Back in Time: Generating Flashbacks in Stories with Event Temporal Prompts
Rujun Han
Hong Chen
Yufei Tian
Nanyun Peng
71
18
0
04 May 2022
Unified Semantic Typing with Meaningful Label Inference
Unified Semantic Typing with Meaningful Label Inference
James Y. Huang
Bangzheng Li
Lyne Tchapmi
Muhao Chen
88
32
0
04 May 2022
Paragraph-based Transformer Pre-training for Multi-Sentence Inference
Paragraph-based Transformer Pre-training for Multi-Sentence Inference
Luca Di Liello
Siddhant Garg
Luca Soldaini
Alessandro Moschitti
51
8
0
02 May 2022
Entity-aware Transformers for Entity Search
Entity-aware Transformers for Entity Search
E. Gerritse
Faegheh Hasibi
A. D. Vries
72
23
0
02 May 2022
Attention Mechanism in Neural Networks: Where it Comes and Where it Goes
Attention Mechanism in Neural Networks: Where it Comes and Where it Goes
Derya Soydaner
3DV
125
182
0
27 Apr 2022
DialogVED: A Pre-trained Latent Variable Encoder-Decoder Model for
  Dialog Response Generation
DialogVED: A Pre-trained Latent Variable Encoder-Decoder Model for Dialog Response Generation
Wei Chen
Yeyun Gong
Song Wang
Bolun Yao
Weizhen Qi
...
Bartuer Zhou
Yi Mao
Weizhu Chen
Biao Cheng
Nan Duan
VLM
82
48
0
27 Apr 2022
SkillSpan: Hard and Soft Skill Extraction from English Job Postings
SkillSpan: Hard and Soft Skill Extraction from English Job Postings
Mike Zhang
Kristian Nørgaard Jensen
Sif Dam Sonniks
Barbara Plank
112
55
0
27 Apr 2022
It Takes Two Flints to Make a Fire: Multitask Learning of Neural
  Relation and Explanation Classifiers
It Takes Two Flints to Make a Fire: Multitask Learning of Neural Relation and Explanation Classifiers
Zheng Tang
Mihai Surdeanu
136
6
0
25 Apr 2022
Mining Root Cause Knowledge from Cloud Service Incident Investigations
  for AIOps
Mining Root Cause Knowledge from Cloud Service Incident Investigations for AIOps
Amrita Saha
Guosheng Lin
33
27
0
21 Apr 2022
LayoutLMv3: Pre-training for Document AI with Unified Text and Image
  Masking
LayoutLMv3: Pre-training for Document AI with Unified Text and Image Masking
Yupan Huang
Tengchao Lv
Lei Cui
Yutong Lu
Furu Wei
129
464
0
18 Apr 2022
BLISS: Robust Sequence-to-Sequence Learning via Self-Supervised Input
  Representation
BLISS: Robust Sequence-to-Sequence Learning via Self-Supervised Input Representation
Zheng Zhang
Liang Ding
Dazhao Cheng
Xuebo Liu
Min Zhang
Dacheng Tao
79
11
0
16 Apr 2022
SETTI: A Self-supervised Adversarial Malware Detection Architecture in
  an IoT Environment
SETTI: A Self-supervised Adversarial Malware Detection Architecture in an IoT Environment
Marjan Golmaryami
R. Taheri
Zahra Pooranian
Mohammad Shojafar
Pei Xiao
56
15
0
16 Apr 2022
Summarization with Graphical Elements
Summarization with Graphical Elements
Maartje ter Hoeve
Julia Kiseleva
Maarten de Rijke
68
2
0
15 Apr 2022
Towards Fine-grained Causal Reasoning and QA
Towards Fine-grained Causal Reasoning and QA
Linyi Yang
Zhen Wang
Yuxiang Wu
Jie Yang
Yue Zhang
88
16
0
15 Apr 2022
FREDA: Flexible Relation Extraction Data Annotation
FREDA: Flexible Relation Extraction Data Annotation
Michael Strobl
Amine Trabelsi
Osmar Zaiane
45
0
0
14 Apr 2022
Experimental Standards for Deep Learning in Natural Language Processing
  Research
Experimental Standards for Deep Learning in Natural Language Processing Research
Dennis Ulmer
Elisa Bassignana
Max Müller-Eberstein
Daniel Varab
Mike Zhang
Rob van der Goot
Christian Hardmeier
Barbara Plank
102
10
0
13 Apr 2022
What Language Model Architecture and Pretraining Objective Work Best for
  Zero-Shot Generalization?
What Language Model Architecture and Pretraining Objective Work Best for Zero-Shot Generalization?
Thomas Wang
Adam Roberts
Daniel Hesslow
Teven Le Scao
Hyung Won Chung
Iz Beltagy
Julien Launay
Colin Raffel
143
176
0
12 Apr 2022
Solving Price Per Unit Problem Around the World: Formulating Fact
  Extraction as Question Answering
Solving Price Per Unit Problem Around the World: Formulating Fact Extraction as Question Answering
Tarik Arici
K. Kumar
Hayreddin Çeker
Anoop Saladi
Ismail B. Tutar
21
2
0
12 Apr 2022
A Comparative Study of Pre-trained Encoders for Low-Resource Named
  Entity Recognition
A Comparative Study of Pre-trained Encoders for Low-Resource Named Entity Recognition
Yuxuan Chen
Jonas Mikkelsen
Arne Binder
Christoph Alt
Leonhard Hennig
72
2
0
11 Apr 2022
Breaking Character: Are Subwords Good Enough for MRLs After All?
Breaking Character: Are Subwords Good Enough for MRLs After All?
Omri Keren
Tal Avinari
Reut Tsarfaty
Omer Levy
66
16
0
10 Apr 2022
Modeling Multi-Granularity Hierarchical Features for Relation Extraction
Modeling Multi-Granularity Hierarchical Features for Relation Extraction
Xinnian Liang
Shuangzhi Wu
Mu Li
Zhoujun Li
54
11
0
09 Apr 2022
Towards Understanding Large-Scale Discourse Structures in Pre-Trained
  and Fine-Tuned Language Models
Towards Understanding Large-Scale Discourse Structures in Pre-Trained and Fine-Tuned Language Models
Patrick Huber
Giuseppe Carenini
64
11
0
08 Apr 2022
EntSUM: A Data Set for Entity-Centric Summarization
EntSUM: A Data Set for Entity-Centric Summarization
Mounica Maddela
Mayank Kulkarni
Daniel Preoţiuc-Pietro
105
24
0
05 Apr 2022
How Pre-trained Language Models Capture Factual Knowledge? A
  Causal-Inspired Analysis
How Pre-trained Language Models Capture Factual Knowledge? A Causal-Inspired Analysis
Shaobo Li
Xiaoguang Li
Lifeng Shang
Zhenhua Dong
Chengjie Sun
Bingquan Liu
Zhenzhou Ji
Xin Jiang
Qun Liu
KELM
94
55
0
31 Mar 2022
Graph Refinement for Coreference Resolution
Graph Refinement for Coreference Resolution
Lesly Miculicich
James Henderson
111
12
0
30 Mar 2022
LinkBERT: Pretraining Language Models with Document Links
LinkBERT: Pretraining Language Models with Document Links
Michihiro Yasunaga
J. Leskovec
Percy Liang
KELM
108
361
0
29 Mar 2022
Discovering material information using hierarchical Reformer model on
  financial regulatory filings
Discovering material information using hierarchical Reformer model on financial regulatory filings
Francois Mercier
Makesh Narsimhan
AIFinAI4TS
20
0
0
28 Mar 2022
ANNA: Enhanced Language Representation for Question Answering
ANNA: Enhanced Language Representation for Question Answering
Changwook Jun
Hansol Jang
Myoseop Sim
Hyun Kim
Jooyoung Choi
Kyungkoo Min
Kyunghoon Bae
73
8
0
28 Mar 2022
Lite Unified Modeling for Discriminative Reading Comprehension
Lite Unified Modeling for Discriminative Reading Comprehension
Yilin Zhao
Hai Zhao
Libin Shen
Yinggong Zhao
86
2
0
26 Mar 2022
3D-OAE: Occlusion Auto-Encoders for Self-Supervised Learning on Point
  Clouds
3D-OAE: Occlusion Auto-Encoders for Self-Supervised Learning on Point Clouds
Junsheng Zhou
Xin Wen
Baorui Ma
Yu-Shen Liu
Yue Gao
Yi Fang
Zhizhong Han
3DPC
82
19
0
26 Mar 2022
Leveraging unsupervised and weakly-supervised data to improve direct
  speech-to-speech translation
Leveraging unsupervised and weakly-supervised data to improve direct speech-to-speech translation
Ye Jia
Yifan Ding
Ankur Bapna
Colin Cherry
Yu Zhang
Alexis Conneau
Nobuyuki Morioka
94
21
0
24 Mar 2022
Multi-armed bandits for resource efficient, online optimization of
  language model pre-training: the use case of dynamic masking
Multi-armed bandits for resource efficient, online optimization of language model pre-training: the use case of dynamic masking
Iñigo Urteaga
Moulay Draidia
Tomer Lancewicki
Shahram Khadivi
AI4CE
59
1
0
24 Mar 2022
Masked Discrimination for Self-Supervised Learning on Point Clouds
Masked Discrimination for Self-Supervised Learning on Point Clouds
Haotian Liu
Mu Cai
Yong Jae Lee
3DPC
117
171
0
21 Mar 2022
Teaching language models to support answers with verified quotes
Teaching language models to support answers with verified quotes
Jacob Menick
Maja Trebacz
Vladimir Mikulik
John Aslanides
Francis Song
...
Mia Glaese
Susannah Young
Lucy Campbell-Gillingham
G. Irving
Nat McAleese
ELMRALM
316
267
0
21 Mar 2022
Simulating Bandit Learning from User Feedback for Extractive Question
  Answering
Simulating Bandit Learning from User Feedback for Extractive Question Answering
Ge Gao
Eunsol Choi
Yoav Artzi
85
14
0
18 Mar 2022
elBERto: Self-supervised Commonsense Learning for Question Answering
elBERto: Self-supervised Commonsense Learning for Question Answering
Xunlin Zhan
Yuan Li
Xiao Dong
Xiaodan Liang
Zhiting Hu
Lawrence Carin
SSLRALMLRM
77
8
0
17 Mar 2022
UNIMO-2: End-to-End Unified Vision-Language Grounded Learning
UNIMO-2: End-to-End Unified Vision-Language Grounded Learning
Wei Li
Can Gao
Guocheng Niu
Xinyan Xiao
Hao Liu
Jiachen Liu
Hua Wu
Haifeng Wang
MLLM
51
22
0
17 Mar 2022
Representation Learning for Resource-Constrained Keyphrase Generation
Representation Learning for Resource-Constrained Keyphrase Generation
Di Wu
Wasi Uddin Ahmad
Sunipa Dev
Kai-Wei Chang
83
18
0
15 Mar 2022
WCL-BBCD: A Contrastive Learning and Knowledge Graph Approach to Named
  Entity Recognition
WCL-BBCD: A Contrastive Learning and Knowledge Graph Approach to Named Entity Recognition
Renjie Zhou
Qian Hu
Jian Wan
Jilin Zhang
Qiang Liu
Tianxiang Hu
Jian Li
51
3
0
14 Mar 2022
PERT: Pre-training BERT with Permuted Language Model
PERT: Pre-training BERT with Permuted Language Model
Yiming Cui
Ziqing Yang
Ting Liu
85
37
0
14 Mar 2022
DeepTrust: A Reliable Financial Knowledge Retrieval Framework For
  Explaining Extreme Pricing Anomalies
DeepTrust: A Reliable Financial Knowledge Retrieval Framework For Explaining Extreme Pricing Anomalies
Pok Wah Chan
47
1
0
11 Mar 2022
ClarET: Pre-training a Correlation-Aware Context-To-Event Transformer
  for Event-Centric Generation and Classification
ClarET: Pre-training a Correlation-Aware Context-To-Event Transformer for Event-Centric Generation and Classification
Yucheng Zhou
Tao Shen
Xiubo Geng
Guodong Long
Daxin Jiang
112
60
0
04 Mar 2022
Attend, Memorize and Generate: Towards Faithful Table-to-Text Generation
  in Few Shots
Attend, Memorize and Generate: Towards Faithful Table-to-Text Generation in Few Shots
Wenting Zhao
Ye Liu
Yao Wan
Philip S. Yu
73
11
0
01 Mar 2022
Read before Generate! Faithful Long Form Question Answering with Machine
  Reading
Read before Generate! Faithful Long Form Question Answering with Machine Reading
Jane Polak Scowcroft
Xiaoguang Li
Jindi Zhang
Lifeng Shang
Xin Jiang
Qun Liu
Pascale Fung
HILM
73
61
0
01 Mar 2022
EPPAC: Entity Pre-typing Relation Classification with Prompt AnswerCentralizing
Jiejun Tan
Wenbin Hu
Weiwei Liu
86
1
0
01 Mar 2022
Previous
123...91011...181920
Next