ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 1907.10529
  4. Cited By
SpanBERT: Improving Pre-training by Representing and Predicting Spans
v1v2v3 (latest)

SpanBERT: Improving Pre-training by Representing and Predicting Spans

24 July 2019
Mandar Joshi
Danqi Chen
Yinhan Liu
Daniel S. Weld
Luke Zettlemoyer
Omer Levy
ArXiv (abs)PDFHTML

Papers citing "SpanBERT: Improving Pre-training by Representing and Predicting Spans"

50 / 955 papers shown
Title
What is the best recipe for character-level encoder-only modelling?
What is the best recipe for character-level encoder-only modelling?
Kris Cao
59
3
0
09 May 2023
CharSpan: Utilizing Lexical Similarity to Enable Zero-Shot Machine
  Translation for Extremely Low-resource Languages
CharSpan: Utilizing Lexical Similarity to Enable Zero-Shot Machine Translation for Extremely Low-resource Languages
Kaushal Kumar Maurya
Rahul Kejriwal
M. Desarkar
Anoop Kunchukuttan
82
1
0
09 May 2023
ANALOGICAL -- A Novel Benchmark for Long Text Analogy Evaluation in
  Large Language Models
ANALOGICAL -- A Novel Benchmark for Long Text Analogy Evaluation in Large Language Models
Thilini Wijesiriwardene
Ruwan Wickramarachchi
Bimal Gajera
Shreeyash Mukul Gowaikar
Chandan Gupta
Aman Chadha
Aishwarya N. Reganti
Amit P. Sheth
Amitava Das
ELM
81
14
0
08 May 2023
A Frustratingly Easy Improvement for Position Embeddings via Random
  Padding
A Frustratingly Easy Improvement for Position Embeddings via Random Padding
Mingxu Tao
Yansong Feng
Dongyan Zhao
71
6
0
08 May 2023
Event Knowledge Incorporation with Posterior Regularization for
  Event-Centric Question Answering
Event Knowledge Incorporation with Posterior Regularization for Event-Centric Question Answering
Junru Lu
Gabriele Pergola
Lin Gui
Yulan He
66
0
0
08 May 2023
AnomalyBERT: Self-Supervised Transformer for Time Series Anomaly
  Detection using Data Degradation Scheme
AnomalyBERT: Self-Supervised Transformer for Time Series Anomaly Detection using Data Degradation Scheme
Yungi Jeong
Eu-Hui Yang
Jung Hyun Ryu
Imseong Park
Myung-joo Kang
ViTAI4TS
72
31
0
08 May 2023
NorBench -- A Benchmark for Norwegian Language Models
NorBench -- A Benchmark for Norwegian Language Models
David Samuel
Andrey Kutuzov
Samia Touileb
Erik Velldal
Lilja Ovrelid
Egil Rønningstad
Elina Sigdel
Anna Palatkina
93
25
0
06 May 2023
UNTER: A Unified Knowledge Interface for Enhancing Pre-trained Language
  Models
UNTER: A Unified Knowledge Interface for Enhancing Pre-trained Language Models
Deming Ye
Yankai Lin
Zhengyan Zhang
Maosong Sun
KELM
53
0
0
02 May 2023
FreeLM: Fine-Tuning-Free Language Model
FreeLM: Fine-Tuning-Free Language Model
Xiang Li
Xin Jiang
Xuying Meng
Aixin Sun
Yequan Wang
84
3
0
02 May 2023
How to Unleash the Power of Large Language Models for Few-shot Relation
  Extraction?
How to Unleash the Power of Large Language Models for Few-shot Relation Extraction?
Xin Xu
Yuqi Zhu
Xiaohan Wang
Ningyu Zhang
KELMLRM
131
54
0
02 May 2023
Towards Multi-Modal DBMSs for Seamless Querying of Texts and Tables
Towards Multi-Modal DBMSs for Seamless Querying of Texts and Tables
Matthias Urban
Carsten Binnig
71
5
0
26 Apr 2023
BERT Based Clinical Knowledge Extraction for Biomedical Knowledge Graph
  Construction and Analysis
BERT Based Clinical Knowledge Extraction for Biomedical Knowledge Graph Construction and Analysis
Ayoub Harnoune
Maryem Rhanoui
M. Mikram
Siham Yousfi
Zineb Elkaimbillah
B. E. Asri
62
86
0
21 Apr 2023
LasUIE: Unifying Information Extraction with Latent Adaptive
  Structure-aware Generative Language Model
LasUIE: Unifying Information Extraction with Latent Adaptive Structure-aware Generative Language Model
Hao Fei
Shengqiong Wu
Jingye Li
Bobo Li
Fei Li
Libo Qin
Meishan Zhang
Hao Fei
Tat-Seng Chua
95
82
0
13 Apr 2023
Sentence-Level Relation Extraction via Contrastive Learning with
  Descriptive Relation Prompts
Sentence-Level Relation Extraction via Contrastive Learning with Descriptive Relation Prompts
Jiewen Zheng
Ze Chen
68
2
0
11 Apr 2023
A Cheaper and Better Diffusion Language Model with Soft-Masked Noise
A Cheaper and Better Diffusion Language Model with Soft-Masked Noise
Jiaao Chen
Aston Zhang
Mu Li
Alexander J. Smola
Diyi Yang
DiffM
88
21
0
10 Apr 2023
Unsupervised Improvement of Factual Knowledge in Language Models
Unsupervised Improvement of Factual Knowledge in Language Models
Nafis Sadeq
Byungkyu Kang
Prarit Lamba
Julian McAuley
KELM
83
7
0
04 Apr 2023
MiniRBT: A Two-stage Distilled Small Chinese Pre-trained Model
MiniRBT: A Two-stage Distilled Small Chinese Pre-trained Model
Xin Yao
Ziqing Yang
Yiming Cui
Shijin Wang
42
3
0
03 Apr 2023
Detecting and Grounding Important Characters in Visual Stories
Detecting and Grounding Important Characters in Visual Stories
Danyang Liu
Frank Keller
54
11
0
30 Mar 2023
TLAG: An Informative Trigger and Label-Aware Knowledge Guided Model for
  Dialogue-based Relation Extraction
TLAG: An Informative Trigger and Label-Aware Knowledge Guided Model for Dialogue-based Relation Extraction
Hao An
Dongsheng Chen
Weiyuan Xu
Zhihong Zhu
Yuexian Zou
90
2
0
30 Mar 2023
KPEval: Towards Fine-Grained Semantic-Based Keyphrase Evaluation
KPEval: Towards Fine-Grained Semantic-Based Keyphrase Evaluation
Di Wu
Da Yin
Kai-Wei Chang
81
2
0
27 Mar 2023
Salient Span Masking for Temporal Understanding
Salient Span Masking for Temporal Understanding
Jeremy R. Cole
Aditi Chaudhary
Bhuwan Dhingra
Partha P. Talukdar
91
13
0
22 Mar 2023
Understand Legal Documents with Contextualized Large Language Models
Understand Legal Documents with Contextualized Large Language Models
Xin Jin
Yuchen Wang
ELMAILaw
45
7
0
21 Mar 2023
Character, Word, or Both? Revisiting the Segmentation Granularity for
  Chinese Pre-trained Language Models
Character, Word, or Both? Revisiting the Segmentation Granularity for Chinese Pre-trained Language Models
Xinnian Liang
Zefan Zhou
Hui Huang
Shuangzhi Wu
Tong Xiao
Muyun Yang
Zhoujun Li
Chao Bian
VLM
65
2
0
20 Mar 2023
Trained on 100 million words and still in shape: BERT meets British
  National Corpus
Trained on 100 million words and still in shape: BERT meets British National Corpus
David Samuel
Andrey Kutuzov
Lilja Øvrelid
Erik Velldal
101
32
0
17 Mar 2023
AMOM: Adaptive Masking over Masking for Conditional Masked Language
  Model
AMOM: Adaptive Masking over Masking for Conditional Masked Language Model
Yisheng Xiao
Ruiyang Xu
Lijun Wu
Juntao Li
Tao Qin
Yan-Tie Liu
Hao Fei
44
9
0
13 Mar 2023
Meet in the Middle: A New Pre-training Paradigm
Meet in the Middle: A New Pre-training Paradigm
A. Nguyen
Nikos Karampatziakis
Weizhu Chen
62
21
0
13 Mar 2023
A Comprehensive Survey of AI-Generated Content (AIGC): A History of
  Generative AI from GAN to ChatGPT
A Comprehensive Survey of AI-Generated Content (AIGC): A History of Generative AI from GAN to ChatGPT
Yihan Cao
Siyu Li
Yixin Liu
Zhiling Yan
Yutong Dai
Philip S. Yu
Lichao Sun
105
555
0
07 Mar 2023
How Robust is GPT-3.5 to Predecessors? A Comprehensive Study on Language
  Understanding Tasks
How Robust is GPT-3.5 to Predecessors? A Comprehensive Study on Language Understanding Tasks
Xuanting Chen
Junjie Ye
Can Zu
Nuo Xu
Rui Zheng
Minlong Peng
Jie Zhou
Tao Gui
Qi Zhang
Xuanjing Huang
AI4MHELM
67
83
0
01 Mar 2023
Empathetic Response Generation via Emotion Cause Transition Graph
Empathetic Response Generation via Emotion Cause Transition Graph
Yushan Qian
Bo Wang
Ting-En Lin
Yinhe Zheng
Yingfu Zhu
Dongming Zhao
Yuexian Hou
Yuchuan Wu
Yongbin Li
91
16
0
23 Feb 2023
Embeddings for Tabular Data: A Survey
Embeddings for Tabular Data: A Survey
Rajat Singh
Srikanta J. Bedathur
LMTD
57
2
0
23 Feb 2023
BBT-Fin: Comprehensive Construction of Chinese Financial Domain
  Pre-trained Language Model, Corpus and Benchmark
BBT-Fin: Comprehensive Construction of Chinese Financial Domain Pre-trained Language Model, Corpus and Benchmark
Dakuan Lu
Hengkui Wu
Jiaqing Liang
Yipei Xu
Qi He
Yipeng Geng
Mengkun Han
Ying Xin
Yanghua Xiao
89
62
0
18 Feb 2023
Bag of Tricks for Effective Language Model Pretraining and Downstream
  Adaptation: A Case Study on GLUE
Bag of Tricks for Effective Language Model Pretraining and Downstream Adaptation: A Case Study on GLUE
Qihuang Zhong
Liang Ding
Keqin Peng
Juhua Liu
Bo Du
Li Shen
Yibing Zhan
Dacheng Tao
VLM
81
13
0
18 Feb 2023
Multimodal Propaganda Processing
Multimodal Propaganda Processing
Vincent Ng
Shengjie Li
102
2
0
17 Feb 2023
Evaluating and Improving the Coreference Capabilities of Machine
  Translation Models
Evaluating and Improving the Coreference Capabilities of Machine Translation Models
Asaf Yehudai
Arie Cattan
Omri Abend
Gabriel Stanovsky
LRMELM
66
2
0
16 Feb 2023
LabelPrompt: Effective Prompt-based Learning for Relation Classification
LabelPrompt: Effective Prompt-based Learning for Relation Classification
Weinan Zhang
Xiaoning Song
Zhenhua Feng
Tianyang Xu
Xiaojun Wu
VLM
63
4
0
16 Feb 2023
Why Can't Discourse Parsing Generalize? A Thorough Investigation of the
  Impact of Data Diversity
Why Can't Discourse Parsing Generalize? A Thorough Investigation of the Impact of Data Diversity
Yang Liu
Amir Zeldes
23
21
0
13 Feb 2023
Counter-GAP: Counterfactual Bias Evaluation through Gendered Ambiguous
  Pronouns
Counter-GAP: Counterfactual Bias Evaluation through Gendered Ambiguous Pronouns
Zhongbin Xie
Vid Kocijan
Thomas Lukasiewicz
Oana-Maria Camburu
40
2
0
11 Feb 2023
Enhancing E-Commerce Recommendation using Pre-Trained Language Model and
  Fine-Tuning
Enhancing E-Commerce Recommendation using Pre-Trained Language Model and Fine-Tuning
Nuofan Xu
Chenhui Hu
23
2
0
09 Feb 2023
CRL+: A Novel Semi-Supervised Deep Active Contrastive Representation
  Learning-Based Text Classification Model for Insurance Data
CRL+: A Novel Semi-Supervised Deep Active Contrastive Representation Learning-Based Text Classification Model for Insurance Data
Amir Namavar Jahromi
Ebrahim Pourjafari
H. Karimipour
Amit Satpathy
Lovell Hodge
50
3
0
08 Feb 2023
COMBO: A Complete Benchmark for Open KG Canonicalization
COMBO: A Complete Benchmark for Open KG Canonicalization
Chengyue Jiang
Yong Jiang
Weiqi Wu
Yuting Zheng
Pengjun Xie
Kewei Tu
63
2
0
08 Feb 2023
Representation Deficiency in Masked Language Modeling
Representation Deficiency in Masked Language Modeling
Yu Meng
Jitin Krishnan
Sinong Wang
Qifan Wang
Yuning Mao
Han Fang
Marjan Ghazvininejad
Jiawei Han
Luke Zettlemoyer
140
7
0
04 Feb 2023
AmbiCoref: Evaluating Human and Model Sensitivity to Ambiguous
  Coreference
AmbiCoref: Evaluating Human and Model Sensitivity to Ambiguous Coreference
Yuewei Yuan
Chaitanya Malaviya
Mark Yatskar
69
11
0
01 Feb 2023
The Impacts of Unanswerable Questions on the Robustness of Machine
  Reading Comprehension Models
The Impacts of Unanswerable Questions on the Robustness of Machine Reading Comprehension Models
Son Quoc Tran
Phong Nguyen-Thuan Do
Uyen Le
Matt Kretchmar
ELMAAML
86
8
0
31 Jan 2023
Sentence Identification with BOS and EOS Label Combinations
Sentence Identification with BOS and EOS Label Combinations
Takuma Udagawa
H. Kanayama
Issei Yoshida
52
2
0
31 Jan 2023
Open Problems in Applied Deep Learning
Open Problems in Applied Deep Learning
M. Raissi
AI4CE
115
2
0
26 Jan 2023
Ensemble Transfer Learning for Multilingual Coreference Resolution
Ensemble Transfer Learning for Multilingual Coreference Resolution
T. Lai
Heng Ji
43
1
0
22 Jan 2023
Dance2MIDI: Dance-driven multi-instruments music generation
Dance2MIDI: Dance-driven multi-instruments music generation
Bo Han
Yuheng Li
Yixuan Shen
Yi Ren
Feilin Han
123
5
0
22 Jan 2023
Unifying Structure Reasoning and Language Model Pre-training for Complex
  Reasoning
Unifying Structure Reasoning and Language Model Pre-training for Complex Reasoning
Siyuan Wang
Zhongyu Wei
Jiarong Xu
Taishan Li
Zhihao Fan
LRM
80
5
0
21 Jan 2023
Toward Building General Foundation Models for Language, Vision, and
  Vision-Language Understanding Tasks
Toward Building General Foundation Models for Language, Vision, and Vision-Language Understanding Tasks
Xinsong Zhang
Yan Zeng
Jipeng Zhang
Hang Li
VLMAI4CELRM
111
17
0
12 Jan 2023
Multilingual Entity and Relation Extraction from Unified to
  Language-specific Training
Multilingual Entity and Relation Extraction from Unified to Language-specific Training
Zixiang Wang
Jian Yang
Tongliang Li
Jiaheng Liu
Ying Mo
Jiaqi Bai
Longtao He
Zhoujun Li
105
2
0
11 Jan 2023
Previous
123...567...181920
Next