ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 1907.10529
  4. Cited By
SpanBERT: Improving Pre-training by Representing and Predicting Spans
v1v2v3 (latest)

SpanBERT: Improving Pre-training by Representing and Predicting Spans

24 July 2019
Mandar Joshi
Danqi Chen
Yinhan Liu
Daniel S. Weld
Luke Zettlemoyer
Omer Levy
ArXiv (abs)PDFHTML

Papers citing "SpanBERT: Improving Pre-training by Representing and Predicting Spans"

50 / 955 papers shown
Title
Span-Selective Linear Attention Transformers for Effective and Robust
  Schema-Guided Dialogue State Tracking
Span-Selective Linear Attention Transformers for Effective and Robust Schema-Guided Dialogue State Tracking
Björn Bebensee
Haejun Lee
72
4
0
15 Jun 2023
Unifying Large Language Models and Knowledge Graphs: A Roadmap
Unifying Large Language Models and Knowledge Graphs: A Roadmap
Shirui Pan
Linhao Luo
Yufei Wang
Chen Chen
Jiapu Wang
Xindong Wu
KELM
160
787
0
14 Jun 2023
Generate to Understand for Representation
Generate to Understand for Representation
Changshan Xue
Xiande Zhong
Xiaoqing Liu
VLM
98
0
0
14 Jun 2023
Tokenization with Factorized Subword Encoding
Tokenization with Factorized Subword Encoding
David Samuel
Lilja Øvrelid
67
2
0
13 Jun 2023
The Effect of Masking Strategies on Knowledge Retention by Language
  Models
The Effect of Masking Strategies on Knowledge Retention by Language Models
Jonas Wallat
Tianyi Zhang
Avishek Anand
KELMCLL
24
0
0
12 Jun 2023
Multi-Source Test-Time Adaptation as Dueling Bandits for Extractive
  Question Answering
Multi-Source Test-Time Adaptation as Dueling Bandits for Extractive Question Answering
Hai Ye
Qizhe Xie
Hwee Tou Ng
90
8
0
11 Jun 2023
QUERT: Continual Pre-training of Language Model for Query Understanding
  in Travel Domain Search
QUERT: Continual Pre-training of Language Model for Query Understanding in Travel Domain Search
Jian Xie
Yidan Liang
Jingping Liu
Yanghua Xiao
Baohua Wu
Shenghua Ni
VLMLRM
90
9
0
11 Jun 2023
Advancing Italian Biomedical Information Extraction with
  Transformers-based Models: Methodological Insights and Multicenter Practical
  Application
Advancing Italian Biomedical Information Extraction with Transformers-based Models: Methodological Insights and Multicenter Practical Application
Claudio Crema
T. M. Buonocore
Silvia Fostinelli
Enea Parimbelli
F. Verde
...
Marco Capelli
Alfredo Costa
G. Binetti
Riccardo Bellazzi
A. Redolfi
47
6
0
08 Jun 2023
Extensive Evaluation of Transformer-based Architectures for Adverse Drug
  Events Extraction
Extensive Evaluation of Transformer-based Architectures for Adverse Drug Events Extraction
Simone Scaboro
Beatrice Portelli
Emmanuele Chersoni
Enrico Santus
Giuseppe Serra
64
9
0
08 Jun 2023
Leveraging Knowledge Graph Embeddings to Enhance Contextual
  Representations for Relation Extraction
Leveraging Knowledge Graph Embeddings to Enhance Contextual Representations for Relation Extraction
F. Laleye
Loïc Rakotoson
S. Massip
53
1
0
07 Jun 2023
Unbalanced Optimal Transport for Unbalanced Word Alignment
Unbalanced Optimal Transport for Unbalanced Word Alignment
Yuki Arase
Han Bao
Sho Yokoi
OT
51
5
0
07 Jun 2023
Gotta: Generative Few-shot Question Answering by Prompt-based Cloze Data
  Augmentation
Gotta: Generative Few-shot Question Answering by Prompt-based Cloze Data Augmentation
Xiusi Chen
Yu Zhang
Jinliang Deng
Jyun-Yu Jiang
Wei Wang
62
12
0
07 Jun 2023
Interactive Editing for Text Summarization
Interactive Editing for Text Summarization
Yujia Xie
Xun Wang
Si-Qing Chen
Wayne Xiong
Pengcheng He
KELM
324
2
0
05 Jun 2023
On "Scientific Debt" in NLP: A Case for More Rigour in Language Model
  Pre-Training Research
On "Scientific Debt" in NLP: A Case for More Rigour in Language Model Pre-Training Research
Made Nindyatama Nityasya
Haryo Akbarianto Wibowo
Alham Fikri Aji
Genta Indra Winata
Radityo Eko Prasojo
Phil Blunsom
A. Kuncoro
60
8
0
05 Jun 2023
PULSAR: Pre-training with Extracted Healthcare Terms for Summarising
  Patients' Problems and Data Augmentation with Black-box Large Language Models
PULSAR: Pre-training with Extracted Healthcare Terms for Summarising Patients' Problems and Data Augmentation with Black-box Large Language Models
Hao Li
Yuping Wu
Viktor Schlegel
Riza Batista-Navarro
Thanh-Tung Nguyen
Abhinav Ramesh Kashyap
Xiaojun Zeng
Daniel Beck
Stefan Winkler
Goran Nenadic
LM&MA
85
9
0
05 Jun 2023
A Comprehensive Survey on Relation Extraction: Recent Advances and New
  Frontiers
A Comprehensive Survey on Relation Extraction: Recent Advances and New Frontiers
Xiaoyan Zhao
Yang Deng
Min Yang
Lingzhi Wang
Rui Zhang
Hong Cheng
W. Lam
Ying Shen
Ruifeng Xu
KELM
95
36
0
03 Jun 2023
Unsupervised Paraphrasing of Multiword Expressions
Unsupervised Paraphrasing of Multiword Expressions
Takashi Wada
Yuji Matsumoto
Timothy Baldwin
Jey Han Lau
66
0
0
02 Jun 2023
Towards Learning Discrete Representations via Self-Supervision for
  Wearables-Based Human Activity Recognition
Towards Learning Discrete Representations via Self-Supervision for Wearables-Based Human Activity Recognition
H. Haresamudram
Irfan Essa
Thomas Ploetz
98
8
0
01 Jun 2023
UKP-SQuARE: An Interactive Tool for Teaching Question Answering
UKP-SQuARE: An Interactive Tool for Teaching Question Answering
Haishuo Fang
Haritz Puerto
Iryna Gurevych
102
1
0
31 May 2023
Examining risks of racial biases in NLP tools for child protective
  services
Examining risks of racial biases in NLP tools for child protective services
Anjalie Field
Amanda Coston
Nupoor Gandhi
Alexandra Chouldechova
Emily Putnam-Hornstein
David Steier
Yulia Tsvetkov
92
14
0
30 May 2023
A Quantitative Review on Language Model Efficiency Research
A Quantitative Review on Language Model Efficiency Research
Meng Jiang
Hy Dang
Lingbo Tong
76
0
0
28 May 2023
Parallel Data Helps Neural Entity Coreference Resolution
Parallel Data Helps Neural Entity Coreference Resolution
Gongbo Tang
Christian Hardmeier
57
3
0
28 May 2023
Slide, Constrain, Parse, Repeat: Synchronous SlidingWindows for Document
  AMR Parsing
Slide, Constrain, Parse, Repeat: Synchronous SlidingWindows for Document AMR Parsing
Yara Rizk
Tahira Naseem
Ramón Fernández Astudillo
Radu Florian
Salim Roukos
89
0
0
26 May 2023
Entailment as Robust Self-Learner
Entailment as Robust Self-Learner
Jiaxin Ge
Hongyin Luo
Yoon Kim
James R. Glass
107
3
0
26 May 2023
Sentence-Incremental Neural Coreference Resolution
Sentence-Incremental Neural Coreference Resolution
Matt Grenander
Shay B. Cohen
Mark Steedman
CLL
97
5
0
26 May 2023
Towards a Common Understanding of Contributing Factors for Cross-Lingual
  Transfer in Multilingual Language Models: A Review
Towards a Common Understanding of Contributing Factors for Cross-Lingual Transfer in Multilingual Language Models: A Review
Fred Philippy
Siwen Guo
Shohreh Haddadan
LRM
72
37
0
26 May 2023
Comparing Humans and Models on a Similar Scale: Towards Cognitive Gender
  Bias Evaluation in Coreference Resolution
Comparing Humans and Models on a Similar Scale: Towards Cognitive Gender Bias Evaluation in Coreference Resolution
Gili Lior
Gabriel Stanovsky
73
4
0
24 May 2023
Self-Evolution Learning for Discriminative Language Model Pretraining
Self-Evolution Learning for Discriminative Language Model Pretraining
Qihuang Zhong
Liang Ding
Juhua Liu
Bo Du
Dacheng Tao
91
12
0
24 May 2023
Revisiting Token Dropping Strategy in Efficient BERT Pretraining
Revisiting Token Dropping Strategy in Efficient BERT Pretraining
Qihuang Zhong
Liang Ding
Juhua Liu
Xuebo Liu
Min Zhang
Bo Du
Dacheng Tao
VLM
73
10
0
24 May 2023
Dynamic Masking Rate Schedules for MLM Pretraining
Dynamic Masking Rate Schedules for MLM Pretraining
Zachary Ankner
Naomi Saphra
Davis W. Blalock
Jonathan Frankle
Matthew L. Leavitt
101
8
0
24 May 2023
Linear-Time Modeling of Linguistic Structure: An Order-Theoretic
  Perspective
Linear-Time Modeling of Linguistic Structure: An Order-Theoretic Perspective
Tianyu Liu
Afra Amini
Mrinmaya Sachan
Ryan Cotterell
91
2
0
24 May 2023
Machine Reading Comprehension using Case-based Reasoning
Machine Reading Comprehension using Case-based Reasoning
Dung Ngoc Thai
Dhruv Agarwal
Mudit Chaudhary
Wenlong Zhao
Rajarshi Das
Manzil Zaheer
J. Lee
Hannaneh Hajishirzi
Andrew McCallum
87
1
0
24 May 2023
A Causal View of Entity Bias in (Large) Language Models
A Causal View of Entity Bias in (Large) Language Models
Fei Wang
Wen-An Mo
Yiwei Wang
Wenxuan Zhou
Muhao Chen
84
15
0
24 May 2023
TACR: A Table-alignment-based Cell-selection and Reasoning Model for
  Hybrid Question-Answering
TACR: A Table-alignment-based Cell-selection and Reasoning Model for Hybrid Question-Answering
Jian Wu
Yicheng Xu
Yan Gao
Jian-Guang Lou
Börje F. Karlsson
Manabu Okumura
LMTD
54
3
0
24 May 2023
Are Large Language Models Robust Coreference Resolvers?
Are Large Language Models Robust Coreference Resolvers?
Nghia T. Le
Alan Ritter
LRM
80
12
0
23 May 2023
HOP, UNION, GENERATE: Explainable Multi-hop Reasoning without Rationale
  Supervision
HOP, UNION, GENERATE: Explainable Multi-hop Reasoning without Rationale Supervision
Wenting Zhao
Justin T. Chiu
Claire Cardie
Alexander M. Rush
LRM
80
4
0
23 May 2023
Weakly Supervised 3D Open-vocabulary Segmentation
Weakly Supervised 3D Open-vocabulary Segmentation
Kunhao Liu
Fangneng Zhan
Jiahui Zhang
Muyu Xu
Yingchen Yu
Abdulmotaleb El Saddik
Christian Theobalt
Eric P. Xing
Shijian Lu
121
70
0
23 May 2023
DAPR: A Benchmark on Document-Aware Passage Retrieval
DAPR: A Benchmark on Document-Aware Passage Retrieval
Kexin Wang
Nils Reimers
Iryna Gurevych
104
5
0
23 May 2023
REFinD: Relation Extraction Financial Dataset
REFinD: Relation Extraction Financial Dataset
Simerjot Kaur
Charese Smiley
Akshat Gupta
Joy Prakash Sain
Dongsheng Wang
S. Siddagangappa
Toyin Aguda
Sameena Shah
73
16
0
22 May 2023
VideoLLM: Modeling Video Sequence with Large Language Models
VideoLLM: Modeling Video Sequence with Large Language Models
Guo Chen
Yin-Dong Zheng
Jiahao Wang
Jilan Xu
Yifei Huang
...
Yi Wang
Yali Wang
Yu Qiao
Tong Lu
Limin Wang
MLLM
148
84
0
22 May 2023
Challenging Decoder helps in Masked Auto-Encoder Pre-training for Dense
  Passage Retrieval
Challenging Decoder helps in Masked Auto-Encoder Pre-training for Dense Passage Retrieval
Zehan Li
Yanzhao Zhang
Dingkun Long
Pengjun Xie
RALM
85
3
0
22 May 2023
EnCore: Fine-Grained Entity Typing by Pre-Training Entity Encoders on
  Coreference Chains
EnCore: Fine-Grained Entity Typing by Pre-Training Entity Encoders on Coreference Chains
Frank Mtumbuka
Steven Schockaert
73
0
0
22 May 2023
Farewell to Aimless Large-scale Pretraining: Influential Subset
  Selection for Language Model
Farewell to Aimless Large-scale Pretraining: Influential Subset Selection for Language Model
Xiao Wang
Wei Zhou
Qi Zhang
Jie Zhou
Songyang Gao
Junzhe Wang
Menghan Zhang
Xiang Gao
Yunwen Chen
Tao Gui
129
10
0
22 May 2023
Discourse Centric Evaluation of Machine Translation with a Densely
  Annotated Parallel Corpus
Discourse Centric Evaluation of Machine Translation with a Densely Annotated Parallel Corpus
Yu Jiang
Tianyu Liu
Shuming Ma
Dongdong Zhang
Mrinmaya Sachan
Ryan Cotterell
75
7
0
18 May 2023
The Interpreter Understands Your Meaning: End-to-end Spoken Language
  Understanding Aided by Speech Translation
The Interpreter Understands Your Meaning: End-to-end Spoken Language Understanding Aided by Speech Translation
Mutian He
Philip N. Garner
100
4
0
16 May 2023
About Evaluation of F1 Score for RECENT Relation Extraction System
About Evaluation of F1 Score for RECENT Relation Extraction System
Michal Olek
23
0
0
16 May 2023
Schema-adaptable Knowledge Graph Construction
Schema-adaptable Knowledge Graph Construction
Hongbin Ye
Honghao Gui
Xin Xu
Xi Chen
Huajun Chen
Ningyu Zhang
98
4
0
15 May 2023
Coreference-aware Double-channel Attention Network for Multi-party
  Dialogue Reading Comprehension
Coreference-aware Double-channel Attention Network for Multi-party Dialogue Reading Comprehension
Yanling Li
Bowei Zou
Yifan Fan
Mengxing Dong
Yu Hong
70
4
0
15 May 2023
Learning to Generalize for Cross-domain QA
Learning to Generalize for Cross-domain QA
Yingjie Niu
Linyi Yang
Ruihai Dong
Yue Zhang
92
6
0
14 May 2023
Can SAM Boost Video Super-Resolution?
Can SAM Boost Video Super-Resolution?
Zhihe Lu
Zeyu Xiao
Jiawang Bai
Zhiwei Xiong
Xinchao Wang
75
24
0
11 May 2023
Previous
123456...181920
Next