SpanBERT: Improving Pre-training by Representing and Predicting Spans

24 July 2019

Luke Zettlemoyer

Papers citing "SpanBERT: Improving Pre-training by Representing and Predicting Spans"

50 / 950 papers shown

Title
FreeLM: Fine-Tuning-Free Language Model Xiang Li Xin Jiang Xuying Meng Aixin Sun Yequan Wang 52 3 0 02 May 2023
How to Unleash the Power of Large Language Models for Few-shot Relation Extraction? Xin Xu Yuqi Zhu Xiaohan Wang Ningyu Zhang KELM LRM 52 47 0 02 May 2023
Towards Multi-Modal DBMSs for Seamless Querying of Texts and Tables Matthias Urban Carsten Binnig 34 5 0 26 Apr 2023
BERT Based Clinical Knowledge Extraction for Biomedical Knowledge Graph Construction and Analysis Ayoub Harnoune Maryem Rhanoui M. Mikram Siham Yousfi Zineb Elkaimbillah B. E. Asri 16 77 0 21 Apr 2023
LasUIE: Unifying Information Extraction with Latent Adaptive Structure-aware Generative Language Model Hao Fei Shengqiong Wu Jingye Li Bobo Li Fei Li Libo Qin Meishan Zhang Hao Fei Tat-Seng Chua 28 76 0 13 Apr 2023
Sentence-Level Relation Extraction via Contrastive Learning with Descriptive Relation Prompts Jiewen Zheng Ze Chen 35 2 0 11 Apr 2023
A Cheaper and Better Diffusion Language Model with Soft-Masked Noise Jiaao Chen Aston Zhang Mu Li Alexander J. Smola Diyi Yang DiffM 32 17 0 10 Apr 2023
Unsupervised Improvement of Factual Knowledge in Language Models Nafis Sadeq Byungkyu Kang Prarit Lamba Julian McAuley KELM 27 6 0 04 Apr 2023
MiniRBT: A Two-stage Distilled Small Chinese Pre-trained Model Xin Yao Ziqing Yang Yiming Cui Shijin Wang 36 3 0 03 Apr 2023
Detecting and Grounding Important Characters in Visual Stories Danyang Liu Frank Keller 20 11 0 30 Mar 2023
TLAG: An Informative Trigger and Label-Aware Knowledge Guided Model for Dialogue-based Relation Extraction Hao An Dongsheng Chen Weiyuan Xu Zhihong Zhu Yuexian Zou 31 2 0 30 Mar 2023
KPEval: Towards Fine-Grained Semantic-Based Keyphrase Evaluation Di Wu Da Yin Kai-Wei Chang 39 1 0 27 Mar 2023
Salient Span Masking for Temporal Understanding Jeremy R. Cole Aditi Chaudhary Bhuwan Dhingra Partha P. Talukdar 57 11 0 22 Mar 2023
Understand Legal Documents with Contextualized Large Language Models Xin Jin Yuchen Wang ELM AILaw 19 7 0 21 Mar 2023
Character, Word, or Both? Revisiting the Segmentation Granularity for Chinese Pre-trained Language Models Xinnian Liang Zefan Zhou Hui Huang Shuangzhi Wu Tong Xiao Muyun Yang Zhoujun Li Chao Bian VLM 38 2 0 20 Mar 2023
Trained on 100 million words and still in shape: BERT meets British National Corpus David Samuel Andrey Kutuzov Lilja Øvrelid Erik Velldal 32 28 0 17 Mar 2023
AMOM: Adaptive Masking over Masking for Conditional Masked Language Model Yisheng Xiao Ruiyang Xu Lijun Wu Juntao Li Tao Qin Yan-Tie Liu Hao Fei 22 9 0 13 Mar 2023
Meet in the Middle: A New Pre-training Paradigm A. Nguyen Nikos Karampatziakis Weizhu Chen 13 20 0 13 Mar 2023
A Comprehensive Survey of AI-Generated Content (AIGC): A History of Generative AI from GAN to ChatGPT Yihan Cao Siyu Li Yixin Liu Zhiling Yan Yutong Dai Philip S. Yu Lichao Sun 38 509 0 07 Mar 2023
How Robust is GPT-3.5 to Predecessors? A Comprehensive Study on Language Understanding Tasks Xuanting Chen Junjie Ye Can Zu Nuo Xu Rui Zheng Minlong Peng Jie Zhou Tao Gui Qi Zhang Xuanjing Huang AI4MH ELM 38 79 0 01 Mar 2023
Empathetic Response Generation via Emotion Cause Transition Graph Yushan Qian Bo Wang Ting-En Lin Yinhe Zheng Yingfu Zhu Dongming Zhao Yuexian Hou Yuchuan Wu Yongbin Li 49 15 0 23 Feb 2023
Embeddings for Tabular Data: A Survey Rajat Singh Srikanta J. Bedathur LMTD 37 2 0 23 Feb 2023
BBT-Fin: Comprehensive Construction of Chinese Financial Domain Pre-trained Language Model, Corpus and Benchmark Dakuan Lu Hengkui Wu Jiaqing Liang Yipei Xu Qi He Yipeng Geng Mengkun Han Ying Xin Yanghua Xiao 38 54 0 18 Feb 2023
Bag of Tricks for Effective Language Model Pretraining and Downstream Adaptation: A Case Study on GLUE Qihuang Zhong Liang Ding Keqin Peng Juhua Liu Bo Du Li Shen Yibing Zhan Dacheng Tao VLM 42 13 0 18 Feb 2023
Multimodal Propaganda Processing Vincent Ng Shengjie Li 6 2 0 17 Feb 2023
Evaluating and Improving the Coreference Capabilities of Machine Translation Models Asaf Yehudai Arie Cattan Omri Abend Gabriel Stanovsky LRM ELM 35 2 0 16 Feb 2023
LabelPrompt: Effective Prompt-based Learning for Relation Classification Weixi Zhang Xiaoning Song Zhenhua Feng Tianyang Xu Xiaojun Wu VLM 40 4 0 16 Feb 2023
Why Can't Discourse Parsing Generalize? A Thorough Investigation of the Impact of Data Diversity Yang Liu Amir Zeldes 8 18 0 13 Feb 2023
Counter-GAP: Counterfactual Bias Evaluation through Gendered Ambiguous Pronouns Zhongbin Xie Vid Kocijan Thomas Lukasiewicz Oana-Maria Camburu 10 2 0 11 Feb 2023
Enhancing E-Commerce Recommendation using Pre-Trained Language Model and Fine-Tuning Nuofan Xu Chenhui Hu 21 2 0 09 Feb 2023
CRL+: A Novel Semi-Supervised Deep Active Contrastive Representation Learning-Based Text Classification Model for Insurance Data Amir Namavar Jahromi Ebrahim Pourjafari H. Karimipour Amit Satpathy Lovell Hodge 22 3 0 08 Feb 2023
COMBO: A Complete Benchmark for Open KG Canonicalization Chengyue Jiang Yong-jia Jiang Weiqi Wu Yuting Zheng Pengjun Xie Kewei Tu 34 2 0 08 Feb 2023
Representation Deficiency in Masked Language Modeling Yu Meng Jitin Krishnan Sinong Wang Qifan Wang Yuning Mao Han Fang Marjan Ghazvininejad Jiawei Han Luke Zettlemoyer 90 7 0 04 Feb 2023
AmbiCoref: Evaluating Human and Model Sensitivity to Ambiguous Coreference Yuewei Yuan Chaitanya Malaviya Mark Yatskar 15 11 0 01 Feb 2023
The Impacts of Unanswerable Questions on the Robustness of Machine Reading Comprehension Models Son Quoc Tran Phong Nguyen-Thuan Do Uyen Le Matt Kretchmar ELM AAML 30 7 0 31 Jan 2023
Sentence Identification with BOS and EOS Label Combinations Takuma Udagawa H. Kanayama Issei Yoshida 19 2 0 31 Jan 2023
Open Problems in Applied Deep Learning M. Raissi AI4CE 55 2 0 26 Jan 2023
Ensemble Transfer Learning for Multilingual Coreference Resolution T. Lai Heng Ji 18 1 0 22 Jan 2023
Dance2MIDI: Dance-driven multi-instruments music generation Bo Han Yuheng Li Yixuan Shen Yi Ren Feilin Han 26 5 0 22 Jan 2023
Unifying Structure Reasoning and Language Model Pre-training for Complex Reasoning Siyuan Wang Zhongyu Wei Jiarong Xu Taishan Li Zhihao Fan LRM 38 5 0 21 Jan 2023
Toward Building General Foundation Models for Language, Vision, and Vision-Language Understanding Tasks Xinsong Zhang Yan Zeng Jipeng Zhang Hang Li VLM AI4CE LRM 34 17 0 12 Jan 2023
Multilingual Entity and Relation Extraction from Unified to Language-specific Training Zixiang Wang Jian Yang Tongliang Li Jiaheng Liu Ying Mo Jiaqi Bai Longtao He Zhoujun Li 29 2 0 11 Jan 2023
Channel-aware Decoupling Network for Multi-turn Dialogue Comprehension ZhuoSheng Zhang Hai Zhao Longxiang Liu BDL 26 1 0 10 Jan 2023
Parameter-Efficient Fine-Tuning Design Spaces Jiaao Chen Aston Zhang Xingjian Shi Mu Li Alexander J. Smola Diyi Yang 48 59 0 04 Jan 2023
Cramming: Training a Language Model on a Single GPU in One Day Jonas Geiping Tom Goldstein MoE 32 86 0 28 Dec 2022
GanLM: Encoder-Decoder Pre-training with an Auxiliary Discriminator Jian Yang Shuming Ma Li Dong Shaohan Huang Haoyang Huang Yuwei Yin Dongdong Zhang Liqun Yang Furu Wei Zhoujun Li SyDa AI4CE 37 25 0 20 Dec 2022
Hybrid Rule-Neural Coreference Resolution System based on Actor-Critic Learning Yu Wang Hongxia Jin 31 2 0 20 Dec 2022
PLUE: Language Understanding Evaluation Benchmark for Privacy Policies in English Jianfeng Chi Wasi Uddin Ahmad Yuan Tian Kai-Wei Chang AILaw ELM 21 10 0 20 Dec 2022
Enriching Relation Extraction with OpenIE Alessandro Temperoni M. Biryukov Martin Theobald 23 1 0 19 Dec 2022
Neural Coreference Resolution based on Reinforcement Learning Yu Wang Hongxia Jin 23 0 0 18 Dec 2022