v1v2v3 (latest)

SpanBERT: Improving Pre-training by Representing and Predicting Spans

24 July 2019

Luke Zettlemoyer

Papers citing "SpanBERT: Improving Pre-training by Representing and Predicting Spans"

50 / 955 papers shown

Title
DyREx: Dynamic Query Representation for Extractive Question Answering Urchade Zaratiana Niama El Khbir Dennis Núñez Pierre Holat Nadi Tomeh Thierry Charnois 111 2 0 26 Oct 2022
Autoregressive Structured Prediction with Language Models Tianyu Liu Yuchen Eleanor Jiang Nicholas Monath Ryan Cotterell Mrinmaya Sachan 87 53 0 26 Oct 2022
Investigating the Role of Centering Theory in the Context of Neural Coreference Resolution Systems Yu Jiang Ryan Cotterell Mrinmaya Sachan 132 2 0 26 Oct 2022
Bi-Link: Bridging Inductive Link Predictions from Text via Contrastive Learning of Transformers and Prompts Bohua Peng Shi Liang Mobarakol Islam 79 2 0 26 Oct 2022
Improving Speech Representation Learning via Speech-level and Phoneme-level Masking Approach Xulong Zhang Jianzong Wang Ning Cheng Kexin Zhu Jing Xiao 58 1 0 25 Oct 2022
PALT: Parameter-Lite Transfer of Language Models for Knowledge Graph Completion Jianhao Shen Chenguang Wang Ye Yuan Jiawei Han Heng Ji Koushik Sen Ming Zhang Dawn Song KELM ALM VPVLM 95 8 0 25 Oct 2022
Effective Pre-Training Objectives for Transformer-based Autoencoders Luca Di Liello Matteo Gabburo Alessandro Moschitti 41 3 0 24 Oct 2022
Extending Phrase Grounding with Pronouns in Visual Dialogues Panzhong Lu Xin Zhang Meishan Zhang Min Zhang ObjD 74 4 0 23 Oct 2022
Cross-document Event Coreference Search: Task, Dataset and Modeling Alon Eirew Avi Caciularu Ido Dagan 105 12 0 23 Oct 2022
Exploring The Landscape of Distributional Robustness for Question Answering Models Anas Awadalla Mitchell Wortsman Gabriel Ilharco Sewon Min Ian H. Magnusson Hannaneh Hajishirzi Ludwig Schmidt ELM OOD KELM 116 21 0 22 Oct 2022
Spectrum-BERT: Pre-training of Deep Bidirectional Transformers for Spectral Classification of Chinese Liquors Yansong Wang Yundong Sun Yan-Jiao Fu Dongjie Zhu Zhaoshuo Tian 46 6 0 22 Oct 2022
Generative Prompt Tuning for Relation Classification Jiale Han Shuai Zhao Bo Cheng Shengkun Ma Wei Lu VLM 106 27 0 22 Oct 2022
Enhancing Tabular Reasoning with Pattern Exploiting Training Abhilash Shankarampeta Vivek Gupta Shuo Zhang LMTD RALM ReLM 139 6 0 21 Oct 2022
SpaBERT: A Pretrained Language Model from Geographic Data for Geo-Entity Representation Zekun Li Jina Kim Yao-Yi Chiang Muhao Chen 133 31 0 21 Oct 2022
LittleBird: Efficient Faster & Longer Transformer for Question Answering Minchul Lee Kijong Han M. Shin VLM 113 6 0 21 Oct 2022
InforMask: Unsupervised Informative Masking for Language Model Pretraining Nafis Sadeq Canwen Xu Julian McAuley 95 13 0 21 Oct 2022
Tele-Knowledge Pre-training for Fault Analysis Zhuo Chen Wen Zhang Yufen Huang Yin Hua Yuxia Geng ... Song Jiang Zhaoyang Lian Yuchen Li Lei Cheng Hua-zeng Chen 97 17 0 20 Oct 2022
Pre-training Language Models with Deterministic Factual Knowledge Shaobo Li Xiaoguang Li Lifeng Shang Chengjie Sun Bingquan Liu Zhenzhou Ji Xin Jiang Qun Liu KELM 99 11 0 20 Oct 2022
Explainable Slot Type Attentions to Improve Joint Intent Detection and Slot Filling Kalpa Gunaratna Vijay Srinivasan Akhila Yerukola Hongxia Jin 59 7 0 19 Oct 2022
The Tail Wagging the Dog: Dataset Construction Biases of Social Bias Benchmarks Nikil Selvam Sunipa Dev Daniel Khashabi Tushar Khot Kai-Wei Chang ALM 72 26 0 18 Oct 2022
Taxonomy of Abstractive Dialogue Summarization: Scenarios, Approaches and Future Directions Qi Jia Yizhu Liu Siyu Ren Kenny Q. Zhu 80 8 0 18 Oct 2022
Adversarial and Safely Scaled Question Generation Sreehari Sankar Zhihang Dong 48 0 0 17 Oct 2022
Knowledge Prompting in Pre-trained Language Model for Natural Language Understanding Jiadong Wang Wenkang Huang Qiuhui Shi Hongbin Wang Minghui Qiu Xiang Li Ming Gao KELM VLM 90 19 0 16 Oct 2022
Mention Annotations Alone Enable Efficient Domain Adaptation for Coreference Resolution Nupoor Gandhi Anjalie Field Emma Strubell 29 6 0 14 Oct 2022
JOIST: A Joint Speech and Text Streaming Model For ASR Tara N. Sainath Rohit Prabhavalkar Ankur Bapna Yu Zhang Zhouyuan Huo Zhehuai Chen Yue Liu Weiran Wang Trevor Strohman RALM AuLLM 87 35 0 13 Oct 2022
ezCoref: Towards Unifying Annotation Guidelines for Coreference Resolution Ankita Gupta Marzena Karpinska Wenlong Zhao Kalpesh Krishna Jack Merullo Luke Yeh Mohit Iyyer Brendan O'Connor 51 5 0 13 Oct 2022
ERNIE-Layout: Layout Knowledge Enhanced Pre-training for Visually-rich Document Understanding Qiming Peng Yinxu Pan Wenjin Wang Bin Luo Zhenyu Zhang ... Shi Feng Yu Sun Hao Tian Hua Wu Haifeng Wang 81 83 0 12 Oct 2022
A Kernel-Based View of Language Model Fine-Tuning Sadhika Malladi Alexander Wettig Dingli Yu Danqi Chen Sanjeev Arora VLM 157 69 0 11 Oct 2022
Aggregating Crowdsourced and Automatic Judgments to Scale Up a Corpus of Anaphoric Reference for Fiction and Wikipedia Texts Juntao Yu Silviu Paun Maris Camilleri Paloma Carretero García Jon Chamberlain Udo Kruschwitz Massimo Poesio 56 8 0 11 Oct 2022
Improving Sharpness-Aware Minimization with Fisher Mask for Better Generalization on Language Models Qihuang Zhong Liang Ding Li Shen Peng Mi Juhua Liu Bo Du Dacheng Tao AAML 90 51 0 11 Oct 2022
Instance Regularization for Discriminative Language Model Pre-training Zhuosheng Zhang Hai Zhao M. Zhou 88 1 0 11 Oct 2022
Extracting or Guessing? Improving Faithfulness of Event Temporal Relation Extraction Haoyu Wang Hongming Zhang Yuqian Deng Jacob R. Gardner Dan Roth Muhao Chen 68 21 0 10 Oct 2022
Empowering the Fact-checkers! Automatic Identification of Claim Spans on Twitter Megha Sundriyal Atharva Kulkarni Vaibhav Pulastya Md. Shad Akhtar Tanmoy Chakraborty MedIm 69 19 0 10 Oct 2022
Better Pre-Training by Reducing Representation Confusion Haojie Zhang Mingfei Liang Ruobing Xie Zhen Sun Bo Zhang Leyu Lin 45 2 0 09 Oct 2022
Longtonotes: OntoNotes with Longer Coreference Chains Kumar Shridhar Nicholas Monath Raghuveer Thirukovalluru Alessandro Stolfo Manzil Zaheer Andrew McCallum Mrinmaya Sachan 60 3 0 07 Oct 2022
XDoc: Unified Pre-training for Cross-Format Document Understanding Jingye Chen Tengchao Lv Lei Cui Changrong Zhang Furu Wei 93 14 0 06 Oct 2022
SpeechLM: Enhanced Speech Pre-Training with Unpaired Textual Data Zi-Hua Zhang Sanyuan Chen Long Zhou Yu Wu Shuo Ren ... Zhuoyuan Yao Xun Gong Lirong Dai Jinyu Li Furu Wei 79 57 0 30 Sep 2022
Unsupervised Lexical Substitution with Decontextualised Embeddings Takashi Wada Timothy Baldwin Yuji Matsumoto Jey Han Lau 140 7 0 17 Sep 2022
ÚFAL CorPipe at CRAC 2022: Effectivity of Multilingual Models for Coreference Resolution Milan Straka Jana Straková LRM 69 13 0 15 Sep 2022
SPACE-3: Unified Dialog Model Pre-training for Task-Oriented Dialog Understanding and Generation Wanwei He Yinpei Dai Min Yang Jian Sun Fei Huang Luo Si Yongbin Li 81 62 0 14 Sep 2022
SPACE-2: Tree-Structured Semi-Supervised Contrastive Pre-training for Task-Oriented Dialog Understanding Wanwei He Yinpei Dai Binyuan Hui Min Yang Zhen Cao Jianbo Dong Fei Huang Luo Si Yongbin Li VLM 118 32 0 14 Sep 2022
SSL-WM: A Black-Box Watermarking Approach for Encoders Pre-trained by Self-supervised Learning Peizhuo Lv Pan Li Shenchen Zhu Shengzhi Zhang Kai Chen ... Fan Xiang Yuling Cai Hualong Ma Yingjun Zhang Guozhu Meng AAML 86 7 0 08 Sep 2022
Extractive is not Faithful: An Investigation of Broad Unfaithfulness Problems in Extractive Summarization Shiyue Zhang David Wan Joey Tianyi Zhou HILM 111 31 0 08 Sep 2022
AILAB-Udine@SMM4H 22: Limits of Transformers and BERT Ensembles Beatrice Portelli Simone Scaboro Emmanuele Chersoni Enrico Santus Giuseppe Serra MoE 36 5 0 07 Sep 2022
Increasing Adverse Drug Events extraction robustness on social media: case study on negation and speculation Simone Scaboro Beatrice Portelli Emmanuele Chersoni Enrico Santus G. Serra 68 5 0 06 Sep 2022
NL2GDPR: Automatically Develop GDPR Compliant Android Application Features from Natural Language F. H. Shezan Yingjie Lao Minlong Peng Xin Wang Mingming Sun Ping Li 42 3 0 29 Aug 2022
CLOWER: A Pre-trained Language Model with Contrastive Learning over Word and Character Representations Borun Chen Hongyin Tang Jiahao Bu Kai Zhang Jingang Wang Qifan Wang Haitao Zheng Wei Wu Liqian Yu VLM 54 1 0 23 Aug 2022
Learning Better Masking for Better Language Model Pre-training Dongjie Yang Zhuosheng Zhang Hai Zhao 80 15 0 23 Aug 2022
PANDA: Prompt Transfer Meets Knowledge Distillation for Efficient Model Adaptation Qihuang Zhong Liang Ding Juhua Liu Bo Du Dacheng Tao VLM CLL 94 44 0 22 Aug 2022
Z-Code++: A Pre-trained Language Model Optimized for Abstractive Summarization Pengcheng He Baolin Peng Liyang Lu Song Wang Jie Mei ... Chenguang Zhu Wayne Xiong Michael Zeng Jianfeng Gao Xuedong Huang 117 47 0 21 Aug 2022