SpanBERT: Improving Pre-training by Representing and Predicting Spans

24 July 2019

Luke Zettlemoyer

Papers citing "SpanBERT: Improving Pre-training by Representing and Predicting Spans"

50 / 950 papers shown

Title
Entity-aware Transformers for Entity Search E. Gerritse Faegheh Hasibi A. D. Vries 41 22 0 02 May 2022
Attention Mechanism in Neural Networks: Where it Comes and Where it Goes Derya Soydaner 3DV 49 150 0 27 Apr 2022
DialogVED: A Pre-trained Latent Variable Encoder-Decoder Model for Dialog Response Generation Wei Chen Yeyun Gong Song Wang Bolun Yao Weizhen Qi ... Bartuer Zhou Yi Mao Weizhu Chen Biao Cheng Nan Duan VLM 32 47 0 27 Apr 2022
SkillSpan: Hard and Soft Skill Extraction from English Job Postings Mike Zhang Kristian Nørgaard Jensen Sif Dam Sonniks Barbara Plank 28 55 0 27 Apr 2022
It Takes Two Flints to Make a Fire: Multitask Learning of Neural Relation and Explanation Classifiers Zheng Tang Mihai Surdeanu 32 6 0 25 Apr 2022
Mining Root Cause Knowledge from Cloud Service Incident Investigations for AIOps Amrita Saha Guosheng Lin 20 27 0 21 Apr 2022
LayoutLMv3: Pre-training for Document AI with Unified Text and Image Masking Yupan Huang Tengchao Lv Lei Cui Yutong Lu Furu Wei 37 437 0 18 Apr 2022
BLISS: Robust Sequence-to-Sequence Learning via Self-Supervised Input Representation Zheng Zhang Liang Ding Dazhao Cheng Xuebo Liu Min Zhang Dacheng Tao 35 11 0 16 Apr 2022
SETTI: A Self-supervised Adversarial Malware Detection Architecture in an IoT Environment Marjan Golmaryami R. Taheri Zahra Pooranian Mohammad Shojafar Pei Xiao 38 12 0 16 Apr 2022
Summarization with Graphical Elements Maartje ter Hoeve Julia Kiseleva Maarten de Rijke 33 2 0 15 Apr 2022
Towards Fine-grained Causal Reasoning and QA Linyi Yang Zhen Wang Yuxiang Wu Jie Yang Yue Zhang 43 15 0 15 Apr 2022
FREDA: Flexible Relation Extraction Data Annotation Michael Strobl Amine Trabelsi Osmar Zaiane 24 0 0 14 Apr 2022
Experimental Standards for Deep Learning in Natural Language Processing Research Dennis Ulmer Elisa Bassignana Max Müller-Eberstein Daniel Varab Mike Zhang Rob van der Goot Christian Hardmeier Barbara Plank 24 10 0 13 Apr 2022
What Language Model Architecture and Pretraining Objective Work Best for Zero-Shot Generalization? Thomas Wang Adam Roberts Daniel Hesslow Teven Le Scao Hyung Won Chung Iz Beltagy Julien Launay Colin Raffel 53 168 0 12 Apr 2022
Solving Price Per Unit Problem Around the World: Formulating Fact Extraction as Question Answering Tarik Arici K. Kumar Hayreddin Çeker Anoop Saladi Ismail B. Tutar 6 2 0 12 Apr 2022
A Comparative Study of Pre-trained Encoders for Low-Resource Named Entity Recognition Yuxuan Chen Jonas Mikkelsen Arne Binder Christoph Alt Leonhard Hennig 40 2 0 11 Apr 2022
Breaking Character: Are Subwords Good Enough for MRLs After All? Omri Keren Tal Avinari Reut Tsarfaty Omer Levy 41 15 0 10 Apr 2022
Modeling Multi-Granularity Hierarchical Features for Relation Extraction Xinnian Liang Shuangzhi Wu Mu Li Zhoujun Li 17 10 0 09 Apr 2022
Towards Understanding Large-Scale Discourse Structures in Pre-Trained and Fine-Tuned Language Models Patrick Huber Giuseppe Carenini 20 11 0 08 Apr 2022
EntSUM: A Data Set for Entity-Centric Summarization Mounica Maddela Mayank Kulkarni Daniel Preoţiuc-Pietro 46 24 0 05 Apr 2022
How Pre-trained Language Models Capture Factual Knowledge? A Causal-Inspired Analysis Shaobo Li Xiaoguang Li Lifeng Shang Zhenhua Dong Chengjie Sun Bingquan Liu Zhenzhou Ji Xin Jiang Qun Liu KELM 41 53 0 31 Mar 2022
Graph Refinement for Coreference Resolution Lesly Miculicich James Henderson 19 12 0 30 Mar 2022
LinkBERT: Pretraining Language Models with Document Links Michihiro Yasunaga J. Leskovec Percy Liang KELM 33 353 0 29 Mar 2022
Discovering material information using hierarchical Reformer model on financial regulatory filings Francois Mercier Makesh Narsimhan AIFin AI4TS 13 0 0 28 Mar 2022
ANNA: Enhanced Language Representation for Question Answering Changwook Jun Hansol Jang Myoseop Sim Hyun Kim Jooyoung Choi Kyungkoo Min Kyunghoon Bae 31 6 0 28 Mar 2022
Lite Unified Modeling for Discriminative Reading Comprehension Yilin Zhao Hai Zhao Libin Shen Yinggong Zhao 34 2 0 26 Mar 2022
3D-OAE: Occlusion Auto-Encoders for Self-Supervised Learning on Point Clouds Junsheng Zhou Xin Wen Baorui Ma Yu-Shen Liu Yue Gao Yi Fang Zhizhong Han 3DPC 41 17 0 26 Mar 2022
Leveraging unsupervised and weakly-supervised data to improve direct speech-to-speech translation Ye Jia Yifan Ding Ankur Bapna Colin Cherry Yu Zhang Alexis Conneau Nobuyuki Morioka 49 20 0 24 Mar 2022
Multi-armed bandits for resource efficient, online optimization of language model pre-training: the use case of dynamic masking Iñigo Urteaga Moulay Draidia Tomer Lancewicki Shahram Khadivi AI4CE 29 1 0 24 Mar 2022
Masked Discrimination for Self-Supervised Learning on Point Clouds Haotian Liu Mu Cai Yong Jae Lee 3DPC 21 164 0 21 Mar 2022
Teaching language models to support answers with verified quotes Jacob Menick Maja Trebacz Vladimir Mikulik John Aslanides Francis Song ... Mia Glaese Susannah Young Lucy Campbell-Gillingham G. Irving Nat McAleese ELM RALM 251 259 0 21 Mar 2022
Simulating Bandit Learning from User Feedback for Extractive Question Answering Ge Gao Eunsol Choi Yoav Artzi 38 14 0 18 Mar 2022
elBERto: Self-supervised Commonsense Learning for Question Answering Xunlin Zhan Yuan Li Xiao Dong Xiaodan Liang Zhiting Hu Lawrence Carin SSL RALM LRM 29 7 0 17 Mar 2022
UNIMO-2: End-to-End Unified Vision-Language Grounded Learning Wei Li Can Gao Guocheng Niu Xinyan Xiao Hao Liu Jiachen Liu Hua Wu Haifeng Wang MLLM 19 21 0 17 Mar 2022
Representation Learning for Resource-Constrained Keyphrase Generation Di Wu Wasi Uddin Ahmad Sunipa Dev Kai-Wei Chang 48 17 0 15 Mar 2022
WCL-BBCD: A Contrastive Learning and Knowledge Graph Approach to Named Entity Recognition Renjie Zhou Qian Hu Jian Wan Jilin Zhang Qiang Liu Tianxiang Hu Jian Li 36 3 0 14 Mar 2022
PERT: Pre-training BERT with Permuted Language Model Yiming Cui Ziqing Yang Ting Liu 33 37 0 14 Mar 2022
DeepTrust: A Reliable Financial Knowledge Retrieval Framework For Explaining Extreme Pricing Anomalies Pok Wah Chan 27 1 0 11 Mar 2022
ClarET: Pre-training a Correlation-Aware Context-To-Event Transformer for Event-Centric Generation and Classification Yucheng Zhou Tao Shen Xiubo Geng Guodong Long Daxin Jiang 42 57 0 04 Mar 2022
Attend, Memorize and Generate: Towards Faithful Table-to-Text Generation in Few Shots Wenting Zhao Ye Liu Yao Wan Philip S. Yu 30 11 0 01 Mar 2022
Read before Generate! Faithful Long Form Question Answering with Machine Reading Dan Su Xiaoguang Li Jindi Zhang Lifeng Shang Xin Jiang Qun Liu Pascale Fung HILM 27 59 0 01 Mar 2022
EPPAC: Entity Pre-typing Relation Classification with Prompt AnswerCentralizing Jiejun Tan Wenbin Hu Weiwei Liu 27 1 0 01 Mar 2022
A Generative Model for Relation Extraction and Classification Jian Ni Gaetano Rossiello A. Gliozzo Radu Florian 33 3 0 26 Feb 2022
OCR-IDL: OCR Annotations for Industry Document Library Dataset Ali Furkan Biten Rubèn Pérez Tito Lluís Gómez Ernest Valveny Dimosthenis Karatzas 30 26 0 25 Feb 2022
Ask2Mask: Guided Data Selection for Masked Speech Modeling M. Baskar Andrew Rosenberg Bhuvana Ramabhadran Yu Zhang Pedro J. Moreno 25 7 0 24 Feb 2022
Incorporating Constituent Syntax for Coreference Resolution Fan Jiang Trevor Cohn 17 4 0 22 Feb 2022
AMS_ADRN at SemEval-2022 Task 5: A Suitable Image-text Multimodal Joint Modeling Method for Multi-task Misogyny Identification Da Li Ming Yi Yukai He 11 1 0 18 Feb 2022
Should You Mask 15% in Masked Language Modeling? Alexander Wettig Tianyu Gao Zexuan Zhong Danqi Chen CVBM 29 162 0 16 Feb 2022
The NLP Task Effectiveness of Long-Range Transformers Guanghui Qin Yukun Feng Benjamin Van Durme 18 28 0 16 Feb 2022
LMN at SemEval-2022 Task 11: A Transformer-based System for English Named Entity Recognition Ngoc Minh Lai 27 3 0 13 Feb 2022