v1v2v3 (latest)

SpanBERT: Improving Pre-training by Representing and Predicting Spans

24 July 2019

Luke Zettlemoyer

Papers citing "SpanBERT: Improving Pre-training by Representing and Predicting Spans"

50 / 955 papers shown

Title
A Generative Model for Relation Extraction and Classification Jian Ni Gaetano Rossiello A. Gliozzo Radu Florian 42 5 0 26 Feb 2022
OCR-IDL: OCR Annotations for Industry Document Library Dataset Ali Furkan Biten Rubèn Pérez Tito Lluís Gómez Ernest Valveny Dimosthenis Karatzas 74 30 0 25 Feb 2022
Ask2Mask: Guided Data Selection for Masked Speech Modeling M. Baskar Andrew Rosenberg Bhuvana Ramabhadran Yu Zhang Pedro J. Moreno 52 8 0 24 Feb 2022
Incorporating Constituent Syntax for Coreference Resolution Fan Jiang Trevor Cohn 118 4 0 22 Feb 2022
AMS_ADRN at SemEval-2022 Task 5: A Suitable Image-text Multimodal Joint Modeling Method for Multi-task Misogyny Identification Da Li Ming Yi Yukai He 24 1 0 18 Feb 2022
Should You Mask 15% in Masked Language Modeling? Alexander Wettig Tianyu Gao Zexuan Zhong Danqi Chen CVBM 105 167 0 16 Feb 2022
The NLP Task Effectiveness of Long-Range Transformers Guanghui Qin Yukun Feng Benjamin Van Durme 67 30 0 16 Feb 2022
LMN at SemEval-2022 Task 11: A Transformer-based System for English Named Entity Recognition Ngoc Minh Lai 43 3 0 13 Feb 2022
PQuAD: A Persian Question Answering Dataset Kasra Darvishi Newsha Shahbodagh Zahra Abbasiantaeb S. Momtazi 36 19 0 13 Feb 2022
mSLAM: Massively multilingual joint pre-training for speech and text Ankur Bapna Colin Cherry Yu Zhang Ye Jia Melvin Johnson Yong Cheng Simran Khanuja Jason Riesa Alexis Conneau VLM 73 114 0 03 Feb 2022
Reasoning Like Program Executors Xinyu Pi Qian Liu Bei Chen Morteza Ziyadi Zeqi Lin Qiang Fu Yan Gao Jian-Guang Lou Weizhu Chen ReLM LRM 319 53 0 27 Jan 2022
Linguistically-driven Multi-task Pre-training for Low-resource Neural Machine Translation Zhuoyuan Mao Chenhui Chu Sadao Kurohashi 37 7 0 20 Jan 2022
Transferability in Deep Learning: A Survey Junguang Jiang Yang Shu Jianmin Wang Mingsheng Long OOD 93 104 0 15 Jan 2022
Reasoning Through Memorization: Nearest Neighbor Knowledge Graph Embeddings Peng Wang Xin Xie Xiaohan Wang Ningyu Zhang RALM 131 18 0 14 Jan 2022
Progressively Optimized Bi-Granular Document Representation for Scalable Embedding Based Retrieval Shitao Xiao Zheng Liu Weihao Han Jianjin Zhang Yingxia Shao ... Hao Sun Denvy Deng Liangjie Zhang Qi Zhang Xing Xie 158 18 0 14 Jan 2022
Making a (Counterfactual) Difference One Rationale at a Time Michael J. Plyler Michal Green Min Chi 94 12 0 13 Jan 2022
Grow-and-Clip: Informative-yet-Concise Evidence Distillation for Answer Explanation Yuyan Chen Yanghua Xiao Bang Liu 80 17 0 13 Jan 2022
Multi-task Pre-training Language Model for Semantic Network Completion Da Li Sen Yang Kele Xu Ming Yi Yukai He Huaimin Wang 99 33 0 13 Jan 2022
MERLOT Reserve: Neural Script Knowledge through Vision and Language and Sound Rowan Zellers Jiasen Lu Ximing Lu Youngjae Yu Yanpeng Zhao Mohammadreza Salehi Aditya Kusupati Jack Hessel Ali Farhadi Yejin Choi 113 215 0 07 Jan 2022
Fortunately, Discourse Markers Can Enhance Language Models for Sentiment Analysis L. Ein-Dor Ilya Shnayderman Artem Spector Lena Dankin R. Aharonov Noam Slonim 77 8 0 06 Jan 2022
Budget Sensitive Reannotation of Noisy Relation Classification Data Using Label Hierarchy Akshay Parekh Ashish Anand Amit Awekar 28 0 0 26 Dec 2021
ERNIE 3.0 Titan: Exploring Larger-scale Knowledge Enhanced Pre-training for Language Understanding and Generation Shuohuan Wang Yu Sun Yang Xiang Zhihua Wu Siyu Ding ... Tian Wu Wei Zeng Ge Li Wen Gao Haifeng Wang ELM 92 78 0 23 Dec 2021
Word Graph Guided Summarization for Radiology Findings Jinpeng Hu Jianling Li Zhihong Chen Yaling Shen Yan Song Xiang Wan Tsung-Hui Chang 65 38 0 18 Dec 2021
Learning Rich Representation of Keyphrases from Text Mayank Kulkarni Debanjan Mahata Ravneet Arora Rajarshi Bhowmik VLM 76 68 0 16 Dec 2021
DocAMR: Multi-Sentence AMR Representation and Evaluation Tahira Naseem Austin Blodgett Yara Rizk Timothy J. O'Gorman Young-Suk Lee Jeffrey Flanigan Ramón Fernández Astudillo Radu Florian Salim Roukos Nathan Schneider 65 17 0 15 Dec 2021
LongT5: Efficient Text-To-Text Transformer for Long Sequences Mandy Guo Joshua Ainslie David C. Uthus Santiago Ontanon Jianmo Ni Yun-hsuan Sung Yinfei Yang VLM 89 317 0 15 Dec 2021
VALSE: A Task-Independent Benchmark for Vision and Language Models Centered on Linguistic Phenomena Letitia Parcalabescu Michele Cafagna Lilitta Muradjan Anette Frank Iacer Calixto Albert Gatt CoGe 104 118 0 14 Dec 2021
TopNet: Learning from Neural Topic Model to Generate Long Stories Yazheng Yang Boyuan Pan Deng Cai Huan Sun 39 9 0 14 Dec 2021
WECHSEL: Effective initialization of subword embeddings for cross-lingual transfer of monolingual language models Benjamin Minixhofer Fabian Paischer Navid Rekabsaz 109 85 0 13 Dec 2021
General Facial Representation Learning in a Visual-Linguistic Manner Yinglin Zheng Hao Yang Ting Zhang Jianmin Bao Dongdong Chen Yangyu Huang Lu Yuan Dong Chen Ming Zeng Fang Wen CVBM 207 176 0 06 Dec 2021
MetaQA: Combining Expert Agents for Multi-Skill Question Answering Haritz Puerto Gözde Gül Sahin Iryna Gurevych LLMAG 105 21 0 03 Dec 2021
DKPLM: Decomposable Knowledge-enhanced Pre-trained Language Model for Natural Language Understanding Taolin Zhang Chengyu Wang Nan Hu Minghui Qiu Chengguang Tang Xiaofeng He Jun Huang KELM VLM 73 30 0 02 Dec 2021
Domain-oriented Language Pre-training with Adaptive Hybrid Masking and Optimal Transport Alignment Denghui Zhang Zixuan Yuan Yanchi Liu Hao Liu Fuzhen Zhuang Hui Xiong Haifeng Chen VLM 33 3 0 01 Dec 2021
Point-BERT: Pre-training 3D Point Cloud Transformers with Masked Point Modeling Xumin Yu Lulu Tang Yongming Rao Tiejun Huang Jie Zhou Jiwen Lu 3DPC 173 689 0 29 Nov 2021
An analysis of document graph construction methods for AMR summarization Fei-Tzin Lee Chris Kedzie Nakul Verma Kathleen McKeown 34 9 0 27 Nov 2021
PeCo: Perceptual Codebook for BERT Pre-training of Vision Transformers Xiaoyi Dong Jianmin Bao Ting Zhang Dongdong Chen Weiming Zhang Lu Yuan Dong Chen Fang Wen Nenghai Yu Baining Guo ViT 150 245 0 24 Nov 2021
ExT5: Towards Extreme Multi-Task Scaling for Transfer Learning V. Aribandi Yi Tay Tal Schuster J. Rao H. Zheng ... Jianmo Ni Jai Gupta Kai Hui Sebastian Ruder Donald Metzler MoE 125 216 0 22 Nov 2021
LAnoBERT: System Log Anomaly Detection based on BERT Masked Language Model Yukyung Lee Jina Kim Pilsung Kang 64 84 0 18 Nov 2021
Document AI: Benchmarks, Models and Applications Lei Cui Yiheng Xu Tengchao Lv Furu Wei VLM 89 74 0 16 Nov 2021
A Survey on Green Deep Learning Jingjing Xu Wangchunshu Zhou Zhiyi Fu Hao Zhou Lei Li VLM 203 84 0 08 Nov 2021
Machine-in-the-Loop Rewriting for Creative Image Captioning Vishakh Padmakumar He He 96 17 0 07 Nov 2021
Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Survey Bonan Min Hayley L Ross Elior Sulem Amir Pouran Ben Veyseh Thien Huu Nguyen Oscar Sainz Eneko Agirre Ilana Heinz Dan Roth LM&MA VLM AI4CE 197 1,094 0 01 Nov 2021
Alignment Attention by Matching Key and Query Distributions Shujian Zhang Xinjie Fan Huangjie Zheng Korawat Tanwisuth Mingyuan Zhou OOD 122 10 0 25 Oct 2021
Interpreting Deep Learning Models in Natural Language Processing: A Review Xiaofei Sun Diyi Yang Xiaoya Li Tianwei Zhang Yuxian Meng Han Qiu Guoyin Wang Eduard H. Hovy Jiwei Li 97 46 0 20 Oct 2021
SLAM: A Unified Encoder for Speech and Language Modeling via Speech-Text Joint Pre-Training Ankur Bapna Yu-An Chung Na Wu Anmol Gulati Ye Jia J. Clark Melvin Johnson Jason Riesa Alexis Conneau Yu Zhang VLM 137 96 0 20 Oct 2021
GNN-LM: Language Modeling based on Global Contexts via GNN Yuxian Meng Shi Zong Xiaoya Li Xiaofei Sun Tianwei Zhang Leilei Gan Jiwei Li LRM 127 39 0 17 Oct 2021
On the Robustness of Reading Comprehension Models to Entity Renaming Jun Yan Yang Xiao Sagnik Mukherjee Bill Yuchen Lin Robin Jia Xiang Ren 104 20 0 16 Oct 2021
Metadata Shaping: Natural Language Annotations for the Tail Simran Arora Sen Wu Enci Liu Christopher Ré 66 0 0 16 Oct 2021
Tracing Origins: Coreference-aware Machine Reading Comprehension Baorong Huang Zhuosheng Zhang Hai Zhao 122 5 0 15 Oct 2021
Attacking Open-domain Question Answering by Injecting Misinformation Liangming Pan Wenhu Chen Min-Yen Kan Wenjie Wang HILM AAML 292 28 0 15 Oct 2021