v1v2v3 (latest)

SpanBERT: Improving Pre-training by Representing and Predicting Spans

24 July 2019

Luke Zettlemoyer

Papers citing "SpanBERT: Improving Pre-training by Representing and Predicting Spans"

50 / 956 papers shown

Title
New Vietnamese Corpus for Machine Reading Comprehension of Health News Articles Kiet Van Nguyen Tin Van Huynh Duc-Vu Nguyen A. Nguyen Ngan Luu-Thuy Nguyen 75 41 0 19 Jun 2020
To Pretrain or Not to Pretrain: Examining the Benefits of Pretraining on Resource Rich Tasks Sinong Wang Madian Khabsa Hao Ma 60 26 0 15 Jun 2020
Self-supervised Learning: Generative or Contrastive Xiao Liu Fanjin Zhang Zhenyu Hou Zhaoyu Wang Li Mian Jing Zhang Jie Tang SSL 215 1,648 0 15 Jun 2020
Mathematical Reasoning via Self-supervised Skip-tree Training M. Rabe Dennis Lee Kshitij Bansal Christian Szegedy ReLM LRM 47 2 0 08 Jun 2020
A Cross-Task Analysis of Text Span Representations Shubham Toshniwal Freda Shi Bowen Shi Lingyu Gao Karen Livescu Kevin Gimpel 88 36 0 06 Jun 2020
DeCLUTR: Deep Contrastive Learning for Unsupervised Textual Representations John Giorgi Osvald Nitski Bo Wang Gary D. Bader SSL 157 499 0 05 Jun 2020
DeBERTa: Decoding-enhanced BERT with Disentangled Attention Pengcheng He Xiaodong Liu Jianfeng Gao Weizhu Chen AAML 195 2,771 0 05 Jun 2020
Syntactic Structure Distillation Pretraining For Bidirectional Encoders A. Kuncoro Lingpeng Kong Daniel Fried Dani Yogatama Laura Rimell Chris Dyer Phil Blunsom 93 34 0 27 May 2020
Stronger Baselines for Grammatical Error Correction Using Pretrained Encoder-Decoder Model Satoru Katsumata Mamoru Komachi 87 56 0 24 May 2020
TaBERT: Pretraining for Joint Understanding of Textual and Tabular Data Pengcheng Yin Graham Neubig Wen-tau Yih Sebastian Riedel RALM LMTD 135 609 0 17 May 2020
Machine Reading Comprehension: The Role of Contextualized Language Models and Beyond Zhuosheng Zhang Hai Zhao Rui Wang 115 63 0 13 May 2020
A Report on the 2020 Sarcasm Detection Shared Task Debanjan Ghosh Avijit Vajpayee Smaranda Muresan 66 61 0 12 May 2020
SKEP: Sentiment Knowledge Enhanced Pre-training for Sentiment Analysis Hao Tian Can Gao Xinyan Xiao Hao Liu Bolei He Hua Wu Haifeng Wang Feng Wu 73 237 0 12 May 2020
Enabling Language Models to Fill in the Blanks Chris Donahue Mina Lee Percy Liang 58 198 0 11 May 2020
It's Morphin' Time! Combating Linguistic Discrimination with Inflectional Perturbations Samson Tan Shafiq Joty Min-Yen Kan R. Socher 227 105 0 09 May 2020
SentiBERT: A Transferable Transformer-Based Architecture for Compositional Sentiment Semantics Da Yin Tao Meng Kai-Wei Chang 85 139 0 08 May 2020
GOBO: Quantizing Attention-Based NLP Models for Low Latency and Energy Efficient Inference Ali Hadi Zadeh Isak Edo Omar Mohamed Awad Andreas Moshovos MQ 82 190 0 08 May 2020
Harvesting and Refining Question-Answer Pairs for Unsupervised QA Zhongli Li Wenhui Wang Li Dong Furu Wei Ke Xu 73 40 0 06 May 2020
ExpBERT: Representation Engineering with Natural Language Explanations Shikhar Murty Pang Wei Koh Percy Liang 86 43 0 05 May 2020
Teaching Machine Comprehension with Compositional Explanations Qinyuan Ye Xiao Huang Elizabeth Boschee Xiang Ren LRM ReLM 100 34 0 02 May 2020
KLEJ: Comprehensive Benchmark for Polish Language Understanding Piotr Rybak Robert Mroczkowski Janusz Tracz Ireneusz Gawlik ELM 73 84 0 01 May 2020
MUSS: Multilingual Unsupervised Sentence Simplification by Mining Paraphrases Louis Martin Angela Fan Eric Villemonte de la Clergerie Antoine Bordes Benoît Sagot 83 36 0 01 May 2020
Incremental Neural Coreference Resolution in Constant Memory Patrick Xia João Sedoc Benjamin Van Durme CLL 50 3 0 30 Apr 2020
TACRED Revisited: A Thorough Evaluation of the TACRED Relation Extraction Task Christoph Alt Aleksandra Gabryszak Leonhard Hennig 143 159 0 30 Apr 2020
Enriched Pre-trained Transformers for Joint Slot Filling and Intent Detection Momchil Hardalov Ivan Koychev Preslav Nakov VLM 47 17 0 30 Apr 2020
Robust Question Answering Through Sub-part Alignment Jifan Chen Greg Durrett OOD 70 13 0 30 Apr 2020
The Effect of Natural Distribution Shift on Question Answering Models John Miller K. Krauth Benjamin Recht Ludwig Schmidt OOD 105 145 0 29 Apr 2020
Exploiting Structured Knowledge in Text via Graph-Guided Representation Learning Tao Shen Yi Mao Pengcheng He Guodong Long Adam Trischler Weizhu Chen 84 63 0 29 Apr 2020
Revisiting Pre-Trained Models for Chinese Natural Language Processing Yiming Cui Wanxiang Che Ting Liu Bing Qin Shijin Wang Guoping Hu 104 706 0 29 Apr 2020
Capturing Global Informativeness in Open Domain Keyphrase Extraction Si Sun Zhenghao Liu Chenyan Xiong Zhiyuan Liu Jie Bao 49 30 0 28 Apr 2020
Semantics-Aware Inferential Network for Natural Language Understanding Shuailiang Zhang Hai Zhao Junru Zhou LRM 71 4 0 28 Apr 2020
LightPAFF: A Two-Stage Distillation Framework for Pre-training and Fine-tuning Kaitao Song Hao Sun Xu Tan Tao Qin Jianfeng Lu Hongzhi Liu Tie-Yan Liu 71 27 0 27 Apr 2020
Contextualized Representations Using Textual Encyclopedic Knowledge Mandar Joshi Kenton Lee Yi Luan Kristina Toutanova 136 31 0 24 Apr 2020
Probabilistically Masked Language Model Capable of Autoregressive Generation in Arbitrary Word Order Yi-Lun Liao Xin Jiang Qun Liu 56 40 0 24 Apr 2020
Self-Attention Attribution: Interpreting Information Interactions Inside Transformer Y. Hao Li Dong Furu Wei Ke Xu ViT 111 229 0 23 Apr 2020
Train No Evil: Selective Masking for Task-Guided Pre-Training Yuxian Gu Zhengyan Zhang Xiaozhi Wang Zhiyuan Liu Maosong Sun 143 60 0 21 Apr 2020
MPNet: Masked and Permuted Pre-training for Language Understanding Kaitao Song Xu Tan Tao Qin Jianfeng Lu Tie-Yan Liu 111 1,142 0 20 Apr 2020
Probing Linguistic Features of Sentence-Level Representations in Neural Relation Extraction Christoph Alt Aleksandra Gabryszak Leonhard Hennig NAI 62 34 0 17 Apr 2020
Dialogue-Based Relation Extraction Dian Yu Kai Sun Claire Cardie Dong Yu 66 135 0 17 Apr 2020
Bridging Anaphora Resolution as Question Answering Yufang Hou RALM 72 47 0 16 Apr 2020
Entities as Experts: Sparse Memory Access with Entity Supervision Thibault Févry Livio Baldini Soares Nicholas FitzGerald Eunsol Choi Tom Kwiatkowski RALM 132 155 0 15 Apr 2020
Coreferential Reasoning Learning for Language Representation Deming Ye Yankai Lin Jiaju Du Zhenghao Liu Peng Li Maosong Sun Zhiyuan Liu 87 179 0 15 Apr 2020
Designing Precise and Robust Dialogue Response Evaluators Tianyu Zhao Divesh Lala Tatsuya Kawahara 75 53 0 10 Apr 2020
Transfer learning and subword sampling for asymmetric-resource one-to-many neural translation Stig-Arne Gronroos Sami Virpioja M. Kurimo 66 6 0 08 Apr 2020
Downstream Model Design of Pre-trained Language Model for Relation Extraction Task Cheng-rong Li Ye Tian 72 36 0 08 Apr 2020
Efficient long-distance relation extraction with DG-SpanBERT Jun Chen Robert Hoehndorf Mohamed Elhoseiny Xiangliang Zhang 80 9 0 07 Apr 2020
MobileBERT: a Compact Task-Agnostic BERT for Resource-Limited Devices Zhiqing Sun Hongkun Yu Xiaodan Song Renjie Liu Yiming Yang Denny Zhou MQ 138 820 0 06 Apr 2020
Deep Learning Based Text Classification: A Comprehensive Review Shervin Minaee Nal Kalchbrenner Min Zhang Narjes Nikzad M. Asgari-Chenaghlu Jianfeng Gao AILaw VLM AI4TS 116 1,116 0 06 Apr 2020
Pre-trained Models for Natural Language Processing: A Survey Xipeng Qiu Tianxiang Sun Yige Xu Yunfan Shao Ning Dai Xuanjing Huang LM&MA VLM 407 1,500 0 18 Mar 2020
A Survey on Contextual Embeddings Qi Liu Matt J. Kusner Phil Blunsom 276 151 0 16 Mar 2020