SpanBERT: Improving Pre-training by Representing and Predicting Spans

24 July 2019

Luke Zettlemoyer

Papers citing "SpanBERT: Improving Pre-training by Representing and Predicting Spans"

50 / 950 papers shown

Title
Exploiting Rich Textual User-Product Context for Improving Sentiment Analysis Chenyang Lyu Linyi Yang Yue Zhang Yvette Graham Jennifer Foster 26 1 0 17 Dec 2022
Improving self-supervised representation learning via sequential adversarial masking Dylan Sam Min Bai Tristan McKinney Li Erran Li SSL 40 0 0 16 Dec 2022
Saved You A Click: Automatically Answering Clickbait Titles Andrey Kurenkov TA Mentor Yian Zhang O. Johnson 26 5 0 15 Dec 2022
Efficient Pre-training of Masked Language Model via Concept-based Curriculum Masking Mingyu Lee Jun-Hyung Park Junho Kim Kang-Min Kim SangKeun Lee 23 12 0 15 Dec 2022
Paraphrase Identification with Deep Learning: A Review of Datasets and Methods Chao Zhou Cheng Qiu Daniel Ernesto Acuna 42 25 0 13 Dec 2022
BigText-QA: Question Answering over a Large-Scale Hybrid Knowledge Graph Jingjing Xu M. Biryukov Martin Theobald V. Venugopal 34 0 0 12 Dec 2022
Uniform Masking Prevails in Vision-Language Pretraining Siddharth Verma Yuchen Lu Rui Hou Hanchao Yu Nicolas Ballas Madian Khabsa Amjad Almahairi VLM 21 0 0 10 Dec 2022
From Cloze to Comprehension: Retrofitting Pre-trained Masked Language Model to Pre-trained Machine Reader Weiwen Xu Xin Li Wenxuan Zhang Meng Zhou W. Lam Luo Si Lidong Bing 27 2 0 09 Dec 2022
POQue: Asking Participant-specific Outcome Questions for a Deeper Understanding of Complex Events Sai Vallurupalli Sayontan Ghosh K. Erk Niranjan Balasubramanian Francis Ferraro 29 5 0 05 Dec 2022
Toward Efficient Language Model Pretraining and Downstream Adaptation via Self-Evolution: A Case Study on SuperGLUE Qihuang Zhong Liang Ding Yibing Zhan Yu Qiao Yonggang Wen ... Yixin Chen Xinbo Gao Steven C. H. Hoi Xiaoou Tang Dacheng Tao VLM ELM 60 34 0 04 Dec 2022
MiLMo:Minority Multilingual Pre-trained Language Model Sisi Liu Hanru Shi Xinhe Yu Wugedele Bao Yuan Sun Xiaobing Zhao 31 0 0 04 Dec 2022
CoP: Factual Inconsistency Detection by Controlling the Preference Shuaijie She Xiang Geng Shujian Huang Jiajun Chen 33 4 0 03 Dec 2022
Nonparametric Masked Language Modeling Sewon Min Weijia Shi M. Lewis Xilun Chen Wen-tau Yih Hannaneh Hajishirzi Luke Zettlemoyer RALM 50 48 0 02 Dec 2022
Systematic Analysis for Pretrained Language Model Priming for Parameter-Efficient Fine-tuning Shih-Cheng Huang Shi Wang Min-Han Shih Saurav Sahay Hung-yi Lee 47 0 0 02 Dec 2022
Language Model Pre-training on True Negatives Zhuosheng Zhang Hai Zhao Masao Utiyama Eiichiro Sumita 39 2 0 01 Dec 2022
Revisiting text decomposition methods for NLI-based factuality scoring of summaries John Glover Federico Fancellu V. Jagannathan Matthew R. Gormley Thomas Schaaf HILM 37 17 0 30 Nov 2022
Protein Language Models and Structure Prediction: Connection and Progression Bozhen Hu Jun Xia Jiangbin Zheng Cheng Tan Yufei Huang Yongjie Xu Stan Z. Li 29 40 0 30 Nov 2022
End-to-End Neural Discourse Deixis Resolution in Dialogue Shengjie Li Vincent Ng 19 1 0 29 Nov 2022
Contrastive Novelty-Augmented Learning: Anticipating Outliers with Large Language Models Albert Xu Xiang Ren Robin Jia OODD 35 2 0 28 Nov 2022
ESIE-BERT: Enriching Sub-words Information Explicitly with BERT for Joint Intent Classification and SlotFilling Yutian Guo Zhilong Xie Xingyan Chen Huangen Chen Leilei Wang Huaming Du Shaopeng Wei Yu Zhao Qing Li Ganglu Wu 26 7 0 27 Nov 2022
A Survey of Text Representation Methods and Their Genealogy Philipp Siebers Christian Janiesch Patrick Zschech AI4TS 22 9 0 26 Nov 2022
Who are you referring to? Coreference resolution in image narrations A. Goel Basura Fernando Frank Keller Hakan Bilen 27 3 0 26 Nov 2022
Make-A-Story: Visual Memory Conditioned Consistent Story Generation Tanzila Rahman Hsin-Ying Lee Jian Ren Sergey Tulyakov Shweta Mahajan Leonid Sigal DiffM 21 68 0 23 Nov 2022
GraphWOZ: Dialogue Management with Conversational Knowledge Graphs Nicholas Walker Stefan Ultes Pierre Lison 27 5 0 23 Nov 2022
Breaking the Representation Bottleneck of Chinese Characters: Neural Machine Translation with Stroke Sequence Modeling Zhijun Wang Xuebo Liu Min Zhang 35 11 0 23 Nov 2022
Coreference Resolution through a seq2seq Transition-Based System Bernd Bohnet Chris Alberti Michael Collins 28 39 0 22 Nov 2022
TCBERT: A Technical Report for Chinese Topic Classification BERT Ting Han Kunhao Pan Xinyu Chen Dingjie Song Yuchen Fan Xinyu Gao Ruyi Gan Jiaxing Zhang VLM 25 1 0 21 Nov 2022
UniHPF : Universal Healthcare Predictive Framework with Zero Domain Knowledge Kyunghoon Hur Jungwoo Oh Junu Kim Jiyoun Kim Min Jae Lee Eunbyeol Cho Seong-Eun Moon Young-Hak Kim Edward Choi 37 5 0 15 Nov 2022
A Survey for Efficient Open Domain Question Answering Qin Zhang Shan Chen Dongkuan Xu Qingqing Cao Xiaojun Chen Trevor Cohn Meng Fang 33 33 0 15 Nov 2022
A hybrid entity-centric approach to Persian pronoun resolution Hassan Haji Mohammadi Alireza Talebpour Ahmad Mahmoudi-Aznaveh S. Yazdani 28 1 0 11 Nov 2022
CCPrefix: Counterfactual Contrastive Prefix-Tuning for Many-Class Classification Heng Chang Canran Xu Guodong Long Tao Shen Chongyang Tao Jing Jiang 48 1 0 11 Nov 2022
FormLM: Recommending Creation Ideas for Online Forms by Modelling Semantic and Structural Information Yijia Shao Mengyu Zhou Yifan Zhong Tao Wu Hongwei Han Shi Han Gideon Huang Dongmei Zhang 3DV 21 2 0 10 Nov 2022
Review of coreference resolution in English and Persian Hassan Haji Mohammadi Alireza Talebpour Ahmad Mahmoudi-Aznaveh S. Yazdani 14 0 0 08 Nov 2022
Multi-Task Learning Framework for Extracting Emotion Cause Span and Entailment in Conversations A. Bhat Ashutosh Modi 35 9 0 07 Nov 2022
Named Entity Recognition in Indian court judgments Prathamesh Kalamkar Astha Agarwal Aman Tiwari Smita Gupta S. Karn Vivek Raghavan AILaw 29 49 0 07 Nov 2022
Open-Vocabulary Argument Role Prediction for Event Extraction Yizhu Jiao Sha Li Yiqing Xie Ming Zhong Heng Ji Jiawei Han 34 16 0 03 Nov 2022
VarMAE: Pre-training of Variational Masked Autoencoder for Domain-adaptive Language Understanding Dou Hu Xiaolong Hou Xiyang Du Mengyuan Zhou Lian-Xin Jiang Yang Mo Xiaofeng Shi 45 12 0 01 Nov 2022
WHEN FLUE MEETS FLANG: Benchmarks and Large Pre-trained Language Model for Financial Domain Raj Sanjay Shah Kunal Chawla Dheeraj Eidnani Agam Shah Wendi Du Sudheer Chava Natraj Raman Charese Smiley Jiaao Chen Diyi Yang AIFin 37 104 0 31 Oct 2022
Leveraging Pre-trained Models for Failure Analysis Triplets Generation Kenneth Ezukwoke Anis Hoayek M. Batton-Hubert Xavier Boucher Pascal Gounet Jerome Adrian 35 1 0 31 Oct 2022
token2vec: A Joint Self-Supervised Pre-training Framework Using Unpaired Speech and Text Xianghu Yue Junyi Ao Xiaoxue Gao Haizhou Li SSL 28 8 0 30 Oct 2022
TASA: Deceiving Question Answering Models by Twin Answer Sentences Attack Yu Cao Dianqi Li Meng Fang Dinesh Manocha Jun Gao Yibing Zhan Dacheng Tao AAML 26 15 0 27 Oct 2022
arXivEdits: Understanding the Human Revision Process in Scientific Writing Chao Jiang Wei Xu Samuel Stevens 30 22 0 26 Oct 2022
DyREx: Dynamic Query Representation for Extractive Question Answering Urchade Zaratiana Niama El Khbir Dennis Núñez Pierre Holat Nadi Tomeh Thierry Charnois 89 2 0 26 Oct 2022
Autoregressive Structured Prediction with Language Models Tianyu Liu Yuchen Eleanor Jiang Nicholas Monath Ryan Cotterell Mrinmaya Sachan 24 51 0 26 Oct 2022
Investigating the Role of Centering Theory in the Context of Neural Coreference Resolution Systems Yu Jiang Ryan Cotterell Mrinmaya Sachan 29 2 0 26 Oct 2022
Bi-Link: Bridging Inductive Link Predictions from Text via Contrastive Learning of Transformers and Prompts Bohua Peng Shi Liang Mobarakol Islam 25 1 0 26 Oct 2022
Improving Speech Representation Learning via Speech-level and Phoneme-level Masking Approach Xulong Zhang Jianzong Wang Ning Cheng Kexin Zhu Jing Xiao 21 0 0 25 Oct 2022
PALT: Parameter-Lite Transfer of Language Models for Knowledge Graph Completion Jianhao Shen Chenguang Wang Ye Yuan Jiawei Han Heng Ji Koushik Sen Ming Zhang Dawn Song KELM ALM VPVLM 25 7 0 25 Oct 2022
Effective Pre-Training Objectives for Transformer-based Autoencoders Luca Di Liello Matteo Gabburo Alessandro Moschitti 28 3 0 24 Oct 2022
Extending Phrase Grounding with Pronouns in Visual Dialogues Panzhong Lu Xin Zhang Meishan Zhang Min Zhang ObjD 30 4 0 23 Oct 2022