SpanBERT: Improving Pre-training by Representing and Predicting Spans

24 July 2019

Luke Zettlemoyer

Papers citing "SpanBERT: Improving Pre-training by Representing and Predicting Spans"

50 / 950 papers shown

Title
Benchmarking Transformers-based models on French Spoken Language Understanding tasks Oralie Cattan Sahar Ghannay Christophe Servan Sophie Rosset 36 4 0 19 Jul 2022
PiC: A Phrase-in-Context Dataset for Phrase Understanding and Semantic Search Thang M. Pham Seunghyun Yoon Trung Bui Anh Totti Nguyen 32 7 0 19 Jul 2022
Language Modelling with Pixels Phillip Rust Jonas F. Lotz Emanuele Bugliarello Elizabeth Salesky Miryam de Lhoneux Desmond Elliott VLM 43 46 0 14 Jul 2022
Re2G: Retrieve, Rerank, Generate Michael R. Glass Gaetano Rossiello Md. Faisal Mahbub Chowdhury Ankita Rajaram Naik Pengshan Cai A. Gliozzo RALM 35 85 0 13 Jul 2022
DSTEA: Improving Dialogue State Tracking via Entity Adaptive Pre-training Yukyung Lee Takyoung Kim Hoonsang Yoon Pilsung Kang Junseong Bang Misuk Kim 34 4 0 08 Jul 2022
Cross-Lingual QA as a Stepping Stone for Monolingual Open QA in Icelandic Vésteinn Snæbjarnarson H. Einarsson 32 5 0 05 Jul 2022
Masked Autoencoders in 3D Point Cloud Representation Learning Jincen Jiang Xuequan Lu Lizhi Zhao Richard Dazeley Meili Wang 3DPC ViT 62 28 0 04 Jul 2022
GUIM -- General User and Item Embedding with Mixture of Representation in E-commerce Chao Yang Ru He Fangquan Lin Suoyuan Song Jingqiao Zhang Cheng Yang 14 0 0 02 Jul 2022
Construct a Sentence with Multiple Specified Words Yuanliang Meng 16 0 0 25 Jun 2022
Unified BERT for Few-shot Natural Language Understanding Junyu Lu Ping Yang Ruyi Gan Jing Yang Jiaxing Zhang 24 2 0 24 Jun 2022
Towards WinoQueer: Developing a Benchmark for Anti-Queer Bias in Large Language Models Virginia K. Felkner Ho-Chun Herbert Chang Eugene Jang Jonathan May OSLM 34 8 0 23 Jun 2022
Hierarchical Context Tagging for Utterance Rewriting Lisa Jin Linfeng Song Lifeng Jin Dong Yu D. Gildea BDL 20 10 0 22 Jun 2022
TAPHSIR: Towards AnaPHoric Ambiguity Detection and ReSolution In Requirements Saad Ezzini Sallam Abualhaija Chetan Arora M. Sabetzadeh 28 7 0 21 Jun 2022
Zero-Shot Video Question Answering via Frozen Bidirectional Language Models Antoine Yang Antoine Miech Josef Sivic Ivan Laptev Cordelia Schmid 60 229 0 16 Jun 2022
Improving Pre-trained Language Model Fine-tuning with Noise Stability Regularization Hang Hua Xingjian Li Dejing Dou Chengzhong Xu Jiebo Luo 41 15 0 12 Jun 2022
REKnow: Enhanced Knowledge for Joint Entity and Relation Extraction Sheng Zhang Patrick Ng Zhiguo Wang Bing Xiang 32 4 0 10 Jun 2022
The Case for a Single Model that can Both Generate Continuations and Fill in the Blank Daphne Ippolito Liam Dugan Emily Reif Ann Yuan Andy Coenen Chris Callison-Burch 23 2 0 09 Jun 2022
E2S2: Encoding-Enhanced Sequence-to-Sequence Pretraining for Language Understanding and Generation Qihuang Zhong Liang Ding Juhua Liu Bo Du Dacheng Tao 54 27 0 30 May 2022
Decoupling Knowledge from Memorization: Retrieval-augmented Prompt Learning Xiang Chen Lei Li Ningyu Zhang Xiaozhuan Liang Shumin Deng Chuanqi Tan Fei Huang Luo Si Huajun Chen VLM 35 52 0 29 May 2022
VD-PCR: Improving Visual Dialog with Pronoun Coreference Resolution Xintong Yu Hongming Zhang Ruixin Hong Yangqiu Song Changshui Zhang 17 13 0 29 May 2022
AANG: Automating Auxiliary Learning Lucio Dery Paul Michel M. Khodak Graham Neubig Ameet Talwalkar 46 9 0 27 May 2022
LingMess: Linguistically Informed Multi Expert Scorers for Coreference Resolution Shon Otmazgin Arie Cattan Yoav Goldberg LRM 40 36 0 25 May 2022
Scoring Coreference Chains with Split-Antecedent Anaphors Silviu Paun Juntao Yu N. Moosavi Massimo Poesio 32 9 0 24 May 2022
RetroMAE: Pre-Training Retrieval-oriented Language Models Via Masked Auto-Encoder Shitao Xiao Zheng Liu Yingxia Shao Bo Zhao RALM 126 112 0 24 May 2022
BabyBear: Cheap inference triage for expensive language models Leila Khalili Yao You John Bohannon 30 9 0 24 May 2022
On the Role of Bidirectionality in Language Model Pre-Training Mikel Artetxe Jingfei Du Naman Goyal Luke Zettlemoyer Ves Stoyanov 30 16 0 24 May 2022
Semi-Parametric Inducing Point Networks and Neural Processes R. Rastogi Yair Schiff Alon Hacohen Zhaozhi Li I-Hsiang Lee Yuntian Deng M. Sabuncu Volodymyr Kuleshov 3DPC 38 6 0 24 May 2022
Interpretable Proof Generation via Iterative Backward Reasoning Hanhao Qu Yu Cao Jun Gao Liang Ding Ruifeng Xu LRM 241 16 0 22 May 2022
Online Coreference Resolution for Dialogue Processing: Improving Mention-Linking on Real-Time Conversations Liyan Xu Jinho Choi 41 3 0 21 May 2022
Pre-training Data Quality and Quantity for a Low-Resource Language: New Corpus and BERT Models for Maltese Kurt Micallef Albert Gatt Marc Tanti Lonneke van der Plas Claudia Borg 41 28 0 21 May 2022
Pre-training Transformer Models with Sentence-Level Objectives for Answer Sentence Selection Luca Di Liello Siddhant Garg Luca Soldaini Alessandro Moschitti 31 17 0 20 May 2022
Self-Supervised Time Series Representation Learning via Cross Reconstruction Transformer Wen-Rang Zhang Ling Yang Shijia Geng Shenda Hong ViT AI4TS 37 42 0 20 May 2022
Summarization as Indirect Supervision for Relation Extraction Keming Lu I-Hung Hsu Wenxuan Zhou Mingyu Derek Ma Muhao Chen 65 52 0 19 May 2022
What GPT Knows About Who is Who Xiaohan Yang Eduardo Peynetti Vasco Meerman Christy Tanner 146 13 0 16 May 2022
TiBERT: Tibetan Pre-trained Language Model Yuan Sun Sisi Liu Junjie Deng Xiaobing Zhao 71 9 0 15 May 2022
Improving Contextual Representation with Gloss Regularized Pre-training Yu Lin Zhecheng An Peihao Wu Zejun Ma 32 5 0 13 May 2022
Predicting Human Psychometric Properties Using Computational Language Models Antonio Laverghetta Animesh Nighojkar Jamshidbek Mirzakhalov John Licato 32 8 0 12 May 2022
UL2: Unifying Language Learning Paradigms Yi Tay Mostafa Dehghani Vinh Q. Tran Xavier Garcia Jason W. Wei ... Tal Schuster H. Zheng Denny Zhou N. Houlsby Donald Metzler AI4CE 81 299 0 10 May 2022
Unsupervised Slot Schema Induction for Task-oriented Dialog Dian Yu Mingqiu Wang Yuan Cao Izhak Shafran Laurent El Shafey H. Soltau 38 13 0 09 May 2022
Improving negation detection with negation-focused pre-training Thinh Hung Truong Timothy Baldwin Trevor Cohn Karin Verspoor 35 21 0 09 May 2022
A Structured Span Selector Tianyu Liu Yuchen Eleanor Jiang Ryan Cotterell Mrinmaya Sachan 17 4 0 08 May 2022
GRAPHCACHE: Message Passing as Caching for Sentence-Level Relation Extraction Yiwei Wang Muhao Chen Wenxuan Zhou Yujun Cai Keli Zhang Bryan Hooi GNN 17 9 0 08 May 2022
Should We Rely on Entity Mentions for Relation Extraction? Debiasing Relation Extraction with Counterfactual Analysis Yiwei Wang Muhao Chen Wenxuan Zhou Yujun Cai Keli Zhang Dayiheng Liu Baosong Yang Juncheng Liu Bryan Hooi CML 22 51 0 08 May 2022
KECP: Knowledge Enhanced Contrastive Prompting for Few-shot Extractive Question Answering Rongxiang Weng Chengyu Wang Minghui Qiu Qiuhui Shi Hongbin Wang Jun Huang Ming Gao RALM 39 16 0 06 May 2022
Assistive Recipe Editing through Critiquing Diego Antognini Shuyang Li Boi Faltings Julian McAuley 30 2 0 05 May 2022
Relation Extraction as Open-book Examination: Retrieval-enhanced Prompt Tuning Xiang Chen Lei Li Ningyu Zhang Chuanqi Tan Fei Huang Luo Si Huajun Chen RALM VLM 26 36 0 04 May 2022
Modeling Task Interactions in Document-Level Joint Entity and Relation Extraction Liyan Xu Jinho Choi 39 6 0 04 May 2022
Go Back in Time: Generating Flashbacks in Stories with Event Temporal Prompts Rujun Han Hong Chen Yufei Tian Nanyun Peng 24 18 0 04 May 2022
Unified Semantic Typing with Meaningful Label Inference James Y. Huang Bangzheng Li Lyne Tchapmi Muhao Chen 31 30 0 04 May 2022
Paragraph-based Transformer Pre-training for Multi-Sentence Inference Luca Di Liello Siddhant Garg Luca Soldaini Alessandro Moschitti 22 8 0 02 May 2022