v1v2v3 (latest)

SpanBERT: Improving Pre-training by Representing and Predicting Spans

24 July 2019

Luke Zettlemoyer

Papers citing "SpanBERT: Improving Pre-training by Representing and Predicting Spans"

50 / 956 papers shown

Title
SPOT: Knowledge-Enhanced Language Representations for Information Extraction Jiacheng Li Yannis Katsis Tyler Baldwin Ho-Cheol Kim Andrew Bartko Julian McAuley Chun-Nan Hsu 80 17 0 20 Aug 2022
Multilingual Coreference Resolution in Multiparty Dialogue Boyuan Zheng Patrick Xia M. Yarmohammadi Benjamin Van Durme 111 4 0 02 Aug 2022
giMLPs: Gate with Inhibition Mechanism in MLPs Cheng Kang Jindich Prokop Lei Tong Huiyu Zhou Yong Hu Daneil Novak 33 0 0 01 Aug 2022
Efficient Training of Language Models to Fill in the Middle Mohammad Bavarian Heewoo Jun Nikolas Tezak John Schulman C. McLeavey Jerry Tworek Mark Chen 94 197 0 28 Jul 2022
MLRIP: Pre-training a military language representation model with informative factual knowledge and professional knowledge base Hui Li Xu Yang Xin Zhao Lin Yu Jiping Zheng Wei Sun KELM 38 0 0 28 Jul 2022
MABe22: A Multi-Species Multi-Task Benchmark for Learned Representations of Behavior Jennifer J. Sun Markus Marks Andrew Ulmer Dipam Chakraborty Brian Geuther ... Joseph Parker Pietro Perona Yisong Yue K. Branson Ann Kennedy 40 9 0 21 Jul 2022
MeshMAE: Masked Autoencoders for 3D Mesh Data Analysis Yaqian Liang Shanshan Zhao Baosheng Yu Jing Zhang Fazhi He ViT 93 39 0 20 Jul 2022
GenHPF: General Healthcare Predictive Framework with Multi-task Multi-source Learning Kyunghoon Hur Jungwoo Oh Junu Kim Jiyoun Kim Min Jae Lee Eunbyeol Choi Seong-Eun Moon Young-Hak Kim Louis Atallah Edward Choi AI4TS 95 29 0 20 Jul 2022
Benchmarking Transformers-based models on French Spoken Language Understanding tasks Oralie Cattan Sahar Ghannay Christophe Servan Sophie Rosset 49 4 0 19 Jul 2022
PiC: A Phrase-in-Context Dataset for Phrase Understanding and Semantic Search Thang M. Pham Seunghyun Yoon Trung Bui Anh Totti Nguyen 62 7 0 19 Jul 2022
Language Modelling with Pixels Phillip Rust Jonas F. Lotz Emanuele Bugliarello Elizabeth Salesky Miryam de Lhoneux Desmond Elliott VLM 107 46 0 14 Jul 2022
Re2G: Retrieve, Rerank, Generate Michael R. Glass Gaetano Rossiello Md. Faisal Mahbub Chowdhury Ankita Rajaram Naik Pengshan Cai A. Gliozzo RALM 89 96 0 13 Jul 2022
DSTEA: Improving Dialogue State Tracking via Entity Adaptive Pre-training Yukyung Lee Takyoung Kim Hoonsang Yoon Pilsung Kang Junseong Bang Misuk Kim 117 4 0 08 Jul 2022
Cross-Lingual QA as a Stepping Stone for Monolingual Open QA in Icelandic Vésteinn Snæbjarnarson H. Einarsson 59 6 0 05 Jul 2022
Masked Autoencoders in 3D Point Cloud Representation Learning Jincen Jiang Xuequan Lu Lizhi Zhao Richard Dazeley Meili Wang 3DPC ViT 144 29 0 04 Jul 2022
GUIM -- General User and Item Embedding with Mixture of Representation in E-commerce Chao Yang Ru He Fangquan Lin Suoyuan Song Jingqiao Zhang Cheng Yang 29 0 0 02 Jul 2022
Construct a Sentence with Multiple Specified Words Yuanliang Meng 18 0 0 25 Jun 2022
Unified BERT for Few-shot Natural Language Understanding Junyu Lu Ping Yang Ruyi Gan Jing Yang Jiaxing Zhang 67 2 0 24 Jun 2022
Towards WinoQueer: Developing a Benchmark for Anti-Queer Bias in Large Language Models Virginia K. Felkner Ho-Chun Herbert Chang Eugene Jang Jonathan May OSLM 59 8 0 23 Jun 2022
Hierarchical Context Tagging for Utterance Rewriting Lisa Jin Linfeng Song Lifeng Jin Dong Yu D. Gildea BDL 81 10 0 22 Jun 2022
TAPHSIR: Towards AnaPHoric Ambiguity Detection and ReSolution In Requirements Saad Ezzini Sallam Abualhaija Chetan Arora M. Sabetzadeh 30 7 0 21 Jun 2022
Zero-Shot Video Question Answering via Frozen Bidirectional Language Models Antoine Yang Antoine Miech Josef Sivic Ivan Laptev Cordelia Schmid 149 239 0 16 Jun 2022
Improving Pre-trained Language Model Fine-tuning with Noise Stability Regularization Hang Hua Xingjian Li Dejing Dou Chengzhong Xu Jiebo Luo 94 15 0 12 Jun 2022
REKnow: Enhanced Knowledge for Joint Entity and Relation Extraction Sheng Zhang Patrick Ng Zhiguo Wang Bing Xiang 63 5 0 10 Jun 2022
The Case for a Single Model that can Both Generate Continuations and Fill in the Blank Daphne Ippolito Liam Dugan Emily Reif Ann Yuan Andy Coenen Chris Callison-Burch 57 2 0 09 Jun 2022
E2S2: Encoding-Enhanced Sequence-to-Sequence Pretraining for Language Understanding and Generation Qihuang Zhong Liang Ding Juhua Liu Bo Du Dacheng Tao 114 27 0 30 May 2022
Decoupling Knowledge from Memorization: Retrieval-augmented Prompt Learning Xiang Chen Lei Li Ningyu Zhang Xiaozhuan Liang Shumin Deng Chuanqi Tan Fei Huang Luo Si Huajun Chen VLM 155 55 0 29 May 2022
VD-PCR: Improving Visual Dialog with Pronoun Coreference Resolution Xintong Yu Hongming Zhang Ruixin Hong Yangqiu Song Changshui Zhang 72 13 0 29 May 2022
AANG: Automating Auxiliary Learning Lucio Dery Paul Michel M. Khodak Graham Neubig Ameet Talwalkar 114 9 0 27 May 2022
LingMess: Linguistically Informed Multi Expert Scorers for Coreference Resolution Shon Otmazgin Arie Cattan Yoav Goldberg LRM 88 37 0 25 May 2022
Scoring Coreference Chains with Split-Antecedent Anaphors Silviu Paun Juntao Yu N. Moosavi Massimo Poesio 70 9 0 24 May 2022
RetroMAE: Pre-Training Retrieval-oriented Language Models Via Masked Auto-Encoder Shitao Xiao Zheng Liu Yingxia Shao Bo Zhao RALM 278 126 0 24 May 2022
BabyBear: Cheap inference triage for expensive language models Leila Khalili Yao You John Bohannon 72 10 0 24 May 2022
On the Role of Bidirectionality in Language Model Pre-Training Mikel Artetxe Jingfei Du Naman Goyal Luke Zettlemoyer Ves Stoyanov 200 17 0 24 May 2022
Semi-Parametric Inducing Point Networks and Neural Processes R. Rastogi Yair Schiff Alon Hacohen Zhaozhi Li I-Hsiang Lee Yuntian Deng M. Sabuncu Volodymyr Kuleshov 3DPC 86 7 0 24 May 2022
Interpretable Proof Generation via Iterative Backward Reasoning Hanhao Qu Yu Cao Jun Gao Liang Ding Ruifeng Xu LRM 417 17 0 22 May 2022
Online Coreference Resolution for Dialogue Processing: Improving Mention-Linking on Real-Time Conversations Liyan Xu Jinho Choi 68 3 0 21 May 2022
Pre-training Data Quality and Quantity for a Low-Resource Language: New Corpus and BERT Models for Maltese Kurt Micallef Albert Gatt Marc Tanti Lonneke van der Plas Claudia Borg 76 29 0 21 May 2022
Pre-training Transformer Models with Sentence-Level Objectives for Answer Sentence Selection Luca Di Liello Siddhant Garg Luca Soldaini Alessandro Moschitti 71 17 0 20 May 2022
Self-Supervised Time Series Representation Learning via Cross Reconstruction Transformer Wen-Rang Zhang Ling Yang Shijia Geng Shenda Hong ViT AI4TS 94 44 0 20 May 2022
Summarization as Indirect Supervision for Relation Extraction Keming Lu I-Hung Hsu Wenxuan Zhou Mingyu Derek Ma Muhao Chen 80 54 0 19 May 2022
What GPT Knows About Who is Who Xiaohan Yang Eduardo Peynetti Vasco Meerman Christy Tanner 206 14 0 16 May 2022
TiBERT: Tibetan Pre-trained Language Model Yuan Sun Sisi Liu Junjie Deng Xiaobing Zhao 94 10 0 15 May 2022
Improving Contextual Representation with Gloss Regularized Pre-training Yu Lin Zhecheng An Peihao Wu Zejun Ma 83 5 0 13 May 2022
Predicting Human Psychometric Properties Using Computational Language Models Antonio Laverghetta Animesh Nighojkar Jamshidbek Mirzakhalov John Licato 62 9 0 12 May 2022
UL2: Unifying Language Learning Paradigms Yi Tay Mostafa Dehghani Vinh Q. Tran Xavier Garcia Jason W. Wei ... Tal Schuster H. Zheng Denny Zhou N. Houlsby Donald Metzler AI4CE 141 313 0 10 May 2022
Unsupervised Slot Schema Induction for Task-oriented Dialog Dian Yu Mingqiu Wang Yuan Cao Izhak Shafran Laurent El Shafey H. Soltau 67 13 0 09 May 2022
Improving negation detection with negation-focused pre-training Thinh Hung Truong Timothy Baldwin Trevor Cohn Karin Verspoor 79 21 0 09 May 2022
A Structured Span Selector Tianyu Liu Yuchen Eleanor Jiang Ryan Cotterell Mrinmaya Sachan 87 4 0 08 May 2022
GRAPHCACHE: Message Passing as Caching for Sentence-Level Relation Extraction Yiwei Wang Muhao Chen Wenxuan Zhou Yujun Cai Yuxuan Liang Bryan Hooi GNN 37 9 0 08 May 2022