SpanBERT: Improving Pre-training by Representing and Predicting Spans

24 July 2019

Luke Zettlemoyer

Papers citing "SpanBERT: Improving Pre-training by Representing and Predicting Spans"

50 / 950 papers shown

Title
Extensive Evaluation of Transformer-based Architectures for Adverse Drug Events Extraction Simone Scaboro Beatrice Portelli Emmanuele Chersoni Enrico Santus Giuseppe Serra 29 8 0 08 Jun 2023
Leveraging Knowledge Graph Embeddings to Enhance Contextual Representations for Relation Extraction F. Laleye Loïc Rakotoson S. Massip 24 1 0 07 Jun 2023
Unbalanced Optimal Transport for Unbalanced Word Alignment Yuki Arase Han Bao Sho Yokoi OT 29 5 0 07 Jun 2023
Gotta: Generative Few-shot Question Answering by Prompt-based Cloze Data Augmentation Xiusi Chen Yu Zhang Jinliang Deng Jyun-Yu Jiang Wei Wang 32 11 0 07 Jun 2023
Interactive Editing for Text Summarization Yujia Xie Xun Wang Si-Qing Chen Wayne Xiong Pengcheng He KELM 145 2 0 05 Jun 2023
On "Scientific Debt" in NLP: A Case for More Rigour in Language Model Pre-Training Research Made Nindyatama Nityasya Haryo Akbarianto Wibowo Alham Fikri Aji Genta Indra Winata Radityo Eko Prasojo Phil Blunsom A. Kuncoro 27 8 0 05 Jun 2023
PULSAR: Pre-training with Extracted Healthcare Terms for Summarising Patients' Problems and Data Augmentation with Black-box Large Language Models Hao Li Yuping Wu Viktor Schlegel Riza Batista-Navarro Thanh-Tung Nguyen Abhinav Ramesh Kashyap Xiaojun Zeng Daniel Beck Stefan Winkler Goran Nenadic LM&MA 21 7 0 05 Jun 2023
A Comprehensive Survey on Relation Extraction: Recent Advances and New Frontiers Xiaoyan Zhao Yang Deng Min Yang Lingzhi Wang Rui Zhang Hong Cheng W. Lam Ying Shen Ruifeng Xu KELM 37 27 0 03 Jun 2023
Unsupervised Paraphrasing of Multiword Expressions Takashi Wada Yuji Matsumoto Timothy Baldwin Jey Han Lau 34 0 0 02 Jun 2023
Towards Learning Discrete Representations via Self-Supervision for Wearables-Based Human Activity Recognition H. Haresamudram Irfan Essa Thomas Ploetz 42 7 0 01 Jun 2023
UKP-SQuARE: An Interactive Tool for Teaching Question Answering Haishuo Fang Haritz Puerto Iryna Gurevych 36 1 0 31 May 2023
Examining risks of racial biases in NLP tools for child protective services Anjalie Field Amanda Coston Nupoor Gandhi Alexandra Chouldechova Emily Putnam-Hornstein David Steier Yulia Tsvetkov 52 13 0 30 May 2023
A Quantitative Review on Language Model Efficiency Research Meng Jiang Hy Dang Lingbo Tong 33 0 0 28 May 2023
Parallel Data Helps Neural Entity Coreference Resolution Gongbo Tang Christian Hardmeier 24 3 0 28 May 2023
Slide, Constrain, Parse, Repeat: Synchronous SlidingWindows for Document AMR Parsing Yara Rizk Tahira Naseem Ramón Fernández Astudillo Radu Florian Salim Roukos 57 0 0 26 May 2023
Entailment as Robust Self-Learner Jiaxin Ge Hongyin Luo Yoon Kim James R. Glass 42 3 0 26 May 2023
Sentence-Incremental Neural Coreference Resolution Matt Grenander Shay B. Cohen Mark Steedman CLL 35 5 0 26 May 2023
Towards a Common Understanding of Contributing Factors for Cross-Lingual Transfer in Multilingual Language Models: A Review Fred Philippy Siwen Guo Shohreh Haddadan LRM 30 30 0 26 May 2023
Comparing Humans and Models on a Similar Scale: Towards Cognitive Gender Bias Evaluation in Coreference Resolution Gili Lior Gabriel Stanovsky 35 4 0 24 May 2023
Self-Evolution Learning for Discriminative Language Model Pretraining Qihuang Zhong Liang Ding Juhua Liu Bo Du Dacheng Tao 39 12 0 24 May 2023
Revisiting Token Dropping Strategy in Efficient BERT Pretraining Qihuang Zhong Liang Ding Juhua Liu Xuebo Liu Min Zhang Bo Du Dacheng Tao VLM 39 9 0 24 May 2023
Dynamic Masking Rate Schedules for MLM Pretraining Zachary Ankner Naomi Saphra Davis W. Blalock Jonathan Frankle Matthew L. Leavitt 34 5 0 24 May 2023
Linear-Time Modeling of Linguistic Structure: An Order-Theoretic Perspective Tianyu Liu Afra Amini Mrinmaya Sachan Ryan Cotterell 34 2 0 24 May 2023
Machine Reading Comprehension using Case-based Reasoning Dung Ngoc Thai Dhruv Agarwal Mudit Chaudhary Wenlong Zhao Rajarshi Das Manzil Zaheer J. Lee Hannaneh Hajishirzi Andrew McCallum 28 1 0 24 May 2023
A Causal View of Entity Bias in (Large) Language Models Fei Wang Wen-An Mo Yiwei Wang Wenxuan Zhou Muhao Chen 32 12 0 24 May 2023
TACR: A Table-alignment-based Cell-selection and Reasoning Model for Hybrid Question-Answering Jian Wu Yicheng Xu Yan Gao Jian-Guang Lou Börje F. Karlsson Manabu Okumura LMTD 18 3 0 24 May 2023
Are Large Language Models Robust Coreference Resolvers? Nghia T. Le Alan Ritter LRM 21 11 0 23 May 2023
HOP, UNION, GENERATE: Explainable Multi-hop Reasoning without Rationale Supervision Wenting Zhao Justin T. Chiu Claire Cardie Alexander M. Rush LRM 21 4 0 23 May 2023
Weakly Supervised 3D Open-vocabulary Segmentation Kunhao Liu Fangneng Zhan Jiahui Zhang Muyu Xu Yingchen Yu Abdulmotaleb El Saddik Christian Theobalt Eric P. Xing Shijian Lu 34 66 0 23 May 2023
DAPR: A Benchmark on Document-Aware Passage Retrieval Kexin Wang Nils Reimers Iryna Gurevych 23 5 0 23 May 2023
REFinD: Relation Extraction Financial Dataset Simerjot Kaur Charese Smiley Akshat Gupta Joy Prakash Sain Dongsheng Wang S. Siddagangappa Toyin Aguda Sameena Shah 29 15 0 22 May 2023
VideoLLM: Modeling Video Sequence with Large Language Models Guo Chen Yin-Dong Zheng Jiahao Wang Jilan Xu Yifei Huang ... Yi Wang Yali Wang Yu Qiao Tong Lu Limin Wang MLLM 103 77 0 22 May 2023
Challenging Decoder helps in Masked Auto-Encoder Pre-training for Dense Passage Retrieval Zehan Li Yanzhao Zhang Dingkun Long Pengjun Xie RALM 33 3 0 22 May 2023
EnCore: Fine-Grained Entity Typing by Pre-Training Entity Encoders on Coreference Chains Frank Mtumbuka Steven Schockaert 49 0 0 22 May 2023
Farewell to Aimless Large-scale Pretraining: Influential Subset Selection for Language Model Xiao Wang Wei Zhou Qi Zhang Jie Zhou Songyang Gao Junzhe Wang Menghan Zhang Xiang Gao Yunwen Chen Tao Gui 53 7 0 22 May 2023
Discourse Centric Evaluation of Machine Translation with a Densely Annotated Parallel Corpus Yu Jiang Tianyu Liu Shuming Ma Dongdong Zhang Mrinmaya Sachan Ryan Cotterell 27 7 0 18 May 2023
The Interpreter Understands Your Meaning: End-to-end Spoken Language Understanding Aided by Speech Translation Mutian He Philip N. Garner 46 4 0 16 May 2023
About Evaluation of F1 Score for RECENT Relation Extraction System Michal Olek 11 0 0 16 May 2023
Schema-adaptable Knowledge Graph Construction Hongbin Ye Honghao Gui Xin Xu Xi Chen Huajun Chen Ningyu Zhang 45 4 0 15 May 2023
Coreference-aware Double-channel Attention Network for Multi-party Dialogue Reading Comprehension Yanling Li Bowei Zou Yifan Fan Mengxing Dong Yu Hong 41 4 0 15 May 2023
Learning to Generalize for Cross-domain QA Yingjie Niu Linyi Yang Ruihai Dong Yue Zhang 24 6 0 14 May 2023
Can SAM Boost Video Super-Resolution? Zhihe Lu Zeyu Xiao Jiawang Bai Zhiwei Xiong Xinchao Wang 27 24 0 11 May 2023
What is the best recipe for character-level encoder-only modelling? Kris Cao 42 2 0 09 May 2023
CharSpan: Utilizing Lexical Similarity to Enable Zero-Shot Machine Translation for Extremely Low-resource Languages Kaushal Kumar Maurya Rahul Kejriwal M. Desarkar Anoop Kunchukuttan 42 1 0 09 May 2023
ANALOGICAL -- A Novel Benchmark for Long Text Analogy Evaluation in Large Language Models Thilini Wijesiriwardene Ruwan Wickramarachchi Bimal Gajera Shreeyash Mukul Gowaikar Chandan Gupta Aman Chadha Aishwarya N. Reganti Amit P. Sheth Amitava Das ELM 30 14 0 08 May 2023
A Frustratingly Easy Improvement for Position Embeddings via Random Padding Mingxu Tao Yansong Feng Dongyan Zhao 34 6 0 08 May 2023
Event Knowledge Incorporation with Posterior Regularization for Event-Centric Question Answering Junru Lu Gabriele Pergola Lin Gui Yulan He 24 0 0 08 May 2023
AnomalyBERT: Self-Supervised Transformer for Time Series Anomaly Detection using Data Degradation Scheme Yungi Jeong Eu-Hui Yang Jung Hyun Ryu Imseong Park Myung-joo Kang ViT AI4TS 34 28 0 08 May 2023
NorBench -- A Benchmark for Norwegian Language Models David Samuel Andrey Kutuzov Samia Touileb Erik Velldal Lilja Ovrelid Egil Rønningstad Elina Sigdel Anna Palatkina 31 23 0 06 May 2023
UNTER: A Unified Knowledge Interface for Enhancing Pre-trained Language Models Deming Ye Yankai Lin Zhengyan Zhang Maosong Sun KELM 29 0 0 02 May 2023