SpanBERT: Improving Pre-training by Representing and Predicting Spans

24 July 2019

Luke Zettlemoyer

Papers citing "SpanBERT: Improving Pre-training by Representing and Predicting Spans"

50 / 950 papers shown

Title
Large Language Models Meet Stance Detection: A Survey of Tasks, Methods, Applications, Challenges and Future Directions Lata Pangtey Anukriti Bhatnagar Shubhi Bansal Shahid Shafi Dar Nagendra Kumar 34 0 0 13 May 2025
The Efficiency of Pre-training with Objective Masking in Pseudo Labeling for Semi-Supervised Text Classification Arezoo Hatefi Xuan-Son Vu Monowar Bhuyan Frank Drewes VLM 37 0 0 10 May 2025
GASCADE: Grouped Summarization of Adverse Drug Event for Enhanced Cancer Pharmacovigilance Sofia Jamil Aryan Dabad Bollampalli Areen Reddy S. Saha Rajiv Misra Adil A. Shakur 56 0 0 07 May 2025
Prediction-powered estimators for finite population statistics in highly imbalanced textual data: Public hate crime estimation Hannes Waldetoft Jakob Torgander Måns Magnusson 34 0 0 05 May 2025
Multimodal Coreference Resolution for Chinese Social Media Dialogues: Dataset and Benchmark Approach Xingyu Li Chen Gong Guohong Fu VGen 34 0 0 19 Apr 2025
Saga: Capturing Multi-granularity Semantics from Massive Unlabelled IMU Data for User Perception Yunzhe Li Facheng Hu Hongzi Zhu Shifan Zhang Liang Zhang Shan Chang Minyi Guo 46 0 0 16 Apr 2025
Relation Extraction with Instance-Adapted Predicate Descriptions Yuhang Jiang Ramakanth Kavuluru 60 0 0 22 Mar 2025
Dense Policy: Bidirectional Autoregressive Learning of Actions Yue Su Xinyu Zhan Hongjie Fang Han Xue Hao-Shu Fang Yong Li Cewu Lu Lixin Yang VGen 62 3 0 17 Mar 2025
Annotating Scientific Uncertainty: A comprehensive model using linguistic patterns and comparison with existing approaches Panggih Kusuma Ningrum Philipp Mayr N. Smirnova Iana Atanassova UQLM 65 1 0 14 Mar 2025
Bridging Language Models and Financial Analysis Alejandro Lopez-Lira Jihoon Kwon Sangwoon Yoon Jy-yong Sohn Chanyeol Choi AIFin 46 0 0 14 Mar 2025
ARLED: Leveraging LED-based ARMAN Model for Abstractive Summarization of Persian Long Documents Samira Zangooei Amirhossein Darmani Hossein Farahmand Nezhad Laya Mahmoudi 50 0 0 13 Mar 2025
Language Models, Graph Searching, and Supervision Adulteration: When More Supervision is Less and How to Make More More Arvid Frydenlund LRM 63 0 0 13 Mar 2025
Pay Attention to Real World Perturbations! Natural Robustness Evaluation in Machine Reading Comprehension Yulong Wu Viktor Schlegel Riza Batista-Navarro AAML 41 0 0 23 Feb 2025
CR-CTC: Consistency regularization on CTC for improved speech recognition Zengwei Yao Wei Kang Xiaoyu Yang Fangjun Kuang Liyong Guo Han Zhu Zengrui Jin Zhaoqing Li Long Lin Daniel Povey 59 0 0 17 Feb 2025
A Survey of Large Language Models for Healthcare: from Data, Technology, and Applications to Accountability and Ethics Kai He Rui Mao Qika Lin Yucheng Ruan Xiang Lan Mengling Feng Min Zhang LM&MA AILaw 107 157 0 28 Jan 2025
CPTuning: Contrastive Prompt Tuning for Generative Relation Extraction Jiaxin Duan Fengyu Lu Junfei Liu 38 0 0 04 Jan 2025
SMI-Editor: Edit-based SMILES Language Model with Fragment-level Supervision Kangjie Zheng Siyue Liang Junwei Yang Bin Feng Zequn Liu Wei Ju Zhiping Xiao Ming Zhang 78 2 0 07 Dec 2024
Diversity Over Quantity: A Lesson From Few Shot Relation Classification Amir D. N. Cohen Shauli Ravfogel Shaltiel Shmidman Yoav Goldberg 70 0 0 06 Dec 2024
AntLM: Bridging Causal and Masked Language Models Xinru Yu Bin Guo Shiwei Luo Rongxiang Weng Tao Ji Yuanbin Wu CLL 82 1 0 04 Dec 2024
Can bidirectional encoder become the ultimate winner for downstream applications of foundation models? Lewen Yang Xuanyu Zhou Juao Fan Xinyi Xie Shengxin Zhu AI4CE 66 0 0 27 Nov 2024
Speaker Emotion Recognition: Leveraging Self-Supervised Models for Feature Extraction Using Wav2Vec2 and HuBERT Pourya Jafarzadeh Amir Mohammad Rostami Padideh Choobdar 30 1 0 05 Nov 2024
Future Token Prediction -- Causal Language Modelling with Per-Token Semantic State Vector for Multi-Token Prediction Nicholas Walker 29 0 0 23 Oct 2024
Learning Versatile Skills with Curriculum Masking Yao Tang Zhihui Xie Zichuan Lin Deheng Ye Shuai Li OffRL 43 0 0 23 Oct 2024
RKadiyala at SemEval-2024 Task 8: Black-Box Word-Level Text Boundary Detection in Partially Machine Generated Texts Ram Mohan Rao Kadiyala DeLMO 31 2 0 22 Oct 2024
REFINE on Scarce Data: Retrieval Enhancement through Fine-Tuning via Model Fusion of Embedding Models Ambuje Gupta Mrinal Rawat Andreas Stolcke Roberto Pieraccini RALM 23 1 0 16 Oct 2024
Skill-LLM: Repurposing General-Purpose LLMs for Skill Extraction Amirhossein Herandi Yitao Li Zhanlin Liu Ximin Hu Xiao Cai 38 2 0 15 Oct 2024
DynamicER: Resolving Emerging Mentions to Dynamic Entities for RAG Jinyoung Kim Dayoon Ko Gunhee Kim 38 1 0 15 Oct 2024
Generation with Dynamic Vocabulary Yanting Liu Tao Ji Changzhi Sun Yuanbin Wu Xiaoling Wang 45 0 0 11 Oct 2024
AI as Humanity's Salieri: Quantifying Linguistic Creativity of Language Models via Systematic Attribution of Machine Text against Web Text Ximing Lu Melanie Sclar Skyler Hallinan Niloofar Mireshghallah Jiacheng Liu ... Allyson Ettinger Liwei Jiang Khyathi Raghavi Chandu Nouha Dziri Yejin Choi DeLMO 59 11 0 05 Oct 2024
CorPipe at CRAC 2024: Predicting Zero Mentions from Raw Text Milan Straka LRM 31 1 0 03 Oct 2024
MenakBERT -- Hebrew Diacriticizer Ido Cohen Jacob Gidron Idan Pinto VLM 26 0 0 03 Oct 2024
Traffic Light or Light Traffic? Investigating Phrasal Semantics in Large Language Models Rui Meng Ye Liu Lifu Tu Daqing He Yingbo Zhou Semih Yavuz LRM 16 0 0 03 Oct 2024
Towards Robust Extractive Question Answering Models: Rethinking the Training Methodology Son Quoc Tran Matt Kretchmar OOD 19 0 0 29 Sep 2024
Exploring Language Model Generalization in Low-Resource Extractive QA Saptarshi Sengupta Wenpeng Yin Preslav Nakov Shreya Ghosh Suhang Wang 44 0 0 27 Sep 2024
"The Data Says Otherwise"-Towards Automated Fact-checking and Communication of Data Claims Yu Fu Shunan Guo Jane Hoffswell Victor S. Bursztyn Ryan A. Rossi J. Stasko 31 2 0 16 Sep 2024
HTR-VT: Handwritten Text Recognition with Vision Transformer Yuting Li Dexiong Chen Tinglong Tang Xi Shen ViT 23 7 0 13 Sep 2024
WinoPron: Revisiting English Winogender Schemas for Consistency, Coverage, and Grammatical Case Vagrant Gautam Julius Steuer Eileen Bingert Ray Johns Anne Lauscher Dietrich Klakow 54 3 0 09 Sep 2024
Expanding Expressivity in Transformer Models with MöbiusAttention Anna-Maria Halacheva M. Nayyeri Steffen Staab 27 1 0 08 Sep 2024
N-gram Prediction and Word Difference Representations for Language Modeling DongNyeong Heo Daniela N. Rim Heeyoul Choi 24 2 0 05 Sep 2024
Exploring Multiple Strategies to Improve Multilingual Coreference Resolution in CorefUD Ondřej Pražák Miloslav Konopík 39 4 0 29 Aug 2024
GeoReasoner: Reasoning On Geospatially Grounded Context For Natural Language Understanding Yibo Yan Joey Lee LRM 43 7 0 21 Aug 2024
CommunityKG-RAG: Leveraging Community Structures in Knowledge Graphs for Advanced Retrieval-Augmented Generation in Fact-Checking Rong-Ching Chang Jiawei Zhang 49 2 0 16 Aug 2024
SAGA: A Participant-specific Examination of Story Alternatives and Goal Applicability for a Deeper Understanding of Complex Events Sai Vallurupalli Katrin Erk Francis Ferraro 40 1 0 11 Aug 2024
Explicating the Implicit: Argument Detection Beyond Sentence Boundaries Paul Roit Aviv Slobodkin Eran Hirsch Arie Cattan Ayal Klein Valentina Pyatkin Ido Dagan 55 1 0 08 Aug 2024
Deep Learning based Visually Rich Document Content Understanding: A Survey Muhammad Ali Jean Lee Salman Khan 47 6 0 02 Aug 2024
Maverick: Efficient and Accurate Coreference Resolution Defying Recent Trends Giuliano Martinelli Martin Larsson Johannes Wiesel 31 7 0 31 Jul 2024
Big Cooperative Learning Yulai Cong AI4CE 44 0 0 31 Jul 2024
A Novel Dependency Framework for Enhancing Discourse Data Analysis Kun Sun Rong Wang 42 0 0 17 Jul 2024
What distinguishes conspiracy from critical narratives? A computational analysis of oppositional discourse Damir Korenčić Berta Chulvi Xavier Bonet Casals Alejandro Toselli M. Taulé Paolo Rosso 41 4 0 15 Jul 2024
Deep Learning-Based Operators for Evolutionary Algorithms Eliad Shem Tov Moshe Sipper Achiya Elyasaf 28 2 0 15 Jul 2024