RoBERTa: A Robustly Optimized BERT Pretraining Approach

26 July 2019

Luke Zettlemoyer

Papers citing "RoBERTa: A Robustly Optimized BERT Pretraining Approach"

50 / 10,674 papers shown

Title
Transformers Can Overcome the Curse of Dimensionality: A Theoretical Study from an Approximation Perspective Yuling Jiao Yanming Lai Yang Wang Bokai Yan 62 0 0 18 Apr 2025
Few-Shot Referring Video Single- and Multi-Object Segmentation via Cross-Modal Affinity with Instance Sequence Matching Heng Liu Guanghui Li Mingqi Gao Xiantong Zhen Feng Zheng Yansen Wang VOS 147 0 0 18 Apr 2025
Controlled Territory and Conflict Tracking (CONTACT): (Geo-)Mapping Occupied Territory from Open Source Intelligence Paul K. Mandal Cole Leo Connor Hurley 97 0 0 18 Apr 2025
Q-FAKER: Query-free Hard Black-box Attack via Controlled Generation CheolWon Na YunSeok Choi Jee-Hyong Lee AAML 71 0 0 18 Apr 2025
Long-context Non-factoid Question Answering in Indic Languages Ritwik Mishra R. Shah Ponnurangam Kumaraguru 76 0 0 18 Apr 2025
Representation Learning for Tabular Data: A Comprehensive Survey Jun-Peng Jiang Si-Yang Liu Hao-Run Cai Qile Zhou Han-Jia Ye LMTD 170 4 0 17 Apr 2025
WildFireCan-MMD: A Multimodal Dataset for Classification of User-Generated Content During Wildfires in Canada Braeden Sherritt Isar Nejadgholi Marzieh Amini VLM 148 0 0 17 Apr 2025
Transferrable Surrogates in Expressive Neural Architecture Search Spaces Shiwen Qin Gabriela Kadlecová Martin Pilát Shay B. Cohen Roman Neruda Elliot J. Crowley Jovita Lukasik Linus Ericsson AI4CE 406 1 0 17 Apr 2025
Tackling Social Bias against the Poor: A Dataset and Taxonomy on Aporophobia Georgina Curto S. Kiritchenko Muhammad Hammad Fahim Siddiqui I. Nejadgholi Kathleen C. Fraser 36 0 0 17 Apr 2025
Towards Characterizing Subjectivity of Individuals through Modeling Value Conflicts and Trade-offs Younghun Lee Dan Goldwasser LLMAG 445 0 0 17 Apr 2025
Accuracy is Not Agreement: Expert-Aligned Evaluation of Crash Narrative Classification Models S. Bhagat Ibne Farabi Shihab Anuj Sharma 194 0 0 17 Apr 2025
A Scoping Review of Natural Language Processing in Addressing Medically Inaccurate Information: Errors, Misinformation, and Hallucination Zhaoyi Sun Wen-wai Yim Özlem Uzuner Fei Xia Meliha Yetisgen 81 0 0 16 Apr 2025
You Don't Need All Attentions: Distributed Dynamic Fine-Tuning for Foundation Models Shiwei Ding Lan Zhang Zhenlin Wang Giuseppe Ateniese Xiaoyong Yuan 68 0 0 16 Apr 2025
FHBench: Towards Efficient and Personalized Federated Learning for Multimodal Healthcare Penghao Wang Qian Chen Teng Zhang Yu Zhang Wang Lu Yiqiang Chen 88 0 0 15 Apr 2025
From Gaze to Insight: Bridging Human Visual Attention and Vision Language Model Explanation for Weakly-Supervised Medical Image Segmentation Jingkun Chen Haoran Duan Xiao Zhang Boyan Gao T. Tan Vicente Grau Jungong Han 130 0 0 15 Apr 2025
TD-Suite: All Batteries Included Framework for Technical Debt Classification Karthik Shivashankar Antonio Martini 57 0 0 15 Apr 2025
C-MTCSD: A Chinese Multi-Turn Conversational Stance Detection Dataset Fuqiang Niu Yue Yang Xianghua Fu Genan Dai Bowen Zhang 118 1 0 14 Apr 2025
MURR: Model Updating with Regularized Replay for Searching a Document Stream Eugene Yang Nicola Tonellotto Dawn J Lawrie Sean MacAvaney James Mayfield Douglas W. Oard Scott Miller KELM 70 0 0 14 Apr 2025
Improving Multimodal Hateful Meme Detection Exploiting LMM-Generated Knowledge Maria Tzelepi Vasileios Mezaris 108 1 0 14 Apr 2025
Controllable Expressive 3D Facial Animation via Diffusion in a Unified Multimodal Space Kangwei Liu Junwu Liu Xiaowei Yi Jinlin Guo Yun Cao VGen 5 0 0 14 Apr 2025
Langformers: Unified NLP Pipelines for Language Models Rabindra Lamsal M. Read S. Karunasekera KELM AI4CE 41 0 0 12 Apr 2025
Position: Beyond Euclidean -- Foundation Models Should Embrace Non-Euclidean Geometries Neil He Jiahong Liu Buze Zhang N. Bui Ali Maatouk Menglin Yang Irwin King Melanie Weber Rex Ying 79 1 0 11 Apr 2025
Large Language Models as Span Annotators Zdeněk Kasner Vilém Zouhar Patrícia Schmidtová Ivan Kartáč Kristýna Onderková Ondřej Plátek Dimitra Gkatzia Saad Mahamood Ondrej Dusek Simone Balloccu ALM 124 0 0 11 Apr 2025
ModernBERT or DeBERTaV3? Examining Architecture and Data Influence on Transformer Encoder Models Performance Wissam Antoun B. Sagot Djamé Seddah MQ 70 1 0 11 Apr 2025
VLMT: Vision-Language Multimodal Transformer for Multimodal Multi-hop Question Answering Qi Zhi Lim C. Lee K. Lim Kalaiarasi Sonai Muthu Anbananthen 75 0 0 11 Apr 2025
Transformer-Based Temporal Information Extraction and Application: A Review Xin Su Phillip Howard Steven Bethard 84 0 0 10 Apr 2025
SaRoHead: A Dataset for Satire Detection in Romanian Multi-Domain News Headlines Mihnea-Alexandru Vîrlan Razvan-Alexandru Smadu Dumitru-Clementin Cercel 70 0 0 10 Apr 2025
Beyond LLMs: A Linguistic Approach to Causal Graph Generation from Narrative Texts Zehan Li Ruhua Pan Xinyu Pi 50 1 0 10 Apr 2025
JEPA4Rec: Learning Effective Language Representations for Sequential Recommendation via Joint Embedding Predictive Architecture Minh-Anh Nguyen Dung D.Le AI4TS 90 0 0 10 Apr 2025
Semantically Encoding Activity Labels for Context-Aware Human Activity Recognition Wen Ge Guanyi Mou Emmanuel O. Agu Kyumin Lee 66 0 0 10 Apr 2025
Findings of the BabyLM Challenge: Sample-Efficient Pretraining on Developmentally Plausible Corpora Alex Warstadt Aaron Mueller Leshem Choshen E. Wilcox Chengxu Zhuang ... Rafael Mosquera Bhargavi Paranjape Adina Williams Tal Linzen Ryan Cotterell 198 120 0 10 Apr 2025
Multi-view autoencoders for Fake News Detection Ingryd V. S. T. Pereira George D. C. Cavalcanti Rafael M. O. Cruz ViT 43 0 0 10 Apr 2025
A new training approach for text classification in Mental Health: LatentGLoss Korhan Sevinç AI4MH 35 0 0 09 Apr 2025
Data Augmentation for Fake Reviews Detection in Multiple Languages and Multiple Domains Ming Liu Massimo Poesio 86 1 0 09 Apr 2025
RuOpinionNE-2024: Extraction of Opinion Tuples from Russian News Texts Natalia Loukachevitch Natalia Tkachenko Anna Lapanitsyna M. Tikhomirov Nicolay Rusnachenko 85 0 0 09 Apr 2025
Integrating Cognitive Processing Signals into Language Models: A Review of Advances, Applications and Future Directions Angela Lopez-Cardona Sebastian Idesis Ioannis Arapakis 74 0 0 09 Apr 2025
NLP Security and Ethics, in the Wild Heather Lent Erick Galinkin Yiyi Chen Jens Myrup Pedersen Leon Derczynski Johannes Bjerva SILM 135 0 0 09 Apr 2025
Linguistic Interpretability of Transformer-based Language Models: a systematic review Miguel López-Otal Jorge Gracia Jordi Bernad Carlos Bobed Lucía Pitarch-Ballesteros Emma Anglés-Herrero VLM 106 1 0 09 Apr 2025
Understanding Users' Security and Privacy Concerns and Attitudes Towards Conversational AI Platforms Mutahar Ali Arjun Arunasalam Habiba Farrukh SILM 133 1 0 09 Apr 2025
Exploring Gradient-Guided Masked Language Model to Detect Textual Adversarial Attacks Xiaomei Zhang Zhaoxi Zhang Yanjun Zhang Xufei Zheng L. Zhang Shengshan Hu Shirui Pan AAML 58 0 0 08 Apr 2025
Layer-Aware Embedding Fusion for LLMs in Text Classifications Jiho Gwak Yuchul Jung 127 0 0 08 Apr 2025
Confidence Regularized Masked Language Modeling using Text Length Seunghyun Ji Soowon Lee 214 0 0 08 Apr 2025
The Zero Body Problem: Probing LLM Use of Sensory Language Rebecca M. M. Hicke Sil Hamilton David M. Mimno 92 0 0 08 Apr 2025
Multi-Sense Embeddings for Language Models and Knowledge Distillation Qitong Wang Mohammed J. Zaki Georgios Kollias Vasileios Kalantzis KELM 60 1 0 08 Apr 2025
Graph-based Approaches and Functionalities in Retrieval-Augmented Generation: A Comprehensive Survey Zulun Zhu Tiancheng Huang Kai Wang Junda Ye Xiao Chen Siqiang Luo 3DV 141 0 0 08 Apr 2025
Few-shot Personalized Scanpath Prediction Ruoyu Xue Jingyi Xu Sounak Mondal Hieu Le G. Zelinsky Minh Hoai D. Samaras 78 0 0 07 Apr 2025
Constraint Multi-class Positive and Unlabeled Learning for Distantly Supervised Named Entity Recognition Yuzhe Zhang M. Cen Hong Zhang 94 0 0 07 Apr 2025
REVEAL: Relation-based Video Representation Learning for Video-Question-Answering Sofian Chaybouti Walid Bousselham Moritz Wolter Hilde Kuehne 394 0 0 07 Apr 2025
LLM-based Automated Grading with Human-in-the-Loop Hang Li Yucheng Chu Kaiqi Yang Yasemin Copur-Gencturk Jiliang Tang AI4Ed ELM 147 3 0 07 Apr 2025
Less but Better: Parameter-Efficient Fine-Tuning of Large Language Models for Personality Detection Lingzhi Shen Yunfei Long Xiaohao Cai Guanming Chen Imran Razzak Shoaib Jameel 84 0 0 07 Apr 2025