RoBERTa: A Robustly Optimized BERT Pretraining Approach

26 July 2019

Luke Zettlemoyer

Papers citing "RoBERTa: A Robustly Optimized BERT Pretraining Approach"

50 / 10,734 papers shown

Title
Improved POS tagging for spontaneous, clinical speech using data augmentation S. Kulick Neville Ryant David J. Irwin N. Nevler Sunghye Cho 66 0 0 11 Jul 2023
Rad-ReStruct: A Novel VQA Benchmark and Method for Structured Radiology Reporting Chantal Pellegrini Matthias Keicher Ege Özsoy Nassir Navab 92 17 0 11 Jul 2023
My3DGen: A Scalable Personalized 3D Generative Model Luchao Qi Jiaye Wu Annie N. Wang Sheng-Yu Wang Roni Sengupta 3DH 91 5 0 11 Jul 2023
EgoVLPv2: Egocentric Video-Language Pre-training with Fusion in the Backbone Shraman Pramanick Yale Song Sayan Nag Kevin Qinghong Lin Hardik Shah Mike Zheng Shou Ramalingam Chellappa Pengchuan Zhang VLM 118 100 0 11 Jul 2023
Writer adaptation for offline text recognition: An exploration of neural network-based methods Tobias van der Werff Maruf A. Dhali Lambert Schomaker 90 1 0 11 Jul 2023
Overview of BioASQ 2023: The eleventh BioASQ challenge on Large-Scale Biomedical Semantic Indexing and Question Answering A. Nentidis Georgios Katsimpras Anastasia Krithara Salvador Lima-López Eulàlia Farré-Maduell Luis Gasco Martin Krallinger George Giannakopoulos 59 27 0 11 Jul 2023
Vacaspati: A Diverse Corpus of Bangla Literature Pramit Bhattacharyya Joydeep Mondal S. Maji Arnab Bhattacharya 69 7 0 11 Jul 2023
Separate-and-Aggregate: A Transformer-based Patch Refinement Model for Knowledge Graph Completion Chen Chen Yufei Wang Yang Zhang Quan.Z Sheng Kwok-Yan Lam KELM 137 3 0 11 Jul 2023
Detecting LLM-Generated Text in Computing Education: A Comparative Study for ChatGPT Cases Michael Sheinman Orenstrakh Oscar Karnalim C. Suárez Michael Liut DeLMO 83 60 0 10 Jul 2023
Exploring Large Language Model for Graph Data Understanding in Online Job Recommendations Likang Wu Zhaopeng Qiu Zhi Zheng Hengshu Zhu Enhong Chen 65 82 0 10 Jul 2023
PapagAI:Automated Feedback for Reflective Essays Veronika Solopova Adrian Gruszczynski Eiad Rostom Fritz Cremer Sascha Witte ... Florian Hofmann R. Romeike Michaela Glaser-Zikuda Christoph Benzmüller Tim Landgraf 34 5 0 10 Jul 2023
FILM: How can Few-Shot Image Classification Benefit from Pre-Trained Language Models? Zihao Jiang Yunkai Dang Dong Pang Huishuai Zhang Weiran Huang VLM 89 2 0 09 Jul 2023
Disentangling Societal Inequality from Model Biases: Gender Inequality in Divorce Court Proceedings Sujan Dutta Parth Srivastava Vaishnavi Solunke Swaprava Nath Ashiqur R. KhudaBukhsh 49 4 0 09 Jul 2023
Bidirectional Attention as a Mixture of Continuous Word Experts Kevin Christian Wibisono Yixin Wang MoE 28 0 0 08 Jul 2023
Is ChatGPT a Good Personality Recognizer? A Preliminary Study Yuzhe Ji Wen Wu Hong Zheng Yiqiang Hu Xi Chen Liang He AI4MH 67 26 0 08 Jul 2023
Unveiling the Potential of Knowledge-Prompted ChatGPT for Enhancing Drug Trafficking Detection on Social Media Chuanbo Hu Bin Liu Xin Li Yanfang Ye 30 4 0 07 Jul 2023
A Side-by-side Comparison of Transformers for English Implicit Discourse Relation Classification Bruce W. Lee Bongseok Yang J. Lee 76 0 0 07 Jul 2023
Evaluating Biased Attitude Associations of Language Models in an Intersectional Context Shiva Omrani Sabbaghi Robert Wolfe Aylin Caliskan 73 25 0 07 Jul 2023
Open-Vocabulary Object Detection via Scene Graph Discovery Hengcan Shi Munawar Hayat Jianfei Cai ObjD 82 12 0 07 Jul 2023
Vision Language Transformers: A Survey Clayton Fields C. Kennington VLM 53 5 0 06 Jul 2023
BLEURT Has Universal Translations: An Analysis of Automatic Metrics by Minimum Risk Training Yiming Yan Tao Wang Chengqi Zhao Shujian Huang Jiajun Chen Mingxuan Wang 89 24 0 06 Jul 2023
A Novel Site-Agnostic Multimodal Deep Learning Model to Identify Pro-Eating Disorder Content on Social Media J. Feldman 58 0 0 06 Jul 2023
Can ChatGPT's Responses Boost Traditional Natural Language Processing? Mostafa M. Amin Min Zhang Björn W. Schuller AI4MH 34 13 0 06 Jul 2023
DeepOnto: A Python Package for Ontology Engineering with Deep Learning Yuan He Jiaoyan Chen Hang Dong Ian Horrocks Carlo Allocca Taehun Kim B. Sapkota 138 26 0 06 Jul 2023
CORE-GPT: Combining Open Access research and large language models for credible, trustworthy question answering David Pride M. Cancellieri Petr Knoth ELM 42 14 0 06 Jul 2023
Agentività e telicità in GilBERTo: implicazioni cognitive A. Lombardi Alessandro Lenci 53 1 0 06 Jul 2023
NatLogAttack: A Framework for Attacking Natural Language Inference Models with Natural Logic Zióu Zheng Xiao-Dan Zhu AAML LRM 98 6 0 06 Jul 2023
VerifAI: Verified Generative AI Nan Tang Chenyu Yang Ju Fan Lei Cao Yuyu Luo Alon Halevy 71 18 0 06 Jul 2023
Training Models to Generate, Recognize, and Reframe Unhelpful Thoughts Mounica Maddela Megan Ung Jing Xu Andrea Madotto H. Foran Y-Lan Boureau LRM 105 23 0 06 Jul 2023
Exploring Linguistic Style Matching in Online Communities: The Role of Social Context and Conversation Dynamics Aparna Ananthasubramaniam Hong Chen Jason Yan Kenan Alkiek Jiaxin Pei Agrima Seth Lavinia Dunagan Minje Choi Benjamin R. Litterer David Jurgens 67 2 0 06 Jul 2023
Dense Retrieval Adaptation using Target Domain Description Helia Hashemi Yong Zhuang Sachith Sri Ram Kothur Srivas Prasad Edgar Meij W. Bruce Croft VLM 91 9 0 06 Jul 2023
Text Alignment Is An Efficient Unified Model for Massive NLP Tasks Yuheng Zha Yichi Yang Ruichen Li Zhiting Hu ALM 67 11 0 06 Jul 2023
Surge Routing: Event-informed Multiagent Reinforcement Learning for Autonomous Rideshare Daniel Garces Stephanie Gil AI4TS 74 2 0 05 Jul 2023
Real-time Workload Pattern Analysis for Large-scale Cloud Databases Jiaqi Wang Tianyi Li Anni Wang Xiaoze Liu Lu Chen Jie Chen Jianye Liu Junyang Wu Feifei Li Yunjun Gao 58 15 0 05 Jul 2023
Evade ChatGPT Detectors via A Single Space Shuyang Cai Wanyun Cui DeLMO 53 20 0 05 Jul 2023
Several categories of Large Language Models (LLMs): A Short Survey Saurabh Pahune Manoj Chandrasekharan AILaw 47 17 0 05 Jul 2023
Named Entity Inclusion in Abstractive Text Summarization S. Berezin Tatiana Batura 77 7 0 05 Jul 2023
OpenDelta: A Plug-and-play Library for Parameter-efficient Adaptation of Pre-trained Models Shengding Hu Ning Ding Weilin Zhao Xingtai Lv Zhen Zhang Zhiyuan Liu Maosong Sun 57 7 0 05 Jul 2023
Performance Comparison of Large Language Models on VNHSGE English Dataset: OpenAI ChatGPT, Microsoft Bing Chat, and Google Bard Xuan-Quy Dao 25 26 0 05 Jul 2023
SpaceNLI: Evaluating the Consistency of Predicting Inferences in Space Lasha Abzianidze J. Zwarts Yoad Winter 34 2 0 05 Jul 2023
Exploring Multimodal Approaches for Alzheimer's Disease Detection Using Patient Speech Transcript and Audio Data Hongmin Cai Xiaoke Huang Zheng Liu Wenxiong Liao Haixing Dai ... Dajiang Zhu Hui Ren Quanzheng Li Tianming Liu Xiang Li 62 18 0 05 Jul 2023
Generative Job Recommendations with Large Language Model Zhi Zheng Zhaopeng Qiu Xiao Hu Likang Wu Hengshu Zhu Hui Xiong 50 22 0 05 Jul 2023
Towards Open Federated Learning Platforms: Survey and Vision from Technical and Legal Perspectives Moming Duan Qinbin Li Linshan Jiang Bingsheng He FedML 105 5 0 05 Jul 2023
CAME: Confidence-guided Adaptive Memory Efficient Optimization Yang Luo Xiaozhe Ren Zangwei Zheng Zhuo Jiang Xin Jiang Yang You ODL 87 22 0 05 Jul 2023
Improving Automatic Parallel Training via Balanced Memory Workload Optimization Yujie Wang Youhe Jiang Xupeng Miao Fangcheng Fu Shenhan Zhu Xiaonan Nie Yaofeng Tu Tengjiao Wang 103 10 0 05 Jul 2023
An analysis of scam baiting calls: Identifying and extracting scam stages and scripts Ian D. Wood Michal Kepkowski Leron Zinatullin Travis Darnley M. Kâafar 39 4 0 05 Jul 2023
Natural Language Generation and Understanding of Big Code for AI-Assisted Programming: A Review M. Wong Shangxin Guo Ching Nam Hang Siu-Wai Ho C. Tan 97 87 0 04 Jul 2023
Concept-Based Explanations to Test for False Causal Relationships Learned by Abusive Language Classifiers I. Nejadgholi S. Kiritchenko Kathleen C. Fraser Esma Balkir 45 0 0 04 Jul 2023
Robust Hate Speech Detection in Social Media: A Cross-Dataset Empirical Evaluation Dimosthenis Antypas Jose Camacho-Collados 84 24 0 04 Jul 2023
Unified Conversational Models with System-Initiated Transitions between Chit-Chat and Task-Oriented Dialogues Ye Liu Stefan Ultes Wolfgang Minker Wolfgang Maier 57 6 0 04 Jul 2023