RoBERTa: A Robustly Optimized BERT Pretraining Approach

26 July 2019

Luke Zettlemoyer

Papers citing "RoBERTa: A Robustly Optimized BERT Pretraining Approach"

50 / 10,803 papers shown

Title
Towards Interpretable Mental Health Analysis with Large Language Models Kailai Yang Shaoxiong Ji Tianlin Zhang Qianqian Xie Zi-Zhou Kuang Sophia Ananiadou ELM AI4MH LRM 121 61 0 06 Apr 2023
Bridging the Language Gap: Knowledge Injected Multilingual Question Answering Zhichao Duan Xiuxing Li Zhengyan Zhang Zhenyu Li Ning Liu Jianyong Wang 70 8 0 06 Apr 2023
Evaluating the Robustness of Machine Reading Comprehension Models to Low Resource Entity Renaming Clemencia Siro T. Ajayi 90 2 0 06 Apr 2023
ETPNav: Evolving Topological Planning for Vision-Language Navigation in Continuous Environments Dongyan An Hongru Wang Wenguan Wang Zun Wang Yan Huang Keji He Liang Wang 175 67 0 06 Apr 2023
ChatGPT: More than a Weapon of Mass Deception, Ethical challenges and responses from the Human-Centered Artificial Intelligence (HCAI) perspective A. Sison Marco Tulio Daza Roberto Gozalo-Brizuela E.C. Garrido-Merchán 79 89 0 06 Apr 2023
Automatic ICD-10 Code Association: A Challenging Task on French Clinical Texts Yakini Tchouka Jean-François Couchot David Laiymani Philippe Selles Azzedine Rahmani 72 3 0 06 Apr 2023
Personalized Cognitive Tutoring using Davinci-003 API for Adaptive Question Generation and Assessment Devan Walton 13 1 0 05 Apr 2023
Detecting and Grounding Multi-Modal Media Manipulation Rui Shao Tianxing Wu Ziwei Liu 105 68 0 05 Apr 2023
CoT-MAE v2: Contextual Masked Auto-Encoder with Multi-view Modeling for Passage Retrieval Xing Wu Guangyuan Ma Peng Wang Meng Lin Zijia Lin Fuzheng Zhang Songlin Hu RALM 91 8 0 05 Apr 2023
Adopting Two Supervisors for Efficient Use of Large-Scale Remote Deep Neural Networks Michael Weiss Paolo Tonella AI4CE 60 0 0 05 Apr 2023
Effective Theory of Transformers at Initialization Emily Dinan Sho Yaida Susan Zhang 92 16 0 04 Apr 2023
Dialogue-Contextualized Re-ranking for Medical History-Taking Jian Zhu Ilya Valmianski Anitha Kannan 67 1 0 04 Apr 2023
PromptAid: Prompt Exploration, Perturbation, Testing and Iteration using Visual Analytics for Large Language Models Aditi Mishra Utkarsh Soni Anjana Arunkumar Jinbin Huang Bum Chul Kwon Chris Bryan LRM 83 35 0 04 Apr 2023
San-BERT: Extractive Summarization for Sanskrit Documents using BERT and it's variants Kartikeya Bhatnagar Sampath Lonka Jammi Kunal Mahabala Rao 71 2 0 04 Apr 2023
Can BERT eat RuCoLA? Topological Data Analysis to Explain Irina Proskurina Irina Piontkovskaya Ekaterina Artemova 112 4 0 04 Apr 2023
A Survey on Contextualised Semantic Shift Detection S. Montanelli Francesco Periti ObjD AI4TS 99 35 0 04 Apr 2023
An Embedding-based Approach to Inconsistency-tolerant Reasoning with Inconsistent Ontologies Keyu Wang Si-Nuo Li Jiaye Li Guilin Qi Qiu Ji 99 2 0 04 Apr 2023
Multidimensional Perceptron for Efficient and Explainable Long Text Classification Yexiang Wang Yating Zhang Xiaozhong Liu Changlong Sun 32 0 0 04 Apr 2023
An interpretability framework for Similar case matching Nankai Lin Haonan Liu Jiajun Fang Dong-ping Zhou Aimin Yang 29 1 0 04 Apr 2023
Locate Then Generate: Bridging Vision and Language with Bounding Box for Scene-Text VQA Yongxin Zhu Ziqiang Liu Yukang Liang Xin Li Hao Liu Changcun Bao Linli Xu 60 7 0 04 Apr 2023
Unsupervised Improvement of Factual Knowledge in Language Models Nafis Sadeq Byungkyu Kang Prarit Lamba Julian McAuley KELM 83 7 0 04 Apr 2023
One Small Step for Generative AI, One Giant Leap for AGI: A Complete Survey on ChatGPT in AIGC Era Chaoning Zhang Chenshuang Zhang Chenghao Li Yu Qiao Sheng Zheng ... Sung-Ho Bae Lik-Hang Lee Pan Hui In So Kweon Choong Seon Hong LM&MA AI4MH LRM ELM 106 138 0 04 Apr 2023
To ChatGPT, or not to ChatGPT: That is the question! Alessandro Pegoraro Kavita Kumari Hossein Fereidooni A. Sadeghi DeLMO 79 49 0 04 Apr 2023
A Bibliometric Review of Large Language Models Research from 2017 to 2023 Lizhou Fan Lingyao Li Zihui Ma Sanggyu Lee Huizi Yu Libby Hemphill 119 158 0 03 Apr 2023
A Simple and Effective Method of Cross-Lingual Plagiarism Detection K. Avetisyan Arthur Malajyan Tsolak Ghukasyan A. Avetisyan 62 6 0 03 Apr 2023
Specialty-Oriented Generalist Medical AI for Chest CT Screening Chuang Niu Qing Lyu Christopher D. Carothers P. Kaviani Josh Tan Pingkun Yan Mannudeep K. Kalra C. Whitlow Ge Wang 66 6 0 03 Apr 2023
Efficiently Aligned Cross-Lingual Transfer Learning for Conversational Tasks using Prompt-Tuning Lifu Tu Jin Qu Semih Yavuz Shafiq Joty Wenhao Liu Caiming Xiong Yingbo Zhou 82 9 0 03 Apr 2023
PEACH: Pre-Training Sequence-to-Sequence Multilingual Models for Translation with Semi-Supervised Pseudo-Parallel Document Generation Alireza Salemi Amirhossein Abaskohi Sara Tavakoli Yadollah Yaghoobzadeh A. Shakery AIMat 76 0 0 03 Apr 2023
Safety Analysis in the Era of Large Language Models: A Case Study of STPA using ChatGPT Yi Qi Xingyu Zhao Siddartha Khastgir Xiaowei Huang 80 17 0 03 Apr 2023
DrBERT: A Robust Pre-trained Model in French for Biomedical and Clinical domains Yanis Labrak Adrien Bazoge Richard Dufour Mickael Rouvier Emmanuel Morin B. Daille P. Gourraud LM&MA 71 57 0 03 Apr 2023
Spam-T5: Benchmarking Large Language Models for Few-Shot Email Spam Detection Maxime Labonne Sean J. Moran 92 23 0 03 Apr 2023
Towards Integration of Discriminability and Robustness for Document-Level Relation Extraction Jiannan Guo Stanley Kok Lidong Bing 56 9 0 03 Apr 2023
MiniRBT: A Two-stage Distilled Small Chinese Pre-trained Model Xin Yao Ziqing Yang Yiming Cui Shijin Wang 44 3 0 03 Apr 2023
Vision-Language Models for Vision Tasks: A Survey Jingyi Zhang Jiaxing Huang Sheng Jin Shijian Lu VLM 167 553 0 03 Apr 2023
Better Language Models of Code through Self-Improvement H. To Nghi D. Q. Bui Jingnan Guo Tien N Nguyen SyDa 94 15 0 02 Apr 2023
Learning by Grouping: A Multilevel Optimization Framework for Improving Fairness in Classification without Losing Accuracy Ramtin Hosseini Li Zhang Bhanu Garg P. Xie FaML 44 0 0 02 Apr 2023
DiverseVul: A New Vulnerable Source Code Dataset for Deep Learning Based Vulnerability Detection Yizheng Chen Zhoujie Ding Lamya Alowain Xinyun Chen David Wagner AAML 113 160 0 01 Apr 2023
Extracting Thyroid Nodules Characteristics from Ultrasound Reports Using Transformer-based Natural Language Processing Methods Aman Pathak Zehao Yu Daniel Paredes Elio Monsour Andrea Ortiz Rocha J. Brito N. Ospina Yonghui Wu MedIm 30 6 0 31 Mar 2023
Identifying Symptoms of Delirium from Clinical Narratives Using Natural Language Processing Aokun Chen Daniel Paredes Zehao Yu Xiwei Lou Roberta Brunson ... Sara Ser M. Prosperi Jiang Bian Ragnhildur I. Bjarnadottir Yonghui Wu 16 0 0 31 Mar 2023
DIME-FM: DIstilling Multimodal and Efficient Foundation Models Ximeng Sun Pengchuan Zhang Peizhao Zhang Hardik Shah Kate Saenko Xide Xia VLM 109 22 0 31 Mar 2023
Quick Dense Retrievers Consume KALE: Post Training Kullback Leibler Alignment of Embeddings for Asymmetrical dual encoders Daniel Fernando Campos Alessandro Magnani Chengxiang Zhai 56 3 0 31 Mar 2023
Pair Programming with Large Language Models for Sampling and Estimation of Copulas Jan Górecki LLMAG 34 1 0 31 Mar 2023
Cross-Cultural Transfer Learning for Chinese Offensive Language Detection Li Zhou Laura Cabello Yongfa Cao Daniel Hershcovich 87 21 0 31 Mar 2023
BOLT: An Automated Deep Learning Framework for Training and Deploying Large-Scale Search and Recommendation Models on Commodity CPU Hardware Nicholas Meisburger V. Lakshman Benito Geordie Joshua Engels David Torres Ramos ... Benjamin Meisburger Shubh Gupta Yashwanth Adunukota Tharun Medini Anshumali Shrivastava 102 2 0 30 Mar 2023
Comparing Abstractive Summaries Generated by ChatGPT to Real Summaries Through Blinded Reviewers and Text Classification Algorithms Mayank Soni Vincent P. Wade 19 21 0 30 Mar 2023
Elastic Weight Removal for Faithful and Abstractive Dialogue Generation Nico Daheim Nouha Dziri Mrinmaya Sachan Iryna Gurevych Edoardo Ponti MoMe 108 31 0 30 Mar 2023
Complementary Random Masking for RGB-Thermal Semantic Segmentation Ukcheol Shin Kyunghyun Lee In So Kweon Jean Oh 76 23 0 30 Mar 2023
Topics in the Haystack: Extracting and Evaluating Topics beyond Coherence Anton Thielmann Q. Seifert Arik Reuter Elisabeth Bergherr Benjamin Säfken 90 2 0 30 Mar 2023
TreePiece: Faster Semantic Parsing via Tree Tokenization Sida I. Wang Akshat Shrivastava S. Livshits 61 5 0 30 Mar 2023
TLAG: An Informative Trigger and Label-Aware Knowledge Guided Model for Dialogue-based Relation Extraction Hao An Dongsheng Chen Weiyuan Xu Zhihong Zhu Yuexian Zou 99 2 0 30 Mar 2023