RoBERTa: A Robustly Optimized BERT Pretraining Approach

26 July 2019

Luke Zettlemoyer

Papers citing "RoBERTa: A Robustly Optimized BERT Pretraining Approach"

50 / 10,734 papers shown

Title
LaFiCMIL: Rethinking Large File Classification from the Perspective of Correlated Multiple Instance Learning Tiezhu Sun Weiguo Pian N. Daoudi Kevin Allix Tegawende F. Bissyande Jacques Klein 126 1 0 30 Jul 2023
An Unforgeable Publicly Verifiable Watermark for Large Language Models Aiwei Liu Leyi Pan Xuming Hu Shuang Li Lijie Wen Irwin King Philip S. Yu WaLM 126 37 0 30 Jul 2023
Text Analysis Using Deep Neural Networks in Digital Humanities and Information Science Omri Suissa Avshalom Elmalech M. Zhitomirsky-Geffet AI4CE 57 48 0 30 Jul 2023
Question Answering with Deep Neural Networks for Semi-Structured Heterogeneous Genealogical Knowledge Graphs Omri Suissa M. Zhitomirsky-Geffet Avshalom Elmalech GNN BDL 82 9 0 30 Jul 2023
Okapi: Instruction-tuned Large Language Models in Multiple Languages with Reinforcement Learning from Human Feedback Viet Dac Lai Chien Van Nguyen Nghia Trung Ngo Thuat Nguyen Franck Dernoncourt Ryan Rossi Thien Huu Nguyen ALM 133 150 0 29 Jul 2023
Towards Codable Watermarking for Injecting Multi-bits Information to LLMs Lean Wang Wenkai Yang Deli Chen Hao Zhou Yankai Lin Fandong Meng Jie Zhou Xu Sun WaLM 86 22 0 29 Jul 2023
ATESA-BÆRT: A Heterogeneous Ensemble Learning Model for Aspect-Based Sentiment Analysis Elena Simona Apostol Alin-Georgian Pisica Ciprian-Octavian Truică 41 3 0 29 Jul 2023
Multi-output Headed Ensembles for Product Item Classification H. Shiokawa Pradipto Das Arthur R. Toth Justin Chiu 23 0 0 29 Jul 2023
CFN-ESA: A Cross-Modal Fusion Network with Emotion-Shift Awareness for Dialogue Emotion Recognition Jiang Li Xiaoping Wang Yingjian Liu Zhigang Zeng 112 19 0 28 Jul 2023
WC-SBERT: Zero-Shot Text Classification via SBERT with Self-Training for Wikipedia Categories Te-Yu Chi Y. Tang Chia-Wen Lu Qiuyue Zhang J. Jang 74 2 0 28 Jul 2023
Reasoning before Responding: Integrating Commonsense-based Causality Explanation for Empathetic Response Generation Yahui Fu K. Inoue Chenhui Chu Tatsuya Kawahara LRM 80 13 0 28 Jul 2023
An Overview Of Temporal Commonsense Reasoning and Acquisition Georg Wenzel Adam Jatowt ReLM LRM 111 9 0 28 Jul 2023
The Marginal Value of Momentum for Small Learning Rate SGD Runzhe Wang Sadhika Malladi Tianhao Wang Kaifeng Lyu Zhiyuan Li ODL 82 9 0 27 Jul 2023
Incrementally-Computable Neural Networks: Efficient Inference for Dynamic Inputs Or Sharir Anima Anandkumar 55 0 0 27 Jul 2023
ARC-NLP at PAN 2023: Transition-Focused Natural Language Inference for Writing Style Detection Izzet Emre Kucukkaya Umitcan Sahin Cagri Toraman 38 4 0 27 Jul 2023
ARC-NLP at PAN 2023: Hierarchical Long Text Classification for Trigger Detection Umitcan Sahin Izzet Emre Kucukkaya Cagri Toraman 51 2 0 27 Jul 2023
Retrieval-based Text Selection for Addressing Class-Imbalanced Data in Classification Sareh Ahmadi Aditya Shah Edward A. Fox 24 1 0 27 Jul 2023
Cascaded Cross-Modal Transformer for Request and Complaint Detection Nicolae-Cătălin Ristea Radu Tudor Ionescu 90 3 0 27 Jul 2023
Exploiting the Potential of Seq2Seq Models as Robust Few-Shot Learners Jihyeon Janel Lee Dain Kim Doohae Jung Boseop Kim Kyoung-Woon On 53 0 0 27 Jul 2023
ArcGPT: A Large Language Model Tailored for Real-world Archival Applications Shitou Zhang Jingrui Hou Siyuan Peng Z. Li Qibiao Hu Peijie Wang KELM RALM LLMAG 76 3 0 27 Jul 2023
Improving Aspect-Based Sentiment with End-to-End Semantic Role Labeling Model P. Pribán O. Pražák 56 4 0 27 Jul 2023
Learning Multi-modal Representations by Watching Hundreds of Surgical Video Lectures Kun Yuan V. Srivastav Tong Yu Joël L. Lavanchy J. Marescaux Pietro Mascagni Nassir Navab N. Padoy 190 23 0 27 Jul 2023
Jailbreak in pieces: Compositional Adversarial Attacks on Multi-Modal Language Models Erfan Shayegani Yue Dong Nael B. Abu-Ghazaleh 119 152 0 26 Jul 2023
Automatically Evaluating Opinion Prevalence in Opinion Summarization Christopher Malon 38 1 0 26 Jul 2023
Are Transformers with One Layer Self-Attention Using Low-Rank Weight Matrices Universal Approximators? T. Kajitsuka Issei Sato 127 18 0 26 Jul 2023
Affective Natural Language Generation of Event Descriptions through Fine-grained Appraisal Conditions Yarik Menchaca Resendiz Roman Klinger 68 5 0 26 Jul 2023
DPBERT: Efficient Inference for BERT based on Dynamic Planning Weixin Wu H. Zhuo 18 0 0 26 Jul 2023
Mental-LLM: Leveraging Large Language Models for Mental Health Prediction via Online Text Data Xuhai Xu Bingsheng Yao Yu Dong Saadia Gabriel Hongfeng Yu James A. Hendler Marzyeh Ghassemi A. Dey Dakuo Wang LM&MA CLL AI4MH 94 70 0 26 Jul 2023
FinTree: Financial Dataset Pretrain Transformer Encoder for Relation Extraction Hyunjong Ok 47 2 0 26 Jul 2023
ARC-NLP at Multimodal Hate Speech Event Detection 2023: Multimodal Methods Boosted by Ensemble Learning, Syntactical and Entity Features Umitcan Sahin Izzet Emre Kucukkaya Oguzhan Ozcelik Cagri Toraman 73 11 0 25 Jul 2023
E^2VPT: An Effective and Efficient Approach for Visual Prompt Tuning Cheng Han Qifan Wang Yiming Cui Zhiwen Cao Wenguan Wang Siyuan Qi Dongfang Liu VPVLM VLM 90 55 0 25 Jul 2023
Foundational Models Defining a New Era in Vision: A Survey and Outlook Muhammad Awais Muzammal Naseer Salman Khan Rao Muhammad Anwer Hisham Cholakkal M. Shah Ming-Hsuan Yang Fahad Shahbaz Khan VLM 146 127 0 25 Jul 2023
GPT-3 Models are Few-Shot Financial Reasoners Raul Salles de Padua Imran Qureshi M. Karakaplan AIFin ELM 22 2 0 25 Jul 2023
Spectrum-guided Multi-granularity Referring Video Object Segmentation Bo Miao Bennamoun Yongsheng Gao Ajmal Mian VOS 97 41 0 25 Jul 2023
Re-mine, Learn and Reason: Exploring the Cross-modal Semantic Correlations for Language-guided HOI detection Yichao Cao Qingfei Tang Fengyuan Yang Xiu Su Shan You Xiaobo Lu Chang Xu 91 17 0 25 Jul 2023
Embedding Models for Supervised Automatic Extraction and Classification of Named Entities in Scientific Acknowledgements N. Smirnova Philipp Mayr 50 5 0 25 Jul 2023
A Hybrid Machine Learning Model for Classifying Gene Mutations in Cancer using LSTM, BiLSTM, CNN, GRU, and GloVe Sanad Aburass O. Dorgham Jamil Al Shaqsi 73 28 0 24 Jul 2023
IteraTTA: An interface for exploring both text prompts and audio priors in generating music with text-to-audio models Hiromu Yakura Masataka Goto 79 2 0 24 Jul 2023
Gradient-Based Word Substitution for Obstinate Adversarial Examples Generation in Language Models Yimu Wang Peng Shi Hongyang Zhang SILM 33 3 0 24 Jul 2023
PSentScore: Evaluating Sentiment Polarity in Dialogue Summarization Yongxin Zhou Fabien Ringeval Franccois Portet 89 1 0 23 Jul 2023
X-CapsNet For Fake News Detection Mohammad Hadi Goldani Reza Safabakhsh S. Momtazi GNN MedIm 66 1 0 23 Jul 2023
FATRER: Full-Attention Topic Regularizer for Accurate and Robust Conversational Emotion Recognition Yuzhao Mao Di Lu Xiaojie Wang Yang Zhang 69 2 0 23 Jul 2023
The Looming Threat of Fake and LLM-generated LinkedIn Profiles: Challenges and Opportunities for Detection and Prevention Navid Ayoobi Sadat Shahriar Arjun Mukherjee DeLMO 51 28 0 21 Jul 2023
Alleviating the Long-Tail Problem in Conversational Recommender Systems Zhipeng Zhao Kun Zhou Xiaolei Wang Wayne Xin Zhao Fan Pan Bo Zhao Ji-Rong Wen 66 13 0 21 Jul 2023
OxfordTVG-HIC: Can Machine Make Humorous Captions from Images? Runjia Li Shuyang Sun Mohamed Elhoseiny Philip Torr 85 11 0 21 Jul 2023
Is ChatGPT Involved in Texts? Measure the Polish Ratio to Detect ChatGPT-Generated Text Lingyi Yang Feng Jiang Haizhou Li DeLMO 92 26 0 21 Jul 2023
Embroid: Unsupervised Prediction Smoothing Can Improve Few-Shot Classification Neel Guha Mayee F. Chen Kush S. Bhatia Azalia Mirhoseini Frederic Sala Christopher Ré 78 4 0 20 Jul 2023
Meta-Transformer: A Unified Framework for Multimodal Learning Yiyuan Zhang Kaixiong Gong Kaipeng Zhang Hongsheng Li Yu Qiao Wanli Ouyang Xiangyu Yue 105 150 0 20 Jul 2023
Layer-wise Representation Fusion for Compositional Generalization Yafang Zheng Lei Lin Shantao Liu Binling Wang Zhaohong Lai Wenhao Rao Biao Fu Yidong Chen Xiaodon Shi AI4CE 111 2 0 20 Jul 2023
Vesper: A Compact and Effective Pretrained Model for Speech Emotion Recognition Weidong Chen Xiaofen Xing Peihao Chen Xiangmin Xu VLM 111 40 0 20 Jul 2023