ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 1907.11692
  4. Cited By
RoBERTa: A Robustly Optimized BERT Pretraining Approach

RoBERTa: A Robustly Optimized BERT Pretraining Approach

26 July 2019
Yinhan Liu
Myle Ott
Naman Goyal
Jingfei Du
Mandar Joshi
Danqi Chen
Omer Levy
M. Lewis
Luke Zettlemoyer
Veselin Stoyanov
    AIMat
ArXiv (abs)PDFHTML

Papers citing "RoBERTa: A Robustly Optimized BERT Pretraining Approach"

50 / 10,734 papers shown
Title
CARE-MI: Chinese Benchmark for Misinformation Evaluation in Maternity
  and Infant Care
CARE-MI: Chinese Benchmark for Misinformation Evaluation in Maternity and Infant Care
Tong Xiang
Liangzhi Li
Wangyue Li
Min‐Jun Bai
Lu Wei
Bowen Wang
Noa Garcia
79
5
0
04 Jul 2023
Modeling Tag Prediction based on Question Tagging Behavior Analysis of
  CommunityQA Platform Users
Modeling Tag Prediction based on Question Tagging Behavior Analysis of CommunityQA Platform Users
Kuntal Kumar Pal
Michael Gamon
N. Chandrasekaran
Silviu Cucerzan
50
0
0
04 Jul 2023
ALBERTI, a Multilingual Domain Specific Language Model for Poetry
  Analysis
ALBERTI, a Multilingual Domain Specific Language Model for Poetry Analysis
Javier de la Rosa
Álvaro Pérez Pozo
Salvador Ros
E. González-Blanco
108
7
0
03 Jul 2023
Shifting Attention to Relevance: Towards the Predictive Uncertainty
  Quantification of Free-Form Large Language Models
Shifting Attention to Relevance: Towards the Predictive Uncertainty Quantification of Free-Form Large Language Models
Jinhao Duan
Hao-Ran Cheng
Shiqi Wang
Alex Zavalny
Chenan Wang
Renjing Xu
B. Kailkhura
Kaidi Xu
129
51
0
03 Jul 2023
Multilingual Language Models are not Multicultural: A Case Study in
  Emotion
Multilingual Language Models are not Multicultural: A Case Study in Emotion
Shreya Havaldar
Sunny Rai
Bhumika Singhal
Langchen Liu
Langchen Liu Sharath Chandra Guntuku
Lyle Ungar
111
62
0
03 Jul 2023
Improving Language Plasticity via Pretraining with Active Forgetting
Improving Language Plasticity via Pretraining with Active Forgetting
Yihong Chen
Kelly Marchisio
Roberta Raileanu
David Ifeoluwa Adelani
Pontus Stenetorp
Sebastian Riedel
Mikel Artetx
KELMAI4CECLL
116
27
0
03 Jul 2023
RefSAM: Efficiently Adapting Segmenting Anything Model for Referring
  Video Object Segmentation
RefSAM: Efficiently Adapting Segmenting Anything Model for Referring Video Object Segmentation
Yonglin Li
Jing Zhang
Xiao Teng
Long Lan
VOSVLM
94
18
0
03 Jul 2023
REAL: A Representative Error-Driven Approach for Active Learning
REAL: A Representative Error-Driven Approach for Active Learning
Cheng Chen
Yong Wang
Lizi Liao
Yueguo Chen
Xiaoyong Du
116
2
0
03 Jul 2023
Challenges in Domain-Specific Abstractive Summarization and How to
  Overcome them
Challenges in Domain-Specific Abstractive Summarization and How to Overcome them
Anum Afzal
Juraj Vladika
Daniel Braun
Florian Matthes
HILM
66
11
0
03 Jul 2023
Review of Large Vision Models and Visual Prompt Engineering
Review of Large Vision Models and Visual Prompt Engineering
Jiaqi Wang
Zheng Liu
Lin Zhao
Zihao Wu
Chong Ma
...
Bao Ge
Yixuan Yuan
Dinggang Shen
Tianming Liu
Shu Zhang
VLMLRM
155
162
0
03 Jul 2023
A Critical Re-evaluation of Benchmark Datasets for (Deep) Learning-Based
  Matching Algorithms
A Critical Re-evaluation of Benchmark Datasets for (Deep) Learning-Based Matching Algorithms
G. Papadakis
Nishadi Kirielle
Peter Christen
Themis Palpanas
89
8
0
03 Jul 2023
Interpretability and Transparency-Driven Detection and Transformation of
  Textual Adversarial Examples (IT-DT)
Interpretability and Transparency-Driven Detection and Transformation of Textual Adversarial Examples (IT-DT)
Bushra Sabir
Muhammad Ali Babar
Sharif Abuadbba
SILM
74
10
0
03 Jul 2023
UniFine: A Unified and Fine-grained Approach for Zero-shot Vision-Language Understanding
UniFine: A Unified and Fine-grained Approach for Zero-shot Vision-Language Understanding
Rui Sun
Zhecan Wang
Haoxuan You
Noel Codella
Kai-Wei Chang
Shih-Fu Chang
CLIP
105
4
0
03 Jul 2023
Bidirectional Correlation-Driven Inter-Frame Interaction Transformer for
  Referring Video Object Segmentation
Bidirectional Correlation-Driven Inter-Frame Interaction Transformer for Referring Video Object Segmentation
Meng Lan
Fu Rong
Zuchao Li
Wei Yu
Lefei Zhang
VOS
117
7
0
02 Jul 2023
Make Text Unlearnable: Exploiting Effective Patterns to Protect Personal
  Data
Make Text Unlearnable: Exploiting Effective Patterns to Protect Personal Data
Xinzhe Li
Ming Liu
Shang Gao
MU
99
8
0
02 Jul 2023
A Dual-Stream Recurrence-Attention Network With Global-Local Awareness
  for Emotion Recognition in Textual Dialog
A Dual-Stream Recurrence-Attention Network With Global-Local Awareness for Emotion Recognition in Textual Dialog
Jiang Li
Xiaoping Wang
Zhigang Zeng
63
4
0
02 Jul 2023
Low-Resource Cross-Lingual Adaptive Training for Nigerian Pidgin
Low-Resource Cross-Lingual Adaptive Training for Nigerian Pidgin
Pin-Jie Lin
Muhammed Saeed
Ernie Chang
Merel C. J. Scholman
84
5
0
01 Jul 2023
BatGPT: A Bidirectional Autoregessive Talker from Generative Pre-trained
  Transformer
BatGPT: A Bidirectional Autoregessive Talker from Generative Pre-trained Transformer
Z. Li
Shitou Zhang
Hai Zhao
Yifei Yang
Dongjie Yang
LM&MA
116
17
0
01 Jul 2023
Single Sequence Prediction over Reasoning Graphs for Multi-hop QA
Single Sequence Prediction over Reasoning Graphs for Multi-hop QA
Gowtham Ramesh
Makesh Narsimhan Sreedhar
Junjie Hu
107
7
0
01 Jul 2023
The Integer Linear Programming Inference Cookbook
The Integer Linear Programming Inference Cookbook
Vivek Srikumar
Dan Roth
42
1
0
30 Jun 2023
SMILE: Evaluation and Domain Adaptation for Social Media Language
  Understanding
SMILE: Evaluation and Domain Adaptation for Social Media Language Understanding
Vasilisa Bashlovkina
Riley Matthews
Zhaobin Kuang
Simon Baumgartner
Michael Bendersky
66
5
0
30 Jun 2023
iMETRE: Incorporating Markers of Entity Types for Relation Extraction
iMETRE: Incorporating Markers of Entity Types for Relation Extraction
Harsha Vardhan
Manav Chaudhary
44
3
0
30 Jun 2023
Meta-training with Demonstration Retrieval for Efficient Few-shot
  Learning
Meta-training with Demonstration Retrieval for Efficient Few-shot Learning
Aaron Mueller
Kanika Narang
Lambert Mathias
Qifan Wang
Hamed Firooz
RALM
77
3
0
30 Jun 2023
Transformers in Healthcare: A Survey
Transformers in Healthcare: A Survey
Subhash Nerella
S. Bandyopadhyay
Jiaqing Zhang
Miguel Contreras
Scott Siegel
...
Jessica Sena
B. Shickel
A. Bihorac
Kia Khezeli
Parisa Rashidi
MedImAI4CE
96
36
0
30 Jun 2023
A Massive Scale Semantic Similarity Dataset of Historical English
A Massive Scale Semantic Similarity Dataset of Historical English
Emily Silcock
Melissa Dell
66
5
0
30 Jun 2023
Feature Representation Learning for NL2SQL Generation Based on Coupling
  and Decoupling
Feature Representation Learning for NL2SQL Generation Based on Coupling and Decoupling
Chen Hao
Xu Zhang
Chuanbao Gao
Deyu Zhou
22
1
0
30 Jun 2023
Knowledge Base Completion for Long-Tail Entities
Knowledge Base Completion for Long-Tail Entities
Lihu Chen
Simon Razniewski
Gerhard Weikum
KELM
71
6
0
30 Jun 2023
Provable Robust Watermarking for AI-Generated Text
Provable Robust Watermarking for AI-Generated Text
Xuandong Zhao
P. Ananth
Lei Li
Yu-Xiang Wang
WaLM
141
187
0
30 Jun 2023
LMBot: Distilling Graph Knowledge into Language Model for Graph-less
  Deployment in Twitter Bot Detection
LMBot: Distilling Graph Knowledge into Language Model for Graph-less Deployment in Twitter Bot Detection
Zijian Cai
Zhaoxuan Tan
Zhenyu Lei
Zifeng Zhu
Hongrui Wang
Qinghua Zheng
Minnan Luo
83
16
0
30 Jun 2023
Topological Data Analysis Guided Segment Anything Model Prompt
  Optimization for Zero-Shot Segmentation in Biological Imaging
Topological Data Analysis Guided Segment Anything Model Prompt Optimization for Zero-Shot Segmentation in Biological Imaging
Ruben Glatt
Shusen Liu
43
4
0
30 Jun 2023
SummQA at MEDIQA-Chat 2023:In-Context Learning with GPT-4 for Medical
  Summarization
SummQA at MEDIQA-Chat 2023:In-Context Learning with GPT-4 for Medical Summarization
Yash Mathur
Sanketh Rangreji
Raghav Kapoor
Medha Palavalli
Amanda Bertsch
Matthew R. Gormley
AI4MH
87
15
0
30 Jun 2023
HPC-Coder: Modeling Parallel Programs using Large Language Models
HPC-Coder: Modeling Parallel Programs using Large Language Models
Daniel Nichols
Aniruddha Marathe
Harshitha Menon
T. Gamblin
A. Bhatele
63
18
0
29 Jun 2023
Classifying Crime Types using Judgment Documents from Social Media
Haoxuan Xu
Zeyu He
Mengfan Shen
Songning Lai
Ziqiang Han
Yifan Peng
90
0
0
29 Jun 2023
Harnessing the Power of Hugging Face Transformers for Predicting Mental
  Health Disorders in Social Networks
Harnessing the Power of Hugging Face Transformers for Predicting Mental Health Disorders in Social Networks
Alireza Pourkeyvan
R. Safa
Ali Sorourkhah
AI4MH
141
24
0
29 Jun 2023
Evaluating Paraphrastic Robustness in Textual Entailment Models
Evaluating Paraphrastic Robustness in Textual Entailment Models
Dhruv Verma
Yash Kumar Lal
Shreyashee Sinha
Benjamin Van Durme
Adam Poliak
91
5
0
29 Jun 2023
Representation Learning via Variational Bayesian Networks
Representation Learning via Variational Bayesian Networks
Oren Barkan
Avi Caciularu
Idan Rejwan
Ori Katz
Jonathan Weill
Itzik Malkiel
Noam Koenigstein
BDL
93
15
0
28 Jun 2023
Taqyim: Evaluating Arabic NLP Tasks Using ChatGPT Models
Taqyim: Evaluating Arabic NLP Tasks Using ChatGPT Models
Zaid Alyafeai
Maged S. Alshaibani
Badr AlKhamissi
H. Luqman
Ebrahim Alareqi
A. Fadel
ELMLM&MAAI4MH
68
19
0
28 Jun 2023
CBBQ: A Chinese Bias Benchmark Dataset Curated with Human-AI
  Collaboration for Large Language Models
CBBQ: A Chinese Bias Benchmark Dataset Curated with Human-AI Collaboration for Large Language Models
Yufei Huang
Deyi Xiong
ALM
134
19
0
28 Jun 2023
MAT: Mixed-Strategy Game of Adversarial Training in Fine-tuning
MAT: Mixed-Strategy Game of Adversarial Training in Fine-tuning
Zhehua Zhong
Tianyi Chen
Zhen Wang
AAML
52
3
0
27 Jun 2023
ConKI: Contrastive Knowledge Injection for Multimodal Sentiment Analysis
ConKI: Contrastive Knowledge Injection for Multimodal Sentiment Analysis
Yu
Mingjun Zhao
Shiguang Qi
Feiran Sun
Baoxun Wang
Weidong Guo
Xiaoli Wang
Lei Yang
Di Niu
56
11
0
27 Jun 2023
Constructing Multilingual Code Search Dataset Using Neural Machine
  Translation
Constructing Multilingual Code Search Dataset Using Neural Machine Translation
Ryo Sekizawa
Nan Duan
Shuai Lu
Hitomi Yanaka
51
2
0
27 Jun 2023
MyCrunchGPT: A chatGPT assisted framework for scientific machine
  learning
MyCrunchGPT: A chatGPT assisted framework for scientific machine learning
Varun V. Kumar
Leonard Gleyzer
Adar Kahana
K. Shukla
George Karniadakis
AI4CE
86
14
0
27 Jun 2023
CamemBERT-bio: Leveraging Continual Pre-training for Cost-Effective
  Models on French Biomedical Data
CamemBERT-bio: Leveraging Continual Pre-training for Cost-Effective Models on French Biomedical Data
Rian Touchent
Laurent Romary
Eric Villemonte de la Clergerie
MedIm
48
5
0
27 Jun 2023
Exploiting Pseudo Future Contexts for Emotion Recognition in
  Conversations
Exploiting Pseudo Future Contexts for Emotion Recognition in Conversations
Yinyi Wei
Shuai Liu
Hailei Yan
Wei Ye
Tong Mo
Guanglu Wan
47
2
0
27 Jun 2023
Herb-Drug Interactions: A Holistic Decision Support System in Healthcare
Herb-Drug Interactions: A Holistic Decision Support System in Healthcare
Andreia S. Martins
Eva Maia
Isabel Praça
9
5
0
27 Jun 2023
Gender Bias in BERT -- Measuring and Analysing Biases through Sentiment
  Rating in a Realistic Downstream Classification Task
Gender Bias in BERT -- Measuring and Analysing Biases through Sentiment Rating in a Realistic Downstream Classification Task
Sophie F. Jentzsch
Cigdem Turan
74
34
0
27 Jun 2023
IDOL: Indicator-oriented Logic Pre-training for Logical Reasoning
IDOL: Indicator-oriented Logic Pre-training for Logical Reasoning
Zihang Xu
Ziqing Yang
Yiming Cui
Shijin Wang
LRMReLMMLLM
87
6
0
27 Jun 2023
C-PMI: Conditional Pointwise Mutual Information for Turn-level Dialogue
  Evaluation
C-PMI: Conditional Pointwise Mutual Information for Turn-level Dialogue Evaluation
Liliang Ren
Mankeerat Sidhu
Qi Zeng
R. Reddy
Heng Ji
Chengxiang Zhai
39
6
0
27 Jun 2023
Approximated Prompt Tuning for Vision-Language Pre-trained Models
Approximated Prompt Tuning for Vision-Language Pre-trained Models
Qiong Wu
Shubin Huang
Yiyi Zhou
Pingyang Dai
Annan Shu
Guannan Jiang
Rongrong Ji
VLMVPVLM
42
2
0
27 Jun 2023
Understanding In-Context Learning via Supportive Pretraining Data
Understanding In-Context Learning via Supportive Pretraining Data
Xiaochuang Han
Daniel Simig
Todor Mihaylov
Yulia Tsvetkov
Asli Celikyilmaz
Tianlu Wang
AIMat
113
38
0
26 Jun 2023
Previous
123...919293...213214215
Next