RoBERTa: A Robustly Optimized BERT Pretraining Approach

26 July 2019

Luke Zettlemoyer

Papers citing "RoBERTa: A Robustly Optimized BERT Pretraining Approach"

50 / 10,878 papers shown

Title
Towards Parameter-Efficient Integration of Pre-Trained Language Models In Temporal Video Grounding Erica K. Shimomoto Edison Marrese-Taylor Hiroya Takamura Ichiro Kobayashi Hideki Nakayama Yusuke Miyao 88 7 0 26 Sep 2022
Smells like Teen Spirit: An Exploration of Sensorial Style in Literary Genres Osama Khalid P. Srinivasan 32 4 0 26 Sep 2022
Can We Automate the Analysis of Online Child Sexual Exploitation Discourse? Darren Cook Miri Zilka Heidi DeSandre S. Giles Adrian Weller S. Maskell 81 1 0 25 Sep 2022
Application of Deep Learning in Generating Structured Radiology Reports: A Transformer-Based Technique Seyed Ali Reza Moezzi Abdolrahman Ghaedi M. Rahmanian Seyedeh Zahra Mousavi A. Sami MedIm 40 9 0 25 Sep 2022
Can Transformer Models Effectively Detect Software Aspects in StackOverflow Discussion? Nibir Mandal Tashreef Muhammad G. M. Shahariar 99 1 0 24 Sep 2022
ET5: A Novel End-to-end Framework for Conversational Machine Reading Comprehension Xiao Zhang Heyan Huang Zewen Chi Xian-Ling Mao LRM 90 2 0 23 Sep 2022
Improving Conversational Recommender System via Contextual and Time-Aware Modeling with Less Domain-Specific Knowledge Lingzhi Wang Shafiq Joty Wei Gao Xingshan Zeng Kam-Fai Wong 74 10 0 23 Sep 2022
Towards Faithful Model Explanation in NLP: A Survey Qing Lyu Marianna Apidianaki Chris Callison-Burch XAI 254 121 0 22 Sep 2022
Scope of Pre-trained Language Models for Detecting Conflicting Health Information Josepho D. Gatto Madhusudan Basak S. Preum 56 7 0 22 Sep 2022
Efficient Few-Shot Learning Without Prompts Lewis Tunstall Nils Reimers Unso Eun Seo Jo Luke Bates Daniel Korat Moshe Wasserblat Oren Pereg VLM 95 197 0 22 Sep 2022
Selecting Better Samples from Pre-trained LLMs: A Case Study on Question Generation Xingdi Yuan Tong Wang Yen-Hsiang Wang Emery Fine Rania Abdelghani Pauline Lucas Hélene Sauzéon Pierre-Yves Oudeyer 103 30 0 22 Sep 2022
Evaluating Agent Interactions Through Episodic Knowledge Graphs Selene Báez Santamaría Piek Vossen T. Baier 90 2 0 22 Sep 2022
Adaptation of domain-specific transformer models with text oversampling for sentiment analysis of social media posts on Covid-19 vaccines Anmol Bansal Arjun Choudhry Anubhav Sharma Seba Susan MedIm 82 4 0 22 Sep 2022
An Information Minimization Based Contrastive Learning Model for Unsupervised Sentence Embeddings Learning Shaobin Chen Jie Zhou Yuling Sun Liang He SSL 78 7 0 22 Sep 2022
Implementing and Experimenting with Diffusion Models for Text-to-Image Generation Robin Zbinden 49 3 0 22 Sep 2022
AIR-JPMC@SMM4H'22: Classifying Self-Reported Intimate Partner Violence in Tweets with Multiple BERT-based Models Alec Candidato Akshat Gupta Xiaomo Liu Sameena Shah 33 2 0 22 Sep 2022
Mega: Moving Average Equipped Gated Attention Xuezhe Ma Chunting Zhou Xiang Kong Junxian He Liangke Gui Graham Neubig Jonathan May Luke Zettlemoyer 149 185 0 21 Sep 2022
Text Revealer: Private Text Reconstruction via Model Inversion Attacks against Transformers Ruisi Zhang Seira Hidano F. Koushanfar SILM 143 28 0 21 Sep 2022
Chatbots for Mental Health Support: Exploring the Impact of Emohaa on Reducing Mental Distress in China Sahand Sabour W. Zhang Xiyao Xiao Yuwei Zhang Yinhe Zheng Jiaxin Wen Jialu Zhao Minlie Huang AI4MH 89 51 0 21 Sep 2022
PePe: Personalized Post-editing Model utilizing User-generated Post-edits Jihyeon Janel Lee Taehee Kim Yunwon Tae Cheonbok Park Jaegul Choo 56 1 0 21 Sep 2022
Language-based Audio Retrieval Task in DCASE 2022 Challenge Huang Xie Samuel Lipping Tuomas Virtanen 115 18 0 20 Sep 2022
Dynamic Relevance Graph Network for Knowledge-Aware Question Answering Chen Zheng Parisa Kordjamshidi 55 6 0 20 Sep 2022
Twitter Topic Classification Dimosthenis Antypas Asahi Ushio Jose Camacho-Collados Leonardo Neves Vítor Silva Francesco Barbieri 110 33 0 20 Sep 2022
PromptCast: A New Prompt-based Learning Paradigm for Time Series Forecasting Hao Xue Flora D.Salim AI4TS 149 166 0 20 Sep 2022
EffEval: A Comprehensive Evaluation of Efficiency for MT Evaluation Metrics Daniil Larionov Jens Grunwald Christoph Leiter Steffen Eger 86 5 0 20 Sep 2022
A Few-shot Approach to Resume Information Extraction via Prompts Chengguang Gan Tatsunori Mori 43 10 0 20 Sep 2022
Revisiting Embeddings for Graph Neural Networks S. Purchase A. Zhao Robert D. Mullins 74 3 0 19 Sep 2022
Semantic-based Pre-training for Dialogue Understanding Xuefeng Bai Linfeng Song Yue Zhang 99 7 0 19 Sep 2022
Will It Blend? Mixing Training Paradigms & Prompting for Argument Quality Prediction Michiel van der Meer Myrthe Reuver Urja Khurana Lea Krause Selene Báez Santamaría 80 14 0 19 Sep 2022
Probing Spurious Correlations in Popular Event-Based Rumor Detection Benchmarks Jiaying Wu Bryan Hooi 111 6 0 19 Sep 2022
Joint Language Semantic and Structure Embedding for Knowledge Graph Completion Jianhao Shen Chenguang Wang Linyuan Gong Dawn Song 119 32 0 19 Sep 2022
A Benchmark for Understanding and Generating Dialogue between Characters in Stories Jianzhu Yao Ziqi Liu Jian Guan Minlie Huang 74 1 0 18 Sep 2022
Structured Knowledge Grounding for Question Answering Yujie Lu Siqi Ouyang Kairui Zhou LMTD KELM 68 0 0 17 Sep 2022
Detecting Generated Scientific Papers using an Ensemble of Transformer Models Anna Glazkova Maksim Glazkov MedIm 87 6 0 17 Sep 2022
Unsupervised Lexical Substitution with Decontextualised Embeddings Takashi Wada Timothy Baldwin Yuji Matsumoto Jey Han Lau 156 7 0 17 Sep 2022
Belief Revision based Caption Re-ranker with Visual Semantic Information Ahmed Sabir Francesc Moreno-Noguer Pranava Madhyastha Lluís Padró BDL 77 2 0 16 Sep 2022
Evons: A Dataset for Fake and Real News Virality Analysis and Prediction K. Krstovski A. Ryu B. Kogut GNN 67 5 0 16 Sep 2022
Skill Extraction from Job Postings using Weak Supervision Mike Zhang Kristian Nørgaard Jensen Rob van der Goot Barbara Plank 69 12 0 16 Sep 2022
Negation, Coordination, and Quantifiers in Contextualized Language Models A. Kalouli Rita Sevastjanova C. Beck Maribel Romero 96 12 0 16 Sep 2022
DBT-DMAE: An Effective Multivariate Time Series Pre-Train Model under Missing Data Kai Zhang Qinmin Yang Chong Li AI4TS 28 0 0 16 Sep 2022
Answering Numerical Reasoning Questions in Table-Text Hybrid Contents with Graph-based Encoder and Tree-based Decoder Fangyu Lei Shizhu He Xiang Li Jun Zhao Kang Liu AIMat LMTD 90 23 0 16 Sep 2022
Context-Aware Query Rewriting for Improving Users' Search Experience on E-commerce Websites Simiao Zuo Qingyu Yin Haoming Jiang Shaohui Xi Bing Yin Chao Zhang Tuo Zhao 88 6 0 15 Sep 2022
TwHIN-BERT: A Socially-Enriched Pre-trained Language Model for Multilingual Tweet Representations at Twitter Xinyang Zhang Yury Malkov Omar U. Florez Serim Park Brian McWilliams Jiawei Han Ahmed El-Kishky VLM 116 94 0 15 Sep 2022
Unsupervised Opinion Summarization Using Approximate Geodesics Somnath Basu Roy Chowdhury Nicholas Monath Kumar Avinava Dubey Amr Ahmed Snigdha Chaturvedi 94 7 0 15 Sep 2022
Public Wisdom Matters! Discourse-Aware Hyperbolic Fourier Co-Attention for Social-Text Classification Karish Grover S. Angara Md. Shad Akhtar Tanmoy Chakraborty 74 13 0 15 Sep 2022
Knowledge Is Flat: A Seq2Seq Generative Framework for Various Knowledge Graph Completion Chen Chen Yufei Wang Bing Li Kwok-Yan Lam 70 32 0 15 Sep 2022
TempoWiC: An Evaluation Benchmark for Detecting Meaning Shift in Social Media Daniel Loureiro Aminette D'Souza Areej Muhajab Isabella A. White Gabriel Wong Luis Espinosa Anke Leonardo Neves Francesco Barbieri Jose Camacho-Collados 77 26 0 15 Sep 2022
Revisiting the Practical Effectiveness of Constituency Parse Extraction from Pre-trained Language Models Taeuk Kim 138 1 0 15 Sep 2022
Align, Reason and Learn: Enhancing Medical Vision-and-Language Pre-training with Knowledge Zhihong Chen Guanbin Li Xiang Wan 178 73 0 15 Sep 2022
Multi-Modal Masked Autoencoders for Medical Vision-and-Language Pre-Training Zhihong Chen Yu Du Jinpeng Hu Yang Liu Guanbin Li Xiang Wan Tsung-Hui Chang 152 118 0 15 Sep 2022