RoBERTa: A Robustly Optimized BERT Pretraining Approach

26 July 2019

Luke Zettlemoyer

Papers citing "RoBERTa: A Robustly Optimized BERT Pretraining Approach"

50 / 9,183 papers shown

Title
EXPLAIN, EDIT, GENERATE: Rationale-Sensitive Counterfactual Data Augmentation for Multi-hop Fact Verification Yingjie Zhu Jiasheng Si Yibo Zhao Haiyang Zhu Deyu Zhou Yulan He 46 6 0 23 Oct 2023
Attention-Enhancing Backdoor Attacks Against BERT-based Models Weimin Lyu Songzhu Zheng Lu Pang Haibin Ling Chao Chen 32 35 0 23 Oct 2023
GeoLM: Empowering Language Models for Geospatially Grounded Language Understanding Zekun Li Wenxuan Zhou Yao-Yi Chiang Muhao Chen SyDa 46 26 0 23 Oct 2023
REFER: An End-to-end Rationale Extraction Framework for Explanation Regularization Mohammad Reza Ghasemi Madani Pasquale Minervini 43 4 0 22 Oct 2023
Merging Generated and Retrieved Knowledge for Open-Domain QA Yunxiang Zhang Muhammad Khalifa Lajanugen Logeswaran Moontae Lee Honglak Lee Lu Wang RALM 40 38 0 22 Oct 2023
ITEm: Unsupervised Image-Text Embedding Learning for eCommerce Baohao Liao Michael Kozielski Sanjika Hewavitharana Jiangbo Yuan Shahram Khadivi Tomer Lancewicki SSL 23 0 0 22 Oct 2023
CLMSM: A Multi-Task Learning Framework for Pre-training on Procedural Text Abhilash Nandy M. Kapadnis Pawan Goyal Niloy Ganguly 31 1 0 22 Oct 2023
Conversational Speech Recognition by Learning Audio-textual Cross-modal Contextual Representation Kun Wei Bei Li Hang Lv Quan Lu Ning Jiang Lei Xie 61 3 0 22 Oct 2023
RSM-NLP at BLP-2023 Task 2: Bangla Sentiment Analysis using Weighted and Majority Voted Fine-Tuned Transformers Pratinav Seth Rashi Goel Komal Mathur Swetha Vemulapalli 25 1 0 22 Oct 2023
UniMAP: Universal SMILES-Graph Representation Learning Shikun Feng Lixin Yang Wei-Ying Ma Yanyan Lan OffRL 24 6 0 22 Oct 2023
LUNA: A Model-Based Universal Analysis Framework for Large Language Models Da Song Xuan Xie Jiayang Song Derui Zhu Yuheng Huang Felix Juefei Xu Lei Ma ALM 40 4 0 22 Oct 2023
PromptCBLUE: A Chinese Prompt Tuning Benchmark for the Medical Domain Wei-wei Zhu Xiaoling Wang Huanran Zheng Mosha Chen Buzhou Tang ELM LM&MA 31 33 0 22 Oct 2023
Finite-context Indexing of Restricted Output Space for NLP Models Facing Noisy Input Minh Nguyen Nancy F. Chen 35 0 0 21 Oct 2023
MeaeQ: Mount Model Extraction Attacks with Efficient Queries Chengwei Dai Minxuan Lv Kun Li Wei Zhou AAML 28 3 0 21 Oct 2023
Toward Stronger Textual Attack Detectors Pierre Colombo Marine Picot Nathan Noiry Guillaume Staerman Pablo Piantanida 78 5 0 21 Oct 2023
Transductive Learning for Textual Few-Shot Classification in API-based Embedding Models Pierre Colombo Victor Pellegrain Malik Boudiaf Victor Storchan Myriam Tami Ismail Ben Ayed C´eline Hudelot Pablo Piantanida 43 8 0 21 Oct 2023
Emulating the Human Mind: A Neural-symbolic Link Prediction Model with Fast and Slow Reasoning and Filtered Rules Mohammad Hossein Khojasteh Najmeh Torabian Ali Farjami Saeid Hosseini B. Minaei-Bidgoli LRM 37 0 0 21 Oct 2023
Implications of Annotation Artifacts in Edge Probing Test Datasets Sagnik Ray Choudhury Jushaan Kalra 23 0 0 20 Oct 2023
Foundation Model's Embedded Representations May Detect Distribution Shift Max Vargas Adam Tsou A. Engel Tony Chiang 41 1 0 20 Oct 2023
Plausibility Processing in Transformer Language Models: Focusing on the Role of Attention Heads in GPT Soo Hyun Ryu 19 0 0 20 Oct 2023
LanPose: Language-Instructed 6D Object Pose Estimation for Robotic Assembly Bowen Fu Sek Kun Leong Yan Di Jiwen Tang Xiangyang Ji 55 5 0 20 Oct 2023
How Much Consistency Is Your Accuracy Worth? Jacob K. Johnson Ana Marasović 29 0 0 20 Oct 2023
Copyright Violations and Large Language Models Antonia Karamolegkou Jiaang Li Li Zhou Anders Sogaard 25 57 0 20 Oct 2023
Retrieval-Augmented Neural Response Generation Using Logical Reasoning and Relevance Scoring Nicholas Walker Stefan Ultes Pierre Lison RALM LRM 51 2 0 20 Oct 2023
The Perils & Promises of Fact-checking with Large Language Models Dorian Quelle Alexandre Bovet 44 20 0 20 Oct 2023
Explaining Interactions Between Text Spans Sagnik Ray Choudhury Pepa Atanasova Isabelle Augenstein 36 1 0 20 Oct 2023
DistillCSE: Distilled Contrastive Learning for Sentence Embeddings Jiahao Xu Wei Shao Lihui Chen Lemao Liu FedML 42 4 0 20 Oct 2023
Mind the instructions: a holistic evaluation of consistency and interactions in prompt-based learning Lucas Weber Elia Bruni Dieuwke Hupkes 48 26 0 20 Oct 2023
An LLM can Fool Itself: A Prompt-Based Adversarial Attack Xilie Xu Keyi Kong Ning Liu Li-zhen Cui Di Wang Jingfeng Zhang Mohan Kankanhalli AAML SILM 45 72 0 20 Oct 2023
Large-Scale and Multi-Perspective Opinion Summarization with Diverse Review Subsets Han Jiang Rui Wang Zhihua Wei Yu Li Xinpeng Wang 42 4 0 20 Oct 2023
Decoding the Silent Majority: Inducing Belief Augmented Social Graph with Large Language Model for Response Forecasting Chenkai Sun Jinning Li Yi R. Fung Hou Pong Chan Tarek Abdelzaher Chengxiang Zhai Heng Ji 36 16 0 20 Oct 2023
On the Language Encoder of Contrastive Cross-modal Models Mengjie Zhao Junya Ono Zhi-Wei Zhong Chieh-Hsin Lai Yuhta Takida Naoki Murata Wei-Hsiang Liao Takashi Shibuya Hiromi Wakaki Yuki Mitsufuji VLM 31 0 0 20 Oct 2023
A Quality-based Syntactic Template Retriever for Syntactically-controlled Paraphrase Generation Xue Zhang Songming Zhang Yunlong Liang Jinan Xu Jian Liu Wenjuan Han Jinan Xu 54 1 0 20 Oct 2023
Visual Grounding Helps Learn Word Meanings in Low-Data Regimes Chengxu Zhuang Evelina Fedorenko Jacob Andreas 29 11 0 20 Oct 2023
Multi-level Contrastive Learning for Script-based Character Understanding Dawei Li Hengyuan Zhang Yanran Li Shiping Yang 75 17 0 20 Oct 2023
The Less the Merrier? Investigating Language Representation in Multilingual Models H. Nigatu A. Tonja Jugal Kalita 49 0 0 20 Oct 2023
Exploring the Impact of Corpus Diversity on Financial Pretrained Language Models Jaeyoung Choe Keonwoong Noh Nayeon Kim Seyun Ahn Woohwan Jung 39 4 0 20 Oct 2023
NameGuess: Column Name Expansion for Tabular Data Jiani Zhang Zhengyuan Shen Balasubramaniam Srinivasan Shen Wang Huzefa Rangwala George Karypis 27 4 0 19 Oct 2023
CLIFT: Analysing Natural Distribution Shift on Question Answering Models in Clinical Domain Ankit Pal 29 2 0 19 Oct 2023
Unsupervised Candidate Answer Extraction through Differentiable Masker-Reconstructor Model Zhuoer Wang Yicheng Wang Ziwei Zhu James Caverlee 35 0 0 19 Oct 2023
Do Language Models Learn about Legal Entity Types during Pretraining? Claire Barale Michael Rovatsos Nehal Bhuta ELM 38 2 0 19 Oct 2023
From Multilingual Complexity to Emotional Clarity: Leveraging Commonsense to Unveil Emotions in Code-Mixed Dialogues Shivani Kumar S. Ramaneswaran Md. Shad Akhtar Tanmoy Chakraborty 41 23 0 19 Oct 2023
Frozen Transformers in Language Models Are Effective Visual Encoder Layers Ziqi Pang Ziyang Xie Yunze Man Yu-Xiong Wang 83 26 0 19 Oct 2023
Eureka-Moments in Transformers: Multi-Step Tasks Reveal Softmax Induced Optimization Problems David T. Hoffmann Simon Schrodi Jelena Bratulić Nadine Behrmann Volker Fischer Thomas Brox 50 5 0 19 Oct 2023
A Predictive Factor Analysis of Social Biases and Task-Performance in Pretrained Masked Language Models Yi Zhou Jose Camacho-Collados Danushka Bollegala 104 6 0 19 Oct 2023
StoryAnalogy: Deriving Story-level Analogies from Large Language Models to Unlock Analogical Understanding Cheng Jiayang Lin Qiu Tszho Chan Tianqing Fang Weiqi Wang ... Qipeng Guo Hongming Zhang Yangqiu Song Yue Zhang Zheng Zhang 59 30 0 19 Oct 2023
Knowledge-Augmented Language Model Verification Jinheon Baek Soyeong Jeong Minki Kang Jong C. Park Sung Ju Hwang RALM 45 13 0 19 Oct 2023
Model Merging by Uncertainty-Based Gradient Matching Nico Daheim Thomas Möllenhoff Edoardo Ponti Iryna Gurevych Mohammad Emtiyaz Khan MoMe FedML 41 45 0 19 Oct 2023
Label-Aware Automatic Verbalizer for Few-Shot Text Classification Thanakorn Thaminkaew Piyawat Lertvittayakumjorn P. Vateekul VLM 24 1 0 19 Oct 2023
Character-level Chinese Backpack Language Models Hao Sun John Hewitt 32 0 0 19 Oct 2023