RoBERTa: A Robustly Optimized BERT Pretraining Approach

26 July 2019

Luke Zettlemoyer

Papers citing "RoBERTa: A Robustly Optimized BERT Pretraining Approach"

50 / 10,839 papers shown

Title
Dark patterns in e-commerce: a dataset and its baseline evaluations Yukiharu Yada J. Feng Tsuneo Matsumoto Naotake Fukushima Fuyuko Kido Hayato Yamana 100 14 0 12 Nov 2022
Cross-Platform and Cross-Domain Abusive Language Detection with Supervised Contrastive Learning Md. Tawkat Islam Khondaker Muhammad Abdul-Mageed L. Lakshmanan 37 1 0 11 Nov 2022
The Architectural Bottleneck Principle Tiago Pimentel Josef Valvoda Niklas Stoehr Ryan Cotterell 54 5 0 11 Nov 2022
Improving Factual Consistency in Summarization with Compression-Based Post-Editing Alexander R. Fabbri Prafulla Kumar Choubey Jesse Vig Chien-Sheng Wu Caiming Xiong HILM KELM 125 18 0 11 Nov 2022
How Much Hate with #china? A Preliminary Analysis on China-related Hateful Tweets Two Years After the Covid Pandemic Began Jinghua Xu Zarah Weiß 75 1 0 11 Nov 2022
Towards automating Numerical Consistency Checks in Financial Reports L. Hillebrand Tobias Deuβer T. Khameneh Bernd Kliem Rüdiger Loitz Christian Bauckhage R. Sifa 62 4 0 11 Nov 2022
CCPrefix: Counterfactual Contrastive Prefix-Tuning for Many-Class Classification Yongbin Li Canran Xu Guodong Long Tao Shen Chongyang Tao Jing Jiang 86 1 0 11 Nov 2022
MEE: A Novel Multilingual Event Extraction Dataset Amir Pouran Ben Veyseh J. Ebrahimi Franck Dernoncourt Thien Huu Nguyen 100 27 0 11 Nov 2022
DiaASQ : A Benchmark of Conversational Aspect-based Sentiment Quadruple Analysis Bobo Li Hao Fei Fei Li Yu-hao Wu Jinsong Zhang ... Jingye Li Yijiang Liu Lizi Liao Tat-Seng Chua Donghong Ji 90 45 0 10 Nov 2022
BERT on a Data Diet: Finding Important Examples by Gradient-Based Pruning Mohsen Fayyaz Ehsan Aghazadeh Ali Modarressi Mohammad Taher Pilehvar Yadollah Yaghoobzadeh Samira Ebrahimi Kahou 64 18 0 10 Nov 2022
Zero-shot Visual Commonsense Immorality Prediction Yujin Jeong Seongbeom Park Suhong Moon Jinkyu Kim VLM 39 2 0 10 Nov 2022
Can Transformers Reason in Fragments of Natural Language? Viktor Schlegel Kamen V. Pavlov Ian Pratt-Hartmann LRM ReLM 90 7 0 10 Nov 2022
Biomedical Multi-hop Question Answering Using Knowledge Graph Embeddings and Language Models Dattaraj J. Rao Shraddha Mane M. Paliwal MedIm 16 2 0 10 Nov 2022
LERT: A Linguistically-motivated Pre-trained Language Model Yiming Cui Wanxiang Che Shijin Wang Ting Liu 91 25 0 10 Nov 2022
Combating Health Misinformation in Social Media: Characterization, Detection, Intervention, and Open Issues Canyu Chen Haoran Wang Matthew A. Shapiro Yunyu Xiao Fei Wang Kai Shu 90 12 0 10 Nov 2022
Collateral facilitation in humans and language models J. Michaelov Benjamin Bergen 118 11 0 09 Nov 2022
BLOOM: A 176B-Parameter Open-Access Multilingual Language Model BigScience Workshop : Teven Le Scao Angela Fan Christopher Akiki ... Zhongli Xie Zifan Ye M. Bras Younes Belkada Thomas Wolf VLM 510 2,401 0 09 Nov 2022
Detecting Languages Unintelligible to Multilingual Models through Local Structure Probes Louis Clouâtre Prasanna Parthasarathi Payel Das Sarath Chandar 84 3 0 09 Nov 2022
Visual Named Entity Linking: A New Dataset and A Baseline Wenxiang Sun Yixing Fan Jiafeng Guo Ruqing Zhang Xueqi Cheng 57 16 0 09 Nov 2022
Nested Named Entity Recognition from Medical Texts: An Adaptive Shared Network Architecture with Attentive CRF Jun Jiang Mingyue Cheng Qi Liu Zhi Li Enhong Chen 63 1 0 09 Nov 2022
Going for GOAL: A Resource for Grounded Football Commentaries Alessandro Suglia José Lopes E. Bastianelli Andrea Vanzo Shubham Agarwal Malvina Nikandrou Lu Yu Ioannis Konstas Verena Rieser 71 5 0 08 Nov 2022
Active Example Selection for In-Context Learning Yiming Zhang Shi Feng Chenhao Tan SILM LRM 114 207 0 08 Nov 2022
SLATE: A Sequence Labeling Approach for Task Extraction from Free-form Inked Content Apurva Gandhi Ryan Serrao Biyi Fang Gilbert Antonius Jenna Hong ... Sheng Yi Ehimwenma Nosakhare Irene Shaffer Soundararajan Srinivasan Vikrant Gupta VLM 56 0 0 08 Nov 2022
Word Order Matters when you Increase Masking Karim Lasri Alessandro Lenci Thierry Poibeau 98 7 0 08 Nov 2022
SocioProbe: What, When, and Where Language Models Learn about Sociodemographics Anne Lauscher Federico Bianchi Samuel R. Bowman Dirk Hovy 93 7 0 08 Nov 2022
Preserving Semantics in Textual Adversarial Attacks David Herel Hugo Cisneros Tomas Mikolov AAML 108 6 0 08 Nov 2022
COPEN: Probing Conceptual Knowledge in Pre-trained Language Models Hao Peng Xiaozhi Wang Shengding Hu Hailong Jin Lei Hou Juanzi Li Zhiyuan Liu Qun Liu 96 25 0 08 Nov 2022
ATCO2 corpus: A Large-Scale Dataset for Research on Automatic Speech Recognition and Natural Language Understanding of Air Traffic Control Communications Juan Pablo Zuluaga Karel Veselý Igor Szöke Alexander Blatt P. Motlícek ... Claudia Cevenini Pavel Kolcárek Allan Tart J. Černocký Dietrich Klakow 76 23 0 08 Nov 2022
Alleviating Sparsity of Open Knowledge Graphs with Ternary Contrastive Learning Qian Li Shafiq Joty Daling Wang Shi Feng Yifei Zhang 29 4 0 08 Nov 2022
Looking at the Overlooked: An Analysis on the Word-Overlap Bias in Natural Language Inference S. Rajaee Yadollah Yaghoobzadeh Mohammad Taher Pilehvar 75 5 0 07 Nov 2022
Reranking Overgenerated Responses for End-to-End Task-Oriented Dialogue Systems Songbo Hu Ivan Vulić Fangyu Liu Anna Korhonen 102 0 0 07 Nov 2022
Learning Semantic Textual Similarity via Topic-informed Discrete Latent Variables Erxin Yu Lan Du Yuan Jin Zhepei Wei Yi-Ju Chang BDL 49 7 0 07 Nov 2022
Using Deep Mixture-of-Experts to Detect Word Meaning Shift for TempoWiC Ze Chen Kangxu Wang Zijian Cai Jiewen Zheng Jiarong He Max Gao Jason Zhang MoE 67 3 0 07 Nov 2022
NAPG: Non-Autoregressive Program Generation for Hybrid Tabular-Textual Question Answering Tengxun Zhang Hongfei Xu Josef van Genabith Deyi Xiong Hongying Zan AIMat LRM 73 5 0 07 Nov 2022
Named Entity Recognition in Indian court judgments Prathamesh Kalamkar Astha Agarwal Aman Tiwari Smita Gupta S. Karn Vivek Raghavan AILaw 66 53 0 07 Nov 2022
Probing neural language models for understanding of words of estimative probability Damien Sileo Marie-Francine Moens 53 12 0 07 Nov 2022
Contrastive Learning with Prompt-derived Virtual Semantic Prototypes for Unsupervised Sentence Embedding Jiali Zeng Yongjing Yin Yu Jiang Shuangzhi Wu Yunbo Cao SSL 71 13 0 07 Nov 2022
Zero-Shot Classification by Logical Reasoning on Natural Language Explanations Chi Han Hengzhi Pei Xinya Du Heng Ji NAI 94 3 0 07 Nov 2022
On the Domain Adaptation and Generalization of Pretrained Language Models: A Survey Xu Guo Han Yu LM&MA VLM 145 30 0 06 Nov 2022
Suffix Retrieval-Augmented Language Modeling Zecheng Wang Yik-Cheung Tam RALM 49 1 0 06 Nov 2022
Tuning Language Models as Training Data Generators for Augmentation-Enhanced Few-Shot Learning Yu Meng Martin Michalski Jiaxin Huang Yu Zhang Tarek Abdelzaher Jiawei Han VLM 122 49 0 06 Nov 2022
Calibration Meets Explanation: A Simple and Effective Approach for Model Confidence Estimates Dongfang Li Baotian Hu Qingcai Chen 55 8 0 06 Nov 2022
Prompt-based Text Entailment for Low-Resource Named Entity Recognition Dongfang Li Baotian Hu Qingcai Chen 75 6 0 06 Nov 2022
Robust Lottery Tickets for Pre-trained Language Models Rui Zheng Rong Bao Yuhao Zhou Di Liang Sirui Wang Wei Wu Tao Gui Qi Zhang Xuanjing Huang AAML 87 14 0 06 Nov 2022
HERB: Measuring Hierarchical Regional Bias in Pre-trained Language Models Yizhi Li Ge Zhang Bohao Yang Chenghua Lin Shi Wang Anton Ragni Jie Fu 76 10 0 05 Nov 2022
KGLM: Integrating Knowledge Graph Structure in Language Models for Link Prediction Jason Youn I. Tagkopoulos KELM 74 23 0 04 Nov 2022
1Cademy @ Causal News Corpus 2022: Leveraging Self-Training in Causality Classification of Socio-Political Event Data A. Nik Ge Zhang Xingran Chen Mingyu Li Jie Fu 72 4 0 04 Nov 2022
Evaluating and Improving Factuality in Multimodal Abstractive Summarization David Wan Joey Tianyi Zhou 95 10 0 04 Nov 2022
A Transformer-Based Substitute Recommendation Model Incorporating Weakly Supervised Customer Behavior Data Wenting Ye Hongfei Yang Shuai Zhao Haoyang Fang Xingjian Shi Naveen Neppalli 62 3 0 04 Nov 2022
BERT-Deep CNN: State-of-the-Art for Sentiment Analysis of COVID-19 Tweets Javad Hassannataj Joloudari Sadiq Hussain M. Nematollahi Rouhollah Bagheri Fatemeh Fazl R. Alizadehsani Reza Lashgari Ashis Talukder 62 47 0 04 Nov 2022