RoBERTa: A Robustly Optimized BERT Pretraining Approach

26 July 2019

Luke Zettlemoyer

Papers citing "RoBERTa: A Robustly Optimized BERT Pretraining Approach"

50 / 10,801 papers shown

Title
"When Words Fail, Emojis Prevail": Generating Sarcastic Utterances with Emoji Using Valence Reversal and Semantic Incongruity Faria Binte Kader Nafisa Hossain Nujat Tasmia Binte Sogir Mohsinul Kabir H. Mahmud Md. Kamrul Hasan 77 1 0 06 May 2023
Analysis of Climate Campaigns on Social Media using Bayesian Model Averaging Tunazzina Islam Ruqi Zhang Dan Goldwasser 76 4 0 06 May 2023
Plan-and-Solve Prompting: Improving Zero-Shot Chain-of-Thought Reasoning by Large Language Models Lei Wang Wanyu Xu Yihuai Lan Zhiqiang Hu Yunshi Lan Roy Ka-wei Lee Ee-Peng Lim ReLM LRM 134 358 0 06 May 2023
SANTA: Separate Strategies for Inaccurate and Incomplete Annotation Noise in Distantly-Supervised Named Entity Recognition Shuzheng Si Zefan Cai Shuang Zeng Guoqiang Feng Jiaxing Lin Baobao Chang 82 5 0 06 May 2023
Pre-training Language Model as a Multi-perspective Course Learner Beiduo Chen Shaohan Huang Zi-qiang Zhang Wu Guo Zhen-Hua Ling Haizhen Huang Furu Wei Weiwei Deng Qi Zhang 61 0 0 06 May 2023
Residual Prompt Tuning: Improving Prompt Tuning with Residual Reparameterization Anastasia Razdaibiedina Yuning Mao Rui Hou Madian Khabsa M. Lewis Jimmy Ba Amjad Almahairi VLM 81 51 0 06 May 2023
Active Continual Learning: On Balancing Knowledge Retention and Learnability Thuy-Trang Vu Shahram Khadivi Mahsa Ghorbanali Dinh Q. Phung Gholamreza Haffari CLL 24 3 0 06 May 2023
NorBench -- A Benchmark for Norwegian Language Models David Samuel Andrey Kutuzov Samia Touileb Erik Velldal Lilja Ovrelid Egil Rønningstad Elina Sigdel Anna Palatkina 93 25 0 06 May 2023
Spatiotemporal Transformer for Stock Movement Prediction Daniel Boyle Jugal Kalita AI4TS 42 2 0 05 May 2023
Towards Zero-Shot Frame Semantic Parsing with Task Agnostic Ontologies and Simple Labels D. Ribeiro Omid Abdar Jack Goetz Mike Ross Annie Dong Ken Forbus A. Mohamed 69 2 0 05 May 2023
Vera: A General-Purpose Plausibility Estimation Model for Commonsense Statements Jiacheng Liu Wenya Wang Dianzhuo Wang Noah A. Smith Yejin Choi Hannaneh Hajishirzi VLM 113 52 0 05 May 2023
NLI4CT: Multi-Evidence Natural Language Inference for Clinical Trial Reports Mael Jullien Marco Valentino H. Frost Paul O'Regan Dónal Landers André Freitas 63 30 0 05 May 2023
Multi-View Graph Representation Learning for Answering Hybrid Numerical Reasoning Question Yifan Wei Fangyu Lei Yuanzhe Zhang Jun Zhao Kang Liu AIMat 84 10 0 05 May 2023
LMs stand their Ground: Investigating the Effect of Embodiment in Figurative Language Interpretation by Language Models Philipp Wicke 53 4 0 05 May 2023
Using ChatGPT for Entity Matching Ralph Peeters Christian Bizer AI4MH 107 29 0 05 May 2023
QCRI at SemEval-2023 Task 3: News Genre, Framing and Persuasion Techniques Detection using Multilingual Models Maram Hasanain Ahmed Oumar El-Shangiti R. N. Nandi Preslav Nakov Firoj Alam 71 9 0 05 May 2023
Improved Logical Reasoning of Language Models via Differentiable Symbolic Programming Hanlin Zhang Jiani Huang Ziyang Li Mayur Naik Eric P. Xing ReLM LRM 84 28 0 05 May 2023
Block the Label and Noise: An N-Gram Masked Speller for Chinese Spell Checking Haiyun Yang 118 1 0 05 May 2023
Low-Resource Multi-Granularity Academic Function Recognition Based on Multiple Prompt Knowledge Jiawei Liu Ziteng Xiong Yi-ping Jiang Yongqiang Ma Wei Lu Yong Huang Qikai Cheng 51 1 0 05 May 2023
Stylized Data-to-Text Generation: A Case Study in the E-Commerce Domain Liqiang Jing Xuemeng Song Xuming Lin Zhongzhou Zhao Wei Zhou Liqiang Nie 91 17 0 05 May 2023
A Survey on Out-of-Distribution Detection in NLP Hao Lang Yinhe Zheng Yixuan Li Jian Sun Feiling Huang Yongbin Li 91 25 0 05 May 2023
Chain-of-Skills: A Configurable Model for Open-domain Question Answering Kaixin Ma Hao Cheng Yu Zhang Xiaodong Liu Eric Nyberg Jianfeng Gao LRM 81 16 0 04 May 2023
Modeling What-to-ask and How-to-ask for Answer-unaware Conversational Question Generation Do Xuan Long Bowei Zou Shafiq Joty Anh Tai Tran Liangming Pan Nancy F. Chen Ai Ti Aw 72 8 0 04 May 2023
Sentence Embedding Leaks More Information than You Expect: Generative Embedding Inversion Attack to Recover the Whole Sentence Haoran Li Mingshi Xu Yangqiu Song 151 52 0 04 May 2023
NatCS: Eliciting Natural Customer Support Dialogues James Gung Emily Moeng Wesley Rose Arshit Gupta Yi Zhang Saab Mansour 64 3 0 04 May 2023
Masked Trajectory Models for Prediction, Representation, and Control Philipp Wu Arjun Majumdar Kevin Stone Yixin Lin Igor Mordatch Pieter Abbeel Aravind Rajeswaran OffRL 67 39 0 04 May 2023
ReMask: A Robust Information-Masking Approach for Domain Counterfactual Generation Pengfei Hong Rishabh Bhardwaj Navonil Majumdar Somak Aditya Soujanya Poria AAML 58 0 0 04 May 2023
The Application of Affective Measures in Text-based Emotion Aware Recommender Systems John Kalung Leung Igor Griva W. Kennedy J. Kinser Sohyun Park Seoyoon Lee 115 2 0 04 May 2023
BranchNorm: Robustly Scaling Extremely Deep Transformers Yanjun Liu Xianfeng Zeng Fandong Meng Jie Zhou 77 3 0 04 May 2023
VendorLink: An NLP approach for Identifying & Linking Vendor Migrants & Potential Aliases on Darknet Markets V. Saxena Nils Rethmeier Gijs Van Dijck Gerasimos Spanakis 40 6 0 04 May 2023
How to Enhance Causal Discrimination of Utterances: A Case on Affective Reasoning Hang Chen Jing Luo Xinyu Yang Wenjing Zhu CML 85 4 0 04 May 2023
RetroMAE-2: Duplex Masked Auto-Encoder For Pre-Training Retrieval-Oriented Language Models Shitao Xiao Zheng Liu Yingxia Shao Weidong (Tom) Cai RALM 100 23 0 04 May 2023
Cognitive Reframing of Negative Thoughts through Human-Language Model Interaction Ashish Sharma Kevin Rushton Inna Wanyin Lin David Wadden Khendra G. Lucas Adam S. Miner Theresa Nguyen Tim Althoff 147 76 0 04 May 2023
Curating corpora with classifiers: A case study of clean energy sentiment online M. V. Arnold P. Dodds C. Danforth 112 0 0 04 May 2023
Transfer and Active Learning for Dissonance Detection: Addressing the Rare-Class Challenge Vasudha Varadarajan Swanie Juhng Syeda Mahwish Xiaoran Liu Jonah Luby C. Luhmann H. Andrew Schwartz 86 3 0 03 May 2023
Lift Yourself Up: Retrieval-augmented Text Generation with Self Memory Xin Cheng Di Luo Preslav Nakov Lemao Liu Dongyan Zhao Rui Yan RALM 223 104 0 03 May 2023
PTP: Boosting Stability and Performance of Prompt Tuning with Perturbation-Based Regularizer Lichang Chen Heng-Chiao Huang Varun Madhavan AAML 176 12 0 03 May 2023
Plan, Eliminate, and Track -- Language Models are Good Teachers for Embodied Agents Yu-Chih Chen So Yeon Min Chase Davis Ruslan Salakhutdinov A. Azaria Yuan-Fang Li Tom Michael Mitchell A. Bovik LM&Ro LLMAG 157 34 0 03 May 2023
ChatGraph: Interpretable Text Classification by Converting ChatGPT Knowledge to Graphs Yucheng Shi Hehuan Ma Wenliang Zhong Qiaoyu Tan Gengchen Mai Xiang Li Tianming Liu Junzhou Huang AI4MH 73 35 0 03 May 2023
The Benefits of Label-Description Training for Zero-Shot Text Classification Lingyu Gao Debanjan Ghosh Kevin Gimpel VLM 198 11 0 03 May 2023
Natural language processing on customer note data Andrew Hilditch David Webb Jozef Baca Tom Armitage Matthew Shardlow Peter Appleby 83 0 0 03 May 2023
Improving Contrastive Learning of Sentence Embeddings from AI Feedback M. Abouheaf W. Gueaieb Md. Suruz Miah D. Spinello Xipeng Qiu 113 39 0 03 May 2023
Few-shot Event Detection: An Empirical Study and a Unified View Yubo Ma Zehao Wang Yixin Cao Aixin Sun 103 11 0 03 May 2023
Causality-aware Concept Extraction based on Knowledge-guided Prompting Siyu Yuan Deqing Yang Jinxi Liu Shuyu Tian Jiaqing Liang Yanghua Xiao R. Xie 128 15 0 03 May 2023
KEPLET: Knowledge-Enhanced Pretrained Language Model with Topic Entity Awareness Yichuan Li Jialong Han Kyumin Lee Chengyuan Ma Soumik Sarkar Derek Liu VLM KELM 70 0 0 02 May 2023
A Data-Driven Approach for Finding Requirements Relevant Feedback from TikTok and YouTube Manish Sihag Ze Shi Li Amanda Dash Nowshin Nawar Arony Kezia Devathasan Neil A. Ernst A. Albu D. Damian 45 7 0 02 May 2023
Stance Detection: A Practical Guide to Classifying Political Beliefs in Text Michael Burnham 84 16 0 02 May 2023
Don't Stop Pretraining? Make Prompt-based Fine-tuning Powerful Learner Zhengxiang Shi Aldo Lipani VLM CLL 80 22 0 02 May 2023
Distill or Annotate? Cost-Efficient Fine-Tuning of Compact Models Junmo Kang Wei Xu Alan Ritter 128 15 0 02 May 2023
Privacy-Preserving In-Context Learning for Large Language Models Tong Wu Ashwinee Panda Jiachen T. Wang Prateek Mittal 114 32 0 02 May 2023