RoBERTa: A Robustly Optimized BERT Pretraining Approach

26 July 2019

Luke Zettlemoyer

Papers citing "RoBERTa: A Robustly Optimized BERT Pretraining Approach"

50 / 10,801 papers shown

Title
Helping the Helper: Supporting Peer Counselors via AI-Empowered Practice and Feedback Shang-ling Hsu Raj Sanjay Shah Prathik Senthil Zahra Ashktorab Casey Dugan Werner Geyer Diyi Yang 119 24 0 15 May 2023
FactKB: Generalizable Factuality Evaluation using Language Models Enhanced with Factual Knowledge Shangbin Feng Vidhisha Balachandran Yuyang Bai Yulia Tsvetkov KELM HILM 79 59 0 14 May 2023
Learning to Generalize for Cross-domain QA Yingjie Niu Linyi Yang Ruihai Dong Yue Zhang 92 6 0 14 May 2023
Learning to Simulate Natural Language Feedback for Interactive Semantic Parsing Hao Yan Saurabh Srivastava Yintao Tai Sida I. Wang Wen-tau Yih Ziyu Yao 73 19 0 14 May 2023
STORYWARS: A Dataset and Instruction Tuning Baselines for Collaborative Story Understanding and Generation Yulun Du Lydia B. Chilton 88 8 0 14 May 2023
Distinguish Before Answer: Generating Contrastive Explanation as Knowledge for Commonsense Question Answering Qianglong Chen Guohai Xu Mingshi Yan Ji Zhang Fei Huang Luo Si Yin Zhang 104 10 0 14 May 2023
Watermarking Text Generated by Black-Box Language Models Xi Yang Kejiang Chen Weiming Zhang Chang-rui Liu Yuang Qi Jie Zhang Han Fang Neng H. Yu WaLM 156 62 0 14 May 2023
Make Prompt-based Black-Box Tuning Colorful: Boosting Model Generalization from Three Orthogonal Perspectives Qiushi Sun Chengcheng Han Nuo Chen Renyu Zhu Jing Gong Xiang Li Ming Gao VLM 47 9 0 14 May 2023
SCENE: Self-Labeled Counterfactuals for Extrapolating to Negative Examples Deqing Fu Ameya Godbole Robin Jia 81 8 0 13 May 2023
Trillion Dollar Words: A New Financial Dataset, Task & Market Analysis Agam Shah Suvan Paturi Sudheer Chava AIFin 54 51 0 13 May 2023
GPT-Sentinel: Distinguishing Human and ChatGPT Generated Content Yutian Chen Hao Kang Vivian Zhai Liang Li Rita Singh B. Ramakrishnan DeLMO 85 58 0 13 May 2023
CodeT5+: Open Code Large Language Models for Code Understanding and Generation Yue Wang Hung Le Akhilesh Deepak Gotmare Nghi D. Q. Bui Junnan Li Steven C. H. Hoi ALM 140 503 0 13 May 2023
A Simple and Plug-and-play Method for Unsupervised Sentence Representation Enhancement Lingfeng Shen Haiyun Jiang Lemao Liu Shuming Shi 35 1 0 13 May 2023
ACCENT: An Automatic Event Commonsense Evaluation Metric for Open-Domain Dialogue Systems Sarik Ghazarian Yijia Shao Rujun Han Aram Galstyan Nanyun Peng 84 7 0 12 May 2023
Constructing Holistic Measures for Social Biases in Masked Language Models Yang Liu Yuexian Hou 27 0 0 12 May 2023
HPE:Answering Complex Questions over Text by Hybrid Question Parsing and Execution Ye Liu Semih Yavuz Rui Meng Dragomir R. Radev Caiming Xiong Yingbo Zhou 93 10 0 12 May 2023
LeXFiles and LegalLAMA: Facilitating English Multinational Legal Language Model Development Ilias Chalkidis Nicolas Garneau Catalina Goanta Daniel Martin Katz Anders Søgaard AILaw ELM 70 64 0 12 May 2023
A Comprehensive Analysis of Adapter Efficiency Nandini Mundra Sumanth Doddapaneni Raj Dabre Anoop Kunchukuttan Ratish Puduppully Mitesh M. Khapra 60 11 0 12 May 2023
Comprehensive Solution Program Centric Pretraining for Table-and-Text Hybrid Numerical Reasoning Qianying Liu Dongsheng Yang Wenjie Zhong Fei Cheng Sadao Kurohashi AIMat 84 0 0 12 May 2023
Perturbation-based QE: An Explainable, Unsupervised Word-level Quality Estimation Method for Blackbox Machine Translation Tu Anh Dinh Jan Niehues 61 7 0 12 May 2023
Instance Smoothed Contrastive Learning for Unsupervised Sentence Embedding Hongliang He Junlei Zhang Zhenzhong Lan Yue Zhang 77 5 0 12 May 2023
Synergistic Interplay between Search and Large Language Models for Information Retrieval Jiazhan Feng Chongyang Tao Xiubo Geng Tao Shen Can Xu Guodong Long Dongyan Zhao Daxin Jiang KELM 129 6 0 12 May 2023
Is ChatGPT a Good Causal Reasoner? A Comprehensive Evaluation Jin-Fang Gao Xiao Ding Bing Qin Ting Liu ELM LRM AI4MH 100 73 0 12 May 2023
Towards Versatile and Efficient Visual Knowledge Integration into Pre-trained Language Models with Cross-Modal Adapters Xinyun Zhang Haochen Tan Han Wu Bei Yu KELM 38 1 0 12 May 2023
ZARA: Improving Few-Shot Self-Rationalization for Small Language Models Wei-Lin Chen An-Zi Yen Cheng-Kuang Wu Hen-Hsen Huang Hsin-Hsi Chen ReLM LRM 52 11 0 12 May 2023
Multi-Relational Hyperbolic Word Embeddings from Natural Language Definitions Marco Valentino Danilo S. Carvalho André Freitas 77 3 0 12 May 2023
When Giant Language Brains Just Aren't Enough! Domain Pizzazz with Knowledge Sparkle Dust Minh Le Nguyen Duy-Hung Nguyen Shahab Sabahi Hung Le Jeffrey Yang Hajime Hotta 92 1 0 12 May 2023
Asymmetric feature interaction for interpreting model predictions Xiaolei Lu Jianghong Ma Haode Zhang FAtt 77 4 0 12 May 2023
Overinformative Question Answering by Humans and Machines Polina Tsvilodub Michael Franke Robert D. Hawkins Noah D. Goodman 42 3 0 11 May 2023
A General-Purpose Multilingual Document Encoder Onur Galoglu Robert Litschko Goran Glavaš 87 2 0 11 May 2023
IUST_NLP at SemEval-2023 Task 10: Explainable Detecting Sexism with Transformers and Task-adaptive Pretraining Hadi Mahmoudi 44 0 0 11 May 2023
Think Twice: Measuring the Efficiency of Eliminating Prediction Shortcuts of Question Answering Models Lukávs Mikula Michal vStefánik Marek Petrovivc Petr Sojka 70 4 0 11 May 2023
THUIR@COLIEE 2023: More Parameters and Legal Knowledge for Legal Case Entailment Haitao Li Chang Wang Weihang Su Yueyue Wu Qingyao Ai Yu-an Liu AILaw ELM 58 17 0 11 May 2023
THUIR@COLIEE 2023: Incorporating Structural Knowledge into Pre-trained Language Models for Legal Case Retrieval Haitao Li Weihang Su Chang Wang Yueyue Wu Qingyao Ai Yu-an Liu ELM AILaw 76 31 0 11 May 2023
COCKATIEL: COntinuous Concept ranKed ATtribution with Interpretable ELements for explaining neural net classifiers on NLP tasks Fanny Jourdan Agustin Picard Thomas Fel Laurent Risser Jean-Michel Loubes Nicholas M. Asher 57 8 0 11 May 2023
When the Majority is Wrong: Modeling Annotator Disagreement for Subjective Tasks Eve Fleisig Rediet Abebe Dan Klein 143 49 0 11 May 2023
FactKG: Fact Verification via Reasoning on Knowledge Graphs Jiho Kim Sungjin Park Yeonsu Kwon Yohan Jo James Thorne E. Choi 72 63 0 11 May 2023
GeoGLUE: A GeoGraphic Language Understanding Evaluation Benchmark Dongyang Li Ruixue Ding Qiang-Wei Zhang Zheng Li Boli Chen ... Yao Xu Xin Li Ning Guo Fei Huang Xiaofeng He ELM VLM 65 6 0 11 May 2023
How Good are Commercial Large Language Models on African Languages? Jessica Ojo Kelechi Ogueji 83 5 0 11 May 2023
Randomized Smoothing with Masked Inference for Adversarially Robust Text Classifications Han Cheol Moon Shafiq Joty Ruochen Zhao Megh Thakkar Xu Chi AAML 68 15 0 11 May 2023
ChatGPT-Like Large-Scale Foundation Models for Prognostics and Health Management: A Survey and Roadmaps Yanfang Li Huan Wang Muxia Sun LM&MA AI4TS AI4CE 103 59 0 10 May 2023
Dynamic Graph Representation Learning for Depression Screening with Transformer Ai-Te Kuo Haiquan Chen Yu-Hsuan Kuo Wei-Shinn Ku 31 3 0 10 May 2023
BIOT: Cross-data Biosignal Learning in the Wild Chaoqi Yang M. P. M. Brandon Westover Jimeng Sun 62 10 0 10 May 2023
Bot or Human? Detecting ChatGPT Imposters with A Single Question Hong Wang Xuan Luo Weizhi Wang Xifeng Yan DeLMO 67 27 0 10 May 2023
Combo of Thinking and Observing for Outside-Knowledge VQA Q. Si Yuchen Mo Zheng Lin Huishan Ji Weiping Wang 95 14 0 10 May 2023
LACoS-BLOOM: Low-rank Adaptation with Contrastive objective on 8 bits Siamese-BLOOM Wenhui Hua Brian Williams Davood Shamsi 51 3 0 10 May 2023
Automatic Evaluation of Attribution by Large Language Models Xiang Yue Boshi Wang Ziru Chen Kai Zhang Yu-Chuan Su Huan Sun ALM LRM HILM 91 58 0 10 May 2023
Talking with Machines: A Comprehensive Survey of Emergent Dialogue Systems William Tholke 59 0 0 10 May 2023
SPSQL: Step-by-step Parsing Based Framework for Text-to-SQL Generation Ran Shen Gang Sun Hao Shen Yiling Li Liangfeng Jin Han Jiang 55 5 0 10 May 2023
ANALOGYKB: Unlocking Analogical Reasoning of Language Models with A Million-scale Knowledge Base Siyu Yuan Jiangjie Chen Changzhi Sun Jiaqing Liang Yanghua Xiao Deqing Yang 90 16 0 10 May 2023