The Skipped Beat: A Study of Sociopragmatic Understanding in LLMs for 64 Languages

23 October 2023

Chiyu Zhang

Khai Duy Doan

Qisheng Liao

Muhammad Abdul-Mageed

ArXiv (abs)PDF HTML Github (3★)

Papers citing "The Skipped Beat: A Study of Sociopragmatic Understanding in LLMs for 64 Languages"

34 / 34 papers shown

Title
Bactrian-X: Multilingual Replicable Instruction-Following Models with Low-Rank Adaptation Haonan Li Fajri Koto Minghao Wu Alham Fikri Aji Timothy Baldwin ALM 62 75 0 24 May 2023
MEGA: Multilingual Evaluation of Generative AI Kabir Ahuja Harshita Diddee Rishav Hada Millicent Ochieng Krithika Ramesh ... T. Ganu Sameer Segal Maxamed Axmed Kalika Bali Sunayana Sitaram LM&MA LRM ELM 97 282 0 22 Mar 2023
Can ChatGPT Understand Too? A Comparative Study on ChatGPT and Fine-tuned BERT Qihuang Zhong Liang Ding Juhua Liu Bo Du Dacheng Tao AI4MH 104 244 0 19 Feb 2023
BLOOM: A 176B-Parameter Open-Access Multilingual Language Model BigScience Workshop : Teven Le Scao Angela Fan Christopher Akiki ... Zhongli Xie Zifan Ye M. Bras Younes Belkada Thomas Wolf VLM 394 2,388 0 09 Nov 2022
Scaling Instruction-Finetuned Language Models Hyung Won Chung Le Hou Shayne Longpre Barret Zoph Yi Tay ... Jacob Devlin Adam Roberts Denny Zhou Quoc V. Le Jason W. Wei ReLM LRM 194 3,146 0 20 Oct 2022
Dual Contrastive Learning: Text Classification via Label-Aware Data Augmentation Qianben Chen Richong Zhang Yaowei Zheng Yongyi Mao SSL 48 68 0 21 Jan 2022
NaijaSenti: A Nigerian Twitter Sentiment Corpus for Multilingual Sentiment Analysis Shamsuddeen Hassan Muhammad David Ifeoluwa Adelani Sebastian Ruder Ibrahim Said Ahmad Idris Abdulmumin ... Chris C. Emezue Saheed Abdul Anuoluwapo Aremu Alipio Jeorge P. Brazdil 69 100 0 20 Jan 2022
COLD: A Benchmark for Chinese Offensive Language Detection Deng Jiawen Jingyan Zhou Hao Sun Chujie Zheng Fei Mi Helen M. Meng Minlie Huang 69 109 0 16 Jan 2022
Multitask Prompted Training Enables Zero-Shot Task Generalization Victor Sanh Albert Webson Colin Raffel Stephen H. Bach Lintang Sutawika ... T. Bers Stella Biderman Leo Gao Thomas Wolf Alexander M. Rush LRM 346 1,706 0 15 Oct 2021
Not All Negatives are Equal: Label-Aware Contrastive Loss for Fine-grained Text Classification Varsha Suresh Desmond C. Ong VLM 107 84 0 12 Sep 2021
Improving Social Meaning Detection with Pragmatic Masking and Surrogate Fine-Tuning Chiyu Zhang Muhammad Abdul-Mageed ObjD AI4CE 58 6 0 01 Aug 2021
DravidianCodeMix: Sentiment Analysis and Offensive Language Identification Dataset for Dravidian Languages in Code-Mixed Text Bharathi Raja Chakravarthi R. Priyadharshini Vigneshwaran Muralidaran Navya Jose Shardul Suryawanshi E. Sherly John P. Mccrae 50 107 0 17 Jun 2021
XLM-T: Multilingual Language Models in Twitter for Sentiment Analysis and Beyond Francesco Barbieri Luis Espinosa Anke Jose Camacho-Collados 218 221 0 25 Apr 2021
DeepHateExplainer: Explainable Hate Speech Detection in Under-resourced Bengali Language Md. Rezaul Karim Sumon Dey Tanhim Islam Sagor Sarker Mehadi Hasan Menon Kabir Hossain Bharathi Raja Chakravarthi Md. Azam Hossain Stefan Decker 79 83 0 28 Dec 2020
ARBERT & MARBERT: Deep Bidirectional Transformers for Arabic Muhammad Abdul-Mageed AbdelRahim Elmadany El Moatez Billah Nagoudi VLM 112 463 0 27 Dec 2020
XED: A Multilingual Dataset for Sentiment Analysis and Emotion Detection Emily Öhman Marc Pàmies Kaisla Kajava Jörg Tiedemann 33 63 0 03 Nov 2020
TweetEval: Unified Benchmark and Comparative Evaluation for Tweet Classification Francesco Barbieri Jose Camacho-Collados Leonardo Neves Luis Espinosa-Anke VLM 84 723 0 23 Oct 2020
"Did you really mean what you said?" : Sarcasm Detection in Hindi-English Code-Mixed Data using Bilingual Word Embeddings Akshita Aggarwal Anshul Wadhawan Anshima Chaudhary Kavita Maurya 15 16 0 01 Oct 2020
The birth of Romanian BERT Stefan Daniel Dumitrescu Andrei-Marius Avram S. Pyysalo VLM 58 78 0 18 Sep 2020
SemEval-2020 Task 12: Multilingual Offensive Language Identification in Social Media (OffensEval 2020) Marcos Zampieri Preslav Nakov Sara Rosenthal Pepa Atanasova Georgi Karadzhov Hamdy Mubarak Leon Derczynski Zeses Pitenis cCaugri cColtekin 67 487 0 12 Jun 2020
SKEP: Sentiment Knowledge Enhanced Pre-training for Sentiment Analysis Hao Tian Can Gao Xinyan Xiao Hao Liu Bolei He Hua Wu Haifeng Wang Feng Wu 57 233 0 12 May 2020
Beneath the Tip of the Iceberg: Current Challenges and New Directions in Sentiment Analysis Research Soujanya Poria Devamanyu Hazarika Navonil Majumder Rada Mihalcea 87 219 0 01 May 2020
CLUE: A Chinese Language Understanding Evaluation Benchmark Liang Xu Hai Hu Xuanwei Zhang Lu Li Chenjie Cao ... Cong Yue Xinrui Zhang Zhen-Yi Yang Kyle Richardson Zhenzhong Lan ELM 87 386 0 13 Apr 2020
Directions in Abusive Language Training Data: Garbage In, Garbage Out Bertie Vidgen Leon Derczynski 74 265 0 03 Apr 2020
Semantic Enrichment of Nigerian Pidgin English for Contextual Sentiment Classification W. Oyewusi Olubayo Adekanmbi O. Akinsande 58 19 0 27 Mar 2020
XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalization Junjie Hu Sebastian Ruder Aditya Siddhant Graham Neubig Orhan Firat Melvin Johnson ELM 183 975 0 24 Mar 2020
SemEval-2017 Task 4: Sentiment Analysis in Twitter Sara Rosenthal N. Farra Preslav Nakov VLM 92 798 0 02 Dec 2019
Emotion Recognition for Vietnamese Social Media Text Vong Anh Ho Duong Nguyen D. H. Nguyen L. T. Pham Duc-Vu Nguyen Kiet Van Nguyen Ngan Luu-Thuy Nguyen 101 45 0 21 Nov 2019
Unsupervised Cross-lingual Representation Learning at Scale Alexis Conneau Kartikay Khandelwal Naman Goyal Vishrav Chaudhary Guillaume Wenzek Francisco Guzmán Edouard Grave Myle Ott Luke Zettlemoyer Veselin Stoyanov 223 6,565 0 05 Nov 2019
Multilingual and Multi-Aspect Hate Speech Analysis N. Ousidhoum Zizheng Lin Hongming Zhang Yangqiu Song Dit-Yan Yeung 86 289 0 29 Aug 2019
ERNIE 2.0: A Continual Pre-training Framework for Language Understanding Yu Sun Shuohuan Wang Yukun Li Shikun Feng Hao Tian Hua Wu Haifeng Wang CLL 87 811 0 29 Jul 2019
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 1.1K 7,182 0 20 Apr 2018
Creating and Characterizing a Diverse Corpus of Sarcasm in Dialogue Shereen Oraby Vrindavan Harrison Lena Reed Ernesto Hernandez E. Riloff M. Walker 42 116 0 15 Sep 2017
Using millions of emoji occurrences to learn any-domain representations for detecting sentiment, emotion and sarcasm Bjarke Felbo A. Mislove Anders Søgaard Iyad Rahwan Sune Lehmann 87 744 0 01 Aug 2017