Testing the Ability of Language Models to Interpret Figurative Language

26 April 2022

Graham Neubig

Papers citing "Testing the Ability of Language Models to Interpret Figurative Language"

43 / 43 papers shown

Title
Hummus: A Dataset of Humorous Multimodal Metaphor Use Xiaoyu Tong Zhi Zhang Martha Lewis Ekaterina Shutova 29 0 0 03 Apr 2025
Sparse Auto-Encoder Interprets Linguistic Features in Large Language Models Yi Jing Zijun Yao Lingxu Ran Hongzhu Guo Xiaozhi Wang Lei Hou Juanzi Li 59 0 0 27 Feb 2025
Non-literal Understanding of Number Words by Language Models Polina Tsvilodub Kanishk Gandhi Haoran Zhao Jan-Philipp Fränken Michael Franke Noah D. Goodman ReLM 83 0 0 10 Feb 2025
Towards Multimodal Metaphor Understanding: A Chinese Dataset and Model for Metaphor Mapping Identification Dongyu Zhang Shengcheng Yin Jiahao Yu Zhiyao Wu Zhen Li Chengpei Xu Xuben Wang Feng Xia 138 0 0 05 Jan 2025
Semantic Change Characterization with LLMs using Rhetorics Jader Martins Camboim de Sá Marcos Da Silveira C. Pruski 34 3 0 23 Jul 2024
mCSQA: Multilingual Commonsense Reasoning Dataset with Unified Creation Strategy by Language Models and Humans Yusuke Sakai Hidetaka Kamigaito Taro Watanabe LRM 43 2 0 06 Jun 2024
A Hard Nut to Crack: Idiom Detection with Conversational Large Language Models Francesca de Luca Fornaciari Begoña Altuna Itziar Gonzalez-Dios Maite Melero 28 2 0 17 May 2024
Is the Pope Catholic? Yes, the Pope is Catholic. Generative Evaluation of Non-Literal Intent Resolution in LLMs Akhila Yerukola Saujas Vaduguru Daniel Fried Maarten Sap 31 1 0 14 May 2024
Enabling Natural Zero-Shot Prompting on Encoder Models via Statement-Tuning Ahmed Elshabrawy Yongix Huang Iryna Gurevych Alham Fikri Aji 40 0 0 19 Apr 2024
Meta4XNLI: A Crosslingual Parallel Corpus for Metaphor Detection and Interpretation Elisa Sanchez-Bayona Rodrigo Agerri 45 0 0 10 Apr 2024
Toward Informal Language Processing: Knowledge of Slang in Large Language Models Zhewei Sun Qian Hu Rahul Gupta Richard Zemel Yang Xu 46 1 0 02 Apr 2024
Metaphor Understanding Challenge Dataset for LLMs Xiaoyu Tong Rochelle Choenni Martha Lewis Ekaterina Shutova 51 8 0 18 Mar 2024
PARADISE: Evaluating Implicit Planning Skills of Language Models with Procedural Warnings and Tips Dataset Arda Uzunouglu Abdalfatah Rashid Safa Gözde Gül Sahin LRM 22 2 0 05 Mar 2024
Stable LM 2 1.6B Technical Report Marco Bellagente J. Tow Dakota Mahan Duy Phung Maksym Zhuravinskyi ... Paulo Rocha Harry Saini H. Teufel Niccoló Zanichelli Carlos Riquelme OSLM 44 52 0 27 Feb 2024
Probing Language Models' Gesture Understanding for Enhanced Human-AI Interaction Philipp Wicke 32 2 0 31 Jan 2024
Semantics of Multiword Expressions in Transformer-Based Models: A Survey Filip Miletic Sabine Schulte im Walde 45 6 0 27 Jan 2024
PUB: A Pragmatics Understanding Benchmark for Assessing LLMs' Pragmatics Capabilities S. Sravanthi Meet Doshi Tankala Pavan Kalyan Rudra Murthy Pushpak Bhattacharyya Raj Dabre 24 20 0 13 Jan 2024
Systematic word meta-sense extension Lei Yu 28 1 0 21 Nov 2023
Divergences between Language Models and Human Brains Yuchen Zhou Emmy Liu Graham Neubig Michael J. Tarr Leila Wehbe 35 1 0 15 Nov 2023
Generating Continuations in Multilingual Idiomatic Contexts Rhitabrat Pokharel Ameeta Agrawal LRM 23 1 0 31 Oct 2023
ViPE: Visualise Pretty-much Everything Hassan Shahmohammadi Adhiraj Ghosh Hendrik P. A. Lensch DiffM 28 1 0 16 Oct 2023
Does the "most sinfully decadent cake ever" taste good? Answering Yes/No Questions from Figurative Contexts Geetanjali Rakshit Jeffrey Flanigan ELM 18 1 0 24 Sep 2023
Evaluating large language models' ability to understand metaphor and sarcasm using a screening test for Asperger syndrome Hiromu Yakura AI4MH 24 0 0 19 Sep 2023
Are Multilingual LLMs Culturally-Diverse Reasoners? An Investigation into Multicultural Proverbs and Sayings Chen Cecilia Liu Fajri Koto Timothy Baldwin Iryna Gurevych LRM 32 17 0 15 Sep 2023
Connecting the Dots in News Analysis: Bridging the Cross-Disciplinary Disparities in Media Bias and Framing Gisela Vallejo Timothy Baldwin Lea Frermann 20 3 0 14 Sep 2023
Large Language Model Displays Emergent Ability to Interpret Novel Literary Metaphors Nicholas Ichien Duvsan Stamenković K. Holyoak LRM 35 4 0 03 Aug 2023
Multi-lingual and Multi-cultural Figurative Language Understanding Anubha Kabra Emmy Liu Simran Khanuja Alham Fikri Aji Genta Indra Winata Samuel Cahyawijaya Anuoluwapo Aremu Perez Ogayo Graham Neubig 16 35 0 25 May 2023
I Spy a Metaphor: Large Language Models and Diffusion Models Co-Create Visual Metaphors Tuhin Chakrabarty Arkadiy Saakyan Olivia Winn Artemis Panagopoulou Yue Yang Marianna Apidianaki Smaranda Muresan DiffM 33 41 0 24 May 2023
LMs stand their Ground: Investigating the Effect of Embodiment in Figurative Language Interpretation by Language Models Philipp Wicke 20 5 0 05 May 2023
Language Model Behavior: A Comprehensive Survey Tyler A. Chang Benjamin Bergen VLM LRM LM&MA 27 103 0 20 Mar 2023
A fine-grained comparison of pragmatic language understanding in humans and language models Jennifer Hu Sammy Floyd Olessia Jouravlev Evelina Fedorenko E. Gibson 10 52 0 13 Dec 2022
MAPS-KB: A Million-scale Probabilistic Simile Knowledge Base Qi He Xintao Wang Jiaqing Liang Yanghua Xiao 38 3 0 10 Dec 2022
Harnessing Knowledge and Reasoning for Human-Like Natural Language Generation: A Brief Review Jiangjie Chen Yanghua Xiao 44 4 0 07 Dec 2022
Detecting Euphemisms with Literal Descriptions and Visual Imagery .Ilker Kesen Aykut Erdem Erkut Erdem Iacer Calixto 29 4 0 08 Nov 2022
Effective Cross-Task Transfer Learning for Explainable Natural Language Inference with T5 Irina Bigoulaeva Rachneet Sachdeva Harish Tayyar Madabushi Aline Villavicencio Iryna Gurevych LRM 50 5 0 31 Oct 2022
EUREKA: EUphemism Recognition Enhanced through Knn-based methods and Augmentation Sedrick Scott Keh Rohit K Bharadwaj Emmy Liu Simone Tedeschi Varun Gangal Roberto Navigli 23 7 0 23 Oct 2022
Leveraging Large Language Models for Multiple Choice Question Answering Joshua Robinson Christopher Rytting David Wingate ELM 143 186 0 22 Oct 2022
Leveraging a New Spanish Corpus for Multilingual and Crosslingual Metaphor Detection Elisa Sanchez-Bayona Rodrigo Agerri 12 10 0 19 Oct 2022
MiQA: A Benchmark for Inference on Metaphorical Questions Iulia Comsa Julian Martin Eisenschlos S. Narayanan 19 8 0 14 Oct 2022
FLUTE: Figurative Language Understanding through Textual Explanations Tuhin Chakrabarty Arkadiy Saakyan Debanjan Ghosh Smaranda Muresan 49 66 0 24 May 2022
Metaphors in Pre-Trained Language Models: Probing and Generalization Across Datasets and Languages Ehsan Aghazadeh Mohsen Fayyaz Yadollah Yaghoobzadeh 33 51 0 26 Mar 2022
Investigating Robustness of Dialog Models to Popular Figurative Language Constructs Harsh Jhamtani Varun Gangal Eduard H. Hovy Taylor Berg-Kirkpatrick 28 21 0 01 Oct 2021
RiddleSense: Reasoning about Riddle Questions Featuring Linguistic Creativity and Commonsense Knowledge Bill Yuchen Lin Ziyi Wu Yichi Yang Dong-Ho Lee Xiang Ren ReLM LRM 236 64 0 02 Jan 2021