Did the Cat Drink the Coffee? Challenging Transformers with Generalized
Event Knowledge

Did the Cat Drink the Coffee? Challenging Transformers with Generalized Event Knowledge

22 July 2021

Paolo Pedinotti

Giulia Rambelli

Emmanuele Chersoni

Alessandro Lenci

Papers citing "Did the Cat Drink the Coffee? Challenging Transformers with Generalized Event Knowledge"

12 / 12 papers shown

Title
Uncovering Autoregressive LLM Knowledge of Thematic Fit in Event Representation Safeyah Khaled Alshemali Daniel Bauer Yuval Marton BDL 218 0 0 19 Oct 2024
Elements of World Knowledge (EWOK): A cognition-inspired framework for evaluating basic world knowledge in language models Anna A. Ivanova Aalok Sathe Benjamin Lipkin Unnathi Kumar S. Radkani ... Leshem Choshen Roger Levy Evelina Fedorenko Josh Tenenbaum Jacob Andreas 46 24 0 15 May 2024
A Dataset for Physical and Abstract Plausibility and Sources of Human Disagreement Annerose Eichel Sabine Schulte im Walde 34 3 0 05 Apr 2024
Plausibility Processing in Transformer Language Models: Focusing on the Role of Attention Heads in GPT Soo Hyun Ryu 19 0 0 20 Oct 2023
Multi-lingual and Multi-cultural Figurative Language Understanding Anubha Kabra Emmy Liu Simran Khanuja Alham Fikri Aji Genta Indra Winata Samuel Cahyawijaya Anuoluwapo Aremu Perez Ogayo Graham Neubig 21 35 0 25 May 2023
EvEval: A Comprehensive Evaluation of Event Semantics for Large Language Models Zhengwei Tao Zhi Jin Xiaoying Bai Haiyan Zhao Yanlin Feng Jia Li Wenpeng Hu 39 4 0 24 May 2023
Language Model Behavior: A Comprehensive Survey Tyler A. Chang Benjamin Bergen VLM LRM LM&MA 29 103 0 20 Mar 2023
Understanding Natural Language Understanding Systems. A Critical Analysis Alessandro Lenci ELM 34 12 0 01 Mar 2023
Stress Test for BERT and Deep Models: Predicting Words from Italian Poetry Rodolfo Delmonte Nicolò Busetto 14 1 0 21 Jan 2023
Event knowledge in large language models: the gap between the impossible and the unlikely Carina Kauf Anna A. Ivanova Giulia Rambelli Emmanuele Chersoni Jingyuan Selena She Zawad Chowdhury Evelina Fedorenko Alessandro Lenci 37 67 0 02 Dec 2022
State-of-the-art generalisation research in NLP: A taxonomy and review Dieuwke Hupkes Mario Giulianelli Verna Dankers Mikel Artetxe Yanai Elazar ... Leila Khalatbari Maria Ryskina Rita Frieske Ryan Cotterell Zhijing Jin 129 95 0 06 Oct 2022
Possible Stories: Evaluating Situated Commonsense Reasoning under Multiple Possible Scenarios Mana Ashida Saku Sugawara 70 6 0 16 Sep 2022