MMToM-QA: Multimodal Theory of Mind Question Answering

MMToM-QA: Multimodal Theory of Mind Question Answering

16 January 2024

Antonio Torralba

Joshua B. Tenenbaum

Papers citing "MMToM-QA: Multimodal Theory of Mind Question Answering"

15 / 15 papers shown

Title
Towards Dynamic Theory of Mind: Evaluating LLM Adaptation to Temporal Evolution of Human States Yang Xiao Jiashuo Wang Qiancheng Xu Changhe Song Chunpu Xu Yi Cheng Wenjie Li Pengfei Liu 102 0 0 23 May 2025
How Well Can Vison-Language Models Understand Humans' Intention? An Open-ended Theory of Mind Question Evaluation Benchmark Ximing Wen Mallika Mainali Anik Sen 81 0 0 28 Mar 2025
Mind Your Theory: Theory of Mind Goes Deeper Than Reasoning Eitan Wagner Nitay Alon J. Barnby Omri Abend LRM 132 2 0 18 Dec 2024
Do Vision-Language Models Represent Space and How? Evaluating Spatial Frame of Reference Under Ambiguities Zheyuan Zhang Fengyuan Hu Jayjun Lee Freda Shi Parisa Kordjamshidi Joyce Chai Ziqiao Ma 97 12 0 22 Oct 2024
MuMA-ToM: Multi-modal Multi-Agent Theory of Mind Haojun Shi Suyu Ye Xinyu Fang Chuanyang Jin Leyla Isik Yen-Ling Kuo Tianmin Shu LLMAG 88 13 0 22 Aug 2024
Understanding Epistemic Language with a Language-augmented Bayesian Theory of Mind Lance Ying Tan Zhi-Xuan Lionel Wong Vikash K. Mansinghka J. Tenenbaum 80 1 0 21 Aug 2024
GOMA: Proactive Embodied Cooperative Communication via Goal-Oriented Mental Alignment Lance Ying Kunal Jha Shivam Aarya Joshua B. Tenenbaum Antonio Torralba Tianmin Shu 65 14 0 17 Mar 2024
Think Twice: Perspective-Taking Improves Large Language Models' Theory-of-Mind Capabilities Alex Wilf Sihyun Shawn Lee Paul Pu Liang Louis-Philippe Morency LRM 66 41 0 16 Nov 2023
FANToM: A Benchmark for Stress-testing Machine Theory of Mind in Interactions Hyunwoo J. Kim Melanie Sclar Xuhui Zhou Ronan Le Bras Gunhee Kim Yejin Choi Maarten Sap LLMAG 51 84 0 24 Oct 2023
Understanding Social Reasoning in Language Models with Language Models Kanishk Gandhi Jan-Philipp Fränken Tobias Gerstenberg Noah D. Goodman LRM 53 121 0 21 Jun 2023
Minding Language Models' (Lack of) Theory of Mind: A Plug-and-Play Multi-Character Belief Tracker Melanie Sclar Sachin Kumar Peter West Alane Suhr Yejin Choi Yulia Tsvetkov 77 75 0 01 Jun 2023
Pre-Trained Language Models for Interactive Decision-Making Shuang Li Xavier Puig Chris Paxton Yilun Du Clinton Jia Wang ... Anima Anandkumar Jacob Andreas Igor Mordatch Antonio Torralba Yuke Zhu LM&Ro 91 253 0 03 Feb 2022
Baby Intuitions Benchmark (BIB): Discerning the goals, preferences, and actions of others Kanishk Gandhi Gala Stojnic Brenden M. Lake M. Dillon 64 47 0 23 Feb 2021
From Recognition to Cognition: Visual Commonsense Reasoning Rowan Zellers Yonatan Bisk Ali Farhadi Yejin Choi LRM BDL OCL ReLM 131 873 0 27 Nov 2018
Machine Theory of Mind Neil C. Rabinowitz Frank Perbet H. F. Song Chiyuan Zhang S. M. Ali Eslami M. Botvinick AI4CE 108 470 0 21 Feb 2018