Minding Language Models' (Lack of) Theory of Mind: A Plug-and-Play Multi-Character Belief Tracker

1 June 2023

Melanie Sclar

Yejin Choi

Papers citing "Minding Language Models' (Lack of) Theory of Mind: A Plug-and-Play Multi-Character Belief Tracker"

47 / 47 papers shown

Title
Measurement of LLM's Philosophies of Human Nature Minheng Ni Ennan Wu Zidong Gong Zhiyong Yang Linjie Li Chung-Ching Lin Kevin Qinghong Lin Lijuan Wang Wangmeng Zuo 37 0 0 03 Apr 2025
EgoToM: Benchmarking Theory of Mind Reasoning from Egocentric Videos Yuxuan Li Vijay Veerabadran Michael L. Iuzzolino Brett D. Roads Asli Celikyilmaz Karl Ridgeway EgoV 64 0 0 28 Mar 2025
The Mind in the Machine: A Survey of Incorporating Psychological Theories in LLMs Zizhou Liu Ziwei Gong Lin Ai Zheng Hui Run Chen Colin Wayne Leach Michelle R. Greene Julia Hirschberg LLMAG 189 0 0 28 Mar 2025
Re-evaluating Theory of Mind evaluation in large language models Jennifer Hu Felix Sosa T. Ullman 45 0 0 28 Feb 2025
Persuasion Should be Double-Blind: A Multi-Domain Dialogue Dataset With Faithfulness Based on Causal Theory of Mind Dingyi Zhang Deyu Zhou 69 1 0 28 Feb 2025
PersuasiveToM: A Benchmark for Evaluating Machine Theory of Mind in Persuasive Dialogues Fangxu Yu Lai Jiang Shenyi Huang Zhen Wu Xinyu Dai LLMAG 87 0 0 28 Feb 2025
Hypothesis-Driven Theory-of-Mind Reasoning for Large Language Models Hyunwoo Kim Melanie Sclar Tan Zhi-Xuan Lance Ying Sydney Levine Yang Liu Joshua B. Tenenbaum Yejin Choi LRM LLMAG 61 0 0 17 Feb 2025
Will Systems of LLM Agents Cooperate: An Investigation into a Social Dilemma Richard Willis Yali Du Joel Z Leibo Michael Luck 61 1 0 28 Jan 2025
Mind Your Theory: Theory of Mind Goes Deeper Than Reasoning Eitan Wagner Nitay Alon J. Barnby Omri Abend LRM 85 2 0 18 Dec 2024
SimpleToM: Exposing the Gap between Explicit ToM Inference and Implicit ToM Application in LLMs Yuling Gu Oyvind Tafjord Hyunwoo Kim Jared Moore Ronan Le Bras Peter Clark Yejin Choi 33 8 0 17 Oct 2024
Enhancing Financial Sentiment Analysis with Expert-Designed Hint Chung-Chi Chen Hiroya Takamura Ichiro Kobayashi Yusuke Miyao 37 1 0 26 Sep 2024
Constrained Reasoning Chains for Enhancing Theory-of-Mind in Large Language Models Zizheng Lin Chunkit Chan Yangqiu Song Xin Liu LRM 28 1 0 20 Sep 2024
Thinking Before Speaking: A Role-playing Model with Mindset Baohua Zhang Yongyi Huang Wenyao Cui Huaping Zhang LRM LLMAG 37 3 0 14 Sep 2024
MuMA-ToM: Multi-modal Multi-Agent Theory of Mind Haojun Shi Suyu Ye Xinyu Fang Chuanyang Jin Leyla Isik Yen-Ling Kuo Tianmin Shu LLMAG 75 7 0 22 Aug 2024
Evaluating and Enhancing LLMs Agent based on Theory of Mind in Guandan: A Multi-Player Cooperative Game under Imperfect Information Yauwai Yim Chunkit Chan Tianyu Shi Zheye Deng Wei Fan Tianshi Zheng Yangqiu Song LLMAG 34 10 0 05 Aug 2024
Perceptions to Beliefs: Exploring Precursory Inferences for Theory of Mind in Large Language Models Chani Jung Dongkwan Kim Jiho Jin Jiseon Kim Yeon Seonwoo Yejin Choi Alice Oh Hyunwoo Kim LRM 58 7 0 08 Jul 2024
TimeToM: Temporal Space is the Key to Unlocking the Door of Large Language Models' Theory-of-Mind Guiyang Hou Wenqi Zhang Yongliang Shen Linjuan Wu Weiming Lu LRM AI4CE 38 7 0 01 Jul 2024
InterIntent: Investigating Social Intelligence of LLMs via Intention Understanding in an Interactive Game Context Ziyi Liu Abhishek Anand Pei Zhou Jen-tse Huang Jieyu Zhao 86 6 0 18 Jun 2024
Do LLMs Exhibit Human-Like Reasoning? Evaluating Theory of Mind in LLMs for Open-Ended Responses Maryam Amirizaniani Elias Martin Maryna Sivachenko A. Mashhadi Chirag Shah LRM 48 12 0 09 Jun 2024
The BiGGen Bench: A Principled Benchmark for Fine-grained Evaluation of Language Models with Language Models Seungone Kim Juyoung Suk Ji Yong Cho Shayne Longpre Chaeeun Kim ... Sean Welleck Graham Neubig Moontae Lee Kyungjae Lee Minjoon Seo ELM ALM LM&MA 105 31 0 09 Jun 2024
Toward In-Context Teaching: Adapting Examples to Students' Misconceptions Alexis Ross Jacob Andreas 36 4 0 07 May 2024
From Persona to Personalization: A Survey on Role-Playing Language Agents Jiangjie Chen Xintao Wang Rui Xu Siyu Yuan Yikai Zhang ... Caiyu Hu Siye Wu Scott Ren Ziquan Fu Yanghua Xiao 62 79 0 28 Apr 2024
NegotiationToM: A Benchmark for Stress-testing Machine Theory of Mind on Negotiation Surrounding Chunkit Chan Cheng Jiayang Yauwai Yim Zheye Deng Wei Fan Haoran Li Xin Liu Hongming Zhang Weiqi Wang Yangqiu Song LLMAG 35 22 0 21 Apr 2024
Views Are My Own, but Also Yours: Benchmarking Theory of Mind Using Common Ground Adil Soubki John Murzaku Arash Yousefi Jordehi Peter Zeng Magdalena Markowska Seyed Abolghasem Mirroshandel Owen Rambow VLM 28 7 0 04 Mar 2024
Pragmatic Instruction Following and Goal Assistance via Cooperative Language-Guided Inverse Planning Zhi-Xuan Tan Lance Ying Vikash K. Mansinghka Joshua B. Tenenbaum 54 22 0 27 Feb 2024
OpenToM: A Comprehensive Benchmark for Evaluating Theory-of-Mind Reasoning Capabilities of Large Language Models Hainiu Xu Runcong Zhao Lixing Zhu Bin Liang Yulan He 84 20 0 08 Feb 2024
Computational Experiments Meet Large Language Model Based Agents: A Survey and Perspective Qun Ma Xiao Xue Deyu Zhou Xiangning Yu Donghua Liu ... Yifan Shen Peilin Ji Juanjuan Li Gang Wang Wanpeng Ma AI4CE LM&Ro LLMAG 21 7 0 01 Feb 2024
SocraSynth: Multi-LLM Reasoning with Conditional Statistics Edward Y. Chang LLMAG LRM 33 8 0 19 Jan 2024
MMToM-QA: Multimodal Theory of Mind Question Answering Chuanyang Jin Yutong Wu Jing Cao Jiannan Xiang Yen-Ling Kuo Zhiting Hu T. Ullman Antonio Torralba Joshua B. Tenenbaum Tianmin Shu 42 33 0 16 Jan 2024
LLM Harmony: Multi-Agent Communication for Problem Solving Sumedh Rasal LLMAG 24 22 0 02 Jan 2024
Think Twice: Perspective-Taking Improves Large Language Models' Theory-of-Mind Capabilities Alex Wilf Sihyun Shawn Lee Paul Pu Liang Louis-Philippe Morency LRM 50 34 0 16 Nov 2023
Plug-and-Play Policy Planner for Large Language Model Powered Dialogue Agents Yang Deng Wenxuan Zhang Wai Lam See-Kiong Ng Tat-Seng Chua LM&Ro LLMAG 20 34 0 01 Nov 2023
Towards A Holistic Landscape of Situated Theory of Mind in Large Language Models Ziqiao Ma Jacob Sansom Run Peng Joyce Chai 49 17 0 30 Oct 2023
Can LLMs Keep a Secret? Testing Privacy Implications of Language Models via Contextual Integrity Theory Niloofar Mireshghallah Hyunwoo J. Kim Xuhui Zhou Yulia Tsvetkov Maarten Sap Reza Shokri Yejin Choi PILM 38 75 0 27 Oct 2023
FANToM: A Benchmark for Stress-testing Machine Theory of Mind in Interactions Hyunwoo J. Kim Melanie Sclar Xuhui Zhou Ronan Le Bras Gunhee Kim Yejin Choi Maarten Sap LLMAG 29 80 0 24 Oct 2023
Theory of Mind for Multi-Agent Collaboration via Large Language Models Huao Li Yu Quan Chong Simon Stepputtis Joseph Campbell Dana Hughes Michael Lewis Katia P. Sycara LLMAG 30 62 0 16 Oct 2023
Put Your Money Where Your Mouth Is: Evaluating Strategic Planning and Execution of LLM Agents in an Auction Arena Jiangjie Chen Siyu Yuan Rong Ye Bodhisattwa Prasad Majumder Kyle Richardson LLMAG ELM 33 56 0 09 Oct 2023
How FaR Are Large Language Models From Agents with Theory-of-Mind? Pei Zhou Aman Madaan Srividya Pranavi Potharaju Aditya Gupta Kevin R. McKee ... Xiang Ren Swaroop Mishra Aida Nematzadeh Shyam Upadhyay Manaal Faruqui LRM AI4CE 32 48 0 04 Oct 2023
Corex: Pushing the Boundaries of Complex Reasoning through Multi-Model Collaboration Qiushi Sun Zhangyue Yin Xiang Li Zhiyong Wu Xipeng Qiu Lingpeng Kong LRM LLMAG 28 44 0 30 Sep 2023
Cooperation, Competition, and Maliciousness: LLM-Stakeholders Interactive Negotiation Sahar Abdelnabi Amr Gomaa S. Sivaprasad Lea Schonherr Mario Fritz 30 29 0 29 Sep 2023
Creativity Support in the Age of Large Language Models: An Empirical Study Involving Emerging Writers Tuhin Chakrabarty Vishakh Padmakumar Faeze Brahman Smaranda Muresan 60 35 0 22 Sep 2023
Socratis: Are large multimodal models emotionally aware? Katherine Deng Arijit Ray Reuben Tan Saadia Gabriel Bryan A. Plummer Kate Saenko 32 4 0 31 Aug 2023
A Survey on Large Language Model based Autonomous Agents Lei Wang Chengbang Ma Xueyang Feng Zeyu Zhang Hao-ran Yang ... Xu Chen Yankai Lin Wayne Xin Zhao Zhewei Wei Ji-Rong Wen LLMAG AI4CE LM&Ro 41 1,126 0 22 Aug 2023
Clever Hans or Neural Theory of Mind? Stress Testing Social Reasoning in Large Language Models Natalie Shapira Mosh Levy S. Alavi Xuhui Zhou Yejin Choi Yoav Goldberg Maarten Sap Vered Shwartz LLMAG ELM 31 115 0 24 May 2023
Can Language Models Solve Graph Problems in Natural Language? Heng Wang Shangbin Feng Tianxing He Zhaoxuan Tan Xiaochuang Han Yulia Tsvetkov ReLM LRM 29 182 0 17 May 2023
Evaluating Large Language Models in Theory of Mind Tasks Michal Kosinskihttps://www.semanticscholar.org/me/account LLMAG LRM 29 104 0 04 Feb 2023
MindCraft: Theory of Mind Modeling for Situated Dialogue in Collaborative Tasks Cristian-Paul Bara Sky CH-Wang J. Chai 67 61 0 13 Sep 2021