v1v2 (latest)

GOMA: Proactive Embodied Cooperative Communication via Goal-Oriented Mental Alignment

17 March 2024

Lance Ying

Kunal Jha

Shivam Aarya

Joshua B. Tenenbaum

Antonio Torralba

Tianmin Shu

ArXiv (abs)PDF HTML

Papers citing "GOMA: Proactive Embodied Cooperative Communication via Goal-Oriented Mental Alignment"

31 / 31 papers shown

Title
BeliefNest: A Joint Action Simulator for Embodied Agents with Theory of Mind Rikunari Sagara Koichiro Terao Naoto Iwahashi LM&Ro 93 0 0 18 May 2025
Cross-environment Cooperation Enables Zero-shot Multi-agent Coordination Kunal Jha Wilka Carvalho Yancheng Liang S. Du Max Kleiman-Weiner Natasha Jaques 128 0 0 17 Apr 2025
Generative Multi-Agent Collaboration in Embodied AI: A Systematic Review Di Wu Xian Wei Guang Chen Hao Shen Xiangfeng Wang Wenhao Li Bo Jin 139 2 0 17 Feb 2025
Infer Human's Intentions Before Following Natural Language Instructions Yanming Wan Yue Wu Yiping Wang Jiayuan Mao Natasha Jaques LM&Ro 116 3 0 26 Sep 2024
SIFToM: Robust Spoken Instruction Following through Theory of Mind Lance Ying Jason Xinyu Liu Shivam Aarya Yizirui Fang Stefanie Tellex J. Tenenbaum Tianmin Shu LM&Ro 99 2 0 17 Sep 2024
MuMA-ToM: Multi-modal Multi-Agent Theory of Mind Haojun Shi Suyu Ye Xinyu Fang Chuanyang Jin Leyla Isik Yen-Ling Kuo Tianmin Shu LLMAG 182 16 0 22 Aug 2024
Understanding Epistemic Language with a Language-augmented Bayesian Theory of Mind Lance Ying Tan Zhi-Xuan Lionel Wong Vikash K. Mansinghka J. Tenenbaum 119 1 0 21 Aug 2024
CAMON: Cooperative Agents for Multi-Object Navigation with LLM-based Conversations Pengying Wu Yao Mu Kangjie Zhou Ji Ma Junting Chen Chang Liu LLMAG LM&Ro 104 2 0 30 Jun 2024
The Overcooked Generalisation Challenge Constantin Ruhdorfer Matteo Bortoletto Anna Penzkofer Andreas Bulling 116 4 0 25 Jun 2024
AToM-Bot: Embodied Fulfillment of Unspoken Human Needs with Affective Theory of Mind Wei Ding Fanhong Li Ziteng Ji Zhengrong Xue Jia Liu LM&Ro 72 2 0 12 Jun 2024
Pragmatic Instruction Following and Goal Assistance via Cooperative Language-Guided Inverse Planning Zhi-Xuan Tan Lance Ying Vikash K. Mansinghka Joshua B. Tenenbaum 113 23 0 27 Feb 2024
Grounding Language about Belief in a Bayesian Theory-of-Mind Lance Ying Zhi-Xuan Tan Lionel Wong Vikash K. Mansinghka Joshua Tenenbaum 121 7 0 16 Feb 2024
MMToM-QA: Multimodal Theory of Mind Question Answering Chuanyang Jin Yutong Wu Jing Cao Jiannan Xiang Yen-Ling Kuo Zhiting Hu T. Ullman Antonio Torralba Joshua B. Tenenbaum Tianmin Shu 111 46 0 16 Jan 2024
RoCo: Dialectic Multi-Robot Collaboration with Large Language Models Zhao Mandi Shreeya Jain Shuran Song LM&Ro LLMAG 75 141 0 10 Jul 2023
Building Cooperative Embodied Agents Modularly with Large Language Models Hongxin Zhang Weihua Du Jiaming Shan Qinhong Zhou Yilun Du J. Tenenbaum Tianmin Shu Chuang Gan LLMAG LM&Ro 126 178 0 05 Jul 2023
Inferring the Goals of Communicating Agents from Actions and Instructions Lance Ying Zhi-Xuan Tan Vikash K. Mansinghka J. Tenenbaum LLMAG 92 20 0 28 Jun 2023
The Neuro-Symbolic Inverse Planning Engine (NIPE): Modeling Probabilistic Social Inferences from Linguistic Inputs Lance Ying Katherine M. Collins Megan Wei Cedegao E. Zhang Tan Zhi-Xuan Adrian Weller J. Tenenbaum L. Wong 121 16 0 25 Jun 2023
GPT-4 Technical Report OpenAI OpenAI OpenAI Josh Achiam Steven Adler Sandhini Agarwal Lama Ahmad ... Shengjia Zhao Tianhao Zheng Juntang Zhuang William Zhuk Barret Zoph LLMAG MLLM 1.6K 14,865 0 15 Mar 2023
Large Language Models Fail on Trivial Alterations to Theory-of-Mind Tasks T. Ullman LRM 92 241 0 16 Feb 2023
Do As I Can, Not As I Say: Grounding Language in Robotic Affordances Michael Ahn Anthony Brohan Noah Brown Yevgen Chebotar Omar Cortes ... Ted Xiao Peng Xu Sichun Xu Mengyuan Yan Andy Zeng LM&Ro 220 1,992 0 04 Apr 2022
Show Me What You Can Do: Capability Calibration on Reachable Workspace for Human-Robot Collaboration Xiaofeng Gao Luyao Yuan Tianmin Shu Hongjing Lu Song-Chun Zhu 56 4 0 06 Mar 2021
AGENT: A Benchmark for Core Psychological Reasoning Tianmin Shu Abhishek Bhandwaldar Chuang Gan Kevin A. Smith Shari Liu Dan Gutfreund E. Spelke J. Tenenbaum T. Ullman 130 70 0 24 Feb 2021
Watch-And-Help: A Challenge for Social Perception and Human-AI Collaboration Xavier Puig Tianmin Shu Shuang Li Zilin Wang Yuan-Hong Liao J. Tenenbaum Sanja Fidler Antonio Torralba LM&Ro 161 130 0 19 Oct 2020
Joint Mind Modeling for Explanation Generation in Complex Human-Robot Collaborative Tasks Xiaofeng Gao Ran Gong Yizhou Zhao Shu Wang Tianmin Shu Song-Chun Zhu 66 37 0 24 Jul 2020
Online Bayesian Goal Inference for Boundedly-Rational Planning Agents Zhi-Xuan Tan Jordyn L. Mann Tom Silver J. Tenenbaum Vikash K. Mansinghka OffRL 95 96 0 13 Jun 2020
On the Utility of Learning about Humans for Human-AI Coordination Micah Carroll Rohin Shah Mark K. Ho Thomas Griffiths Sanjit A. Seshia Pieter Abbeel Anca Dragan HAI 77 405 0 13 Oct 2019
Expressing Robot Incapability Minae Kwon Sandy H. Huang Anca Dragan 74 124 0 18 Oct 2018
Cooperative Inverse Reinforcement Learning Dylan Hadfield-Menell Anca Dragan Pieter Abbeel Stuart J. Russell 117 645 0 09 Jun 2016
Plan Explicability and Predictability for Robot Task Planning Yu-an Zhang S. Sreedharan Anagha Kulkarni Tathagata Chakraborti Hankui Zhuo S. Kambhampati 75 177 0 25 Nov 2015
Monte Carlo Sampling Methods for Approximating Interactive POMDPs Prashant Doshi P. Gmytrasiewicz 98 106 0 15 Jan 2014
A Framework for Sequential Planning in Multi-Agent Settings P. Gmytrasiewicz Prashant Doshi 124 484 0 09 Sep 2011