VirtualHome: Simulating Household Activities via Programs

19 June 2018

Sanja Fidler

Antonio Torralba

LM&Ro

ArXiv PDF HTML

Papers citing "VirtualHome: Simulating Household Activities via Programs"

50 / 100 papers shown

Title
Multimodal Speech Recognition for Language-Guided Embodied Agents Allen Chang Xiaoyuan Zhu Aarav Monga Seoho Ahn Tejas Srinivasan Jesse Thomason AuLLM 24 3 0 27 Feb 2023
Scene Synthesis from Human Motion Sifan Ye Yixing Wang Jiaman Li Dennis Park C. Karen Liu Huazhe Xu Jiajun Wu 3DH 85 19 0 04 Jan 2023
IMos: Intent-Driven Full-Body Motion Synthesis for Human-Object Interactions Anindita Ghosh Rishabh Dabral Vladislav Golyanik Christian Theobalt P. Slusallek DiffM 39 85 0 14 Dec 2022
OpenD: A Benchmark for Language-Driven Door and Drawer Opening Yizhou Zhao Qiaozi Gao Liang Qiu Govind Thattai Gaurav Sukhatme 29 5 0 10 Dec 2022
LLM-Planner: Few-Shot Grounded Planning for Embodied Agents with Large Language Models Chan Hee Song Jiaman Wu Clay Washington Brian M Sadler Wei-Lun Chao Yu-Chuan Su LLMAG LM&Ro 36 383 0 08 Dec 2022
Proactive Robot Assistance via Spatio-Temporal Object Modeling Maithili Patel Sonia Chernova 29 26 0 28 Nov 2022
Ask4Help: Learning to Leverage an Expert for Embodied Tasks Kunal Pratap Singh Luca Weihs Alvaro Herrasti Jonghyun Choi Aniruddha Kemhavi Roozbeh Mottaghi 13 19 0 18 Nov 2022
Long-HOT: A Modular Hierarchical Approach for Long-Horizon Object Transport S. Narayanan Dinesh Jayaraman Manmohan Chandraker 24 1 0 28 Oct 2022
RCareWorld: A Human-centric Simulation World for Caregiving Robots Ruolin Ye Wenqiang Xu Haoyuan Fu Rajat Kumar Jenamani V. Nguyen Cewu Lu Katherine Dimitropoulou T. Bhattacharjee LM&Ro 25 39 0 19 Oct 2022
VIMA: General Robot Manipulation with Multimodal Prompts Yunfan Jiang Agrim Gupta Zichen Zhang Guanzhi Wang Yongqiang Dou Yanjun Chen Li Fei-Fei Anima Anandkumar Yuke Zhu Linxi Fan LM&Ro 28 335 0 06 Oct 2022
Robot Task Planning and Situation Handling in Open Worlds Yan Ding Xiaohan Zhang S. Amiri Nieqing Cao Hao Yang Chad Esselink Shiqi Zhang LM&Ro 28 19 0 04 Oct 2022
A Portable Multiscopic Camera for Novel View and Time Synthesis in Dynamic Scenes Tianjiao Zhang Yuen-Fui Lau Qifeng Chen 32 4 0 30 Aug 2022
Multimodal Generation of Novel Action Appearances for Synthetic-to-Real Recognition of Activities of Daily Living Zdravko Marinov David Schneider Alina Roitberg Rainer Stiefelhagen VGen 32 2 0 03 Aug 2022
Finding Fallen Objects Via Asynchronous Audio-Visual Integration Chuang Gan Yi Gu Siyuan Zhou Jeremy Schwartz S. Alter James Traer Dan Gutfreund J. Tenenbaum Josh H. McDermott Antonio Torralba 50 19 0 07 Jul 2022
ToolTango: Common sense Generalization in Predicting Sequential Tool Interactions for Robot Plan Synthesis Shreshth Tuli Rajas Bansal Rohan Paul Mausam LM&Ro 15 4 0 18 Jun 2022
MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledge Linxi Fan Guanzhi Wang Yunfan Jiang Ajay Mandlekar Yuncong Yang Haoyi Zhu Andrew Tang De-An Huang Yuke Zhu Anima Anandkumar LM&Ro 48 348 0 17 Jun 2022
ProcTHOR: Large-Scale Embodied AI Using Procedural Generation Matt Deitke Eli VanderBilt Alvaro Herrasti Luca Weihs Jordi Salvador ... Winson Han Eric Kolve Ali Farhadi Aniruddha Kembhavi Roozbeh Mottaghi LM&Ro 38 235 0 14 Jun 2022
ABCDE: An Agent-Based Cognitive Development Environment Jieyi Ye Jiafei Duan Samson Yu B. Wen Cheston Tan 13 1 0 10 Jun 2022
HandoverSim: A Simulation Framework and Benchmark for Human-to-Robot Object Handovers Yu-Wei Chao Chris Paxton Yu Xiang Wei Yang Balakumar Sundaralingam Tao Chen Adithyavairavan Murali Maya Cakmak D. Fox 62 17 0 19 May 2022
Explainable Knowledge Graph Embedding: Inference Reconciliation for Knowledge Inferences Supporting Robot Actions A. Daruna Devleena Das Sonia Chernova 30 9 0 04 May 2022
NavDreams: Towards Camera-Only RL Navigation Among Humans Daniel Dugas Olov Andersson Roland Siegwart Jen Jen Chung VGen 21 12 0 23 Mar 2022
DialFRED: Dialogue-Enabled Agents for Embodied Instruction Following Xiaofeng Gao Qiaozi Gao Ran Gong Kaixiang Lin Govind Thattai Gaurav Sukhatme LM&Ro 89 70 0 27 Feb 2022
Pre-Trained Language Models for Interactive Decision-Making Shuang Li Xavier Puig Chris Paxton Yilun Du Clinton Jia Wang ... Anima Anandkumar Jacob Andreas Igor Mordatch Antonio Torralba Yuke Zhu LM&Ro 39 247 0 03 Feb 2022
LayoutEnhancer: Generating Good Indoor Layouts from Imperfect Data Kurt Leimer Paul Guerrero Tomer Weiss Przemyslaw Musialski 3DV 40 17 0 01 Feb 2022
Learning to Act with Affordance-Aware Multimodal Neural SLAM Zhiwei Jia Kaixiang Lin Yizhou Zhao Qiaozi Gao Govind Thattai Gaurav Sukhatme LM&Ro 31 15 0 24 Jan 2022
Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agents Wenlong Huang Pieter Abbeel Deepak Pathak Igor Mordatch LM&Ro 42 1,056 0 18 Jan 2022
BigDatasetGAN: Synthesizing ImageNet with Pixel-wise Annotations Daiqing Li Huan Ling Seung Wook Kim Karsten Kreis Adela Barriuso Sanja Fidler Antonio Torralba 36 103 0 12 Jan 2022
Pose2Room: Understanding 3D Scenes from Human Activities Y. Nie Angela Dai Xiaoguang Han Matthias Nießner 29 14 0 01 Dec 2021
Shaping embodied agent behavior with activity-context priors from egocentric video Tushar Nagarajan Kristen Grauman EgoV LM&Ro 43 13 0 14 Oct 2021
Habitat-Matterport 3D Dataset (HM3D): 1000 Large-scale 3D Environments for Embodied AI Santhosh Kumar Ramakrishnan Aaron Gokaslan Erik Wijmans Oleksandr Maksymets Alexander Clegg ... Andrew Westbury Angel X. Chang Manolis Savva Yili Zhao Dhruv Batra 22 368 0 16 Sep 2021
Procedures as Programs: Hierarchical Control of Situated Agents through Natural Language Shuyan Zhou Pengcheng Yin Graham Neubig LM&Ro 14 1 0 16 Sep 2021
ObjectFolder: A Dataset of Objects with Implicit Visual, Auditory, and Tactile Representations Ruohan Gao Yen-Yu Chang Shivani Mall Li Fei-Fei Jiajun Wu 34 78 0 16 Sep 2021
Evaluating Continual Learning Algorithms by Generating 3D Virtual Environments Enrico Meloni Alessandro Betti Lapo Faggi Simone Marullo Matteo Tiezzi S. Melacci 35 4 0 16 Sep 2021
BEHAVIOR: Benchmark for Everyday Household Activities in Virtual, Interactive, and Ecological Environments S. Srivastava Chengshu Li Michael Lingelbach Roberto Martín-Martín Fei Xia ... C. Karen Liu Silvio Savarese H. Gweon Jiajun Wu Li Fei-Fei LM&Ro 151 157 0 06 Aug 2021
iGibson 2.0: Object-Centric Simulation for Robot Learning of Everyday Household Tasks Chengshu Li Fei Xia Roberto Martín-Martín Michael Lingelbach S. Srivastava ... Karen Liu H. Gweon Jiajun Wu Li Fei-Fei Silvio Savarese LM&Ro 168 223 0 06 Aug 2021
Communicative Learning with Natural Gestures for Embodied Navigation Agents with Human-in-the-Scene Qi Wu Cheng-Ju Wu Yixin Zhu Jungseock Joo 43 14 0 05 Aug 2021
ManiSkill: Generalizable Manipulation Skill Benchmark with Large-Scale Demonstrations Tongzhou Mu Z. Ling Fanbo Xiang Derek Yang Xuanlin Li Stone Tao Zhiao Huang Zhiwei Jia Hao Su 39 130 0 30 Jul 2021
Core Challenges in Embodied Vision-Language Planning Jonathan M Francis Nariaki Kitamura Felix Labelle Xiaopeng Lu Ingrid Navarro Jean Oh LM&Ro 47 45 0 26 Jun 2021
A Survey on Human-aware Robot Navigation Ronja Möller Antonino Furnari Sebastiano Battiato Aki Härmä G. Farinella 44 87 0 22 Jun 2021
3DB: A Framework for Debugging Computer Vision Models Guillaume Leclerc Hadi Salman Andrew Ilyas Sai H. Vemprala Logan Engstrom ... Pengchuan Zhang Shibani Santurkar Greg Yang Ashish Kapoor A. Madry 40 40 0 07 Jun 2021
Episodic Transformer for Vision-and-Language Navigation Alexander Pashevich Cordelia Schmid Chen Sun LM&Ro 43 193 0 13 May 2021
DriveGAN: Towards a Controllable High-Quality Neural Simulation S. Kim Jonah Philion Antonio Torralba Sanja Fidler 21 108 0 30 Apr 2021
Where Are You? Localization from Embodied Dialog Meera Hahn Jacob Krantz Dhruv Batra Devi Parikh James M. Rehg Stefan Lee Peter Anderson LM&Ro 22 27 0 16 Nov 2020
ElderSim: A Synthetic Data Generation Platform for Human Action Recognition in Eldercare Applications Hochul Hwang Cheongjae Jang Geonwoo Park Junghyun Cho Ig-Jae Kim 24 70 0 28 Oct 2020
ThreeDWorld: A Platform for Interactive Multi-Modal Physical Simulation Chuang Gan Jeremy Schwartz S. Alter Damian Mrowca Martin Schrimpf ... Antonio Torralba J. DiCarlo J. Tenenbaum Josh H. McDermott Daniel L. K. Yamins VGen 53 303 0 09 Jul 2020
SAPIEN: A SimulAted Part-based Interactive ENvironment Fanbo Xiang Yuzhe Qin Kaichun Mo Yikuan Xia Hao Zhu ... He-Nan Wang Li Yi Angel X. Chang Leonidas J. Guibas Hao Su 218 487 0 19 Mar 2020
Synthetic Humans for Action Recognition from Unseen Viewpoints Gül Varol Ivan Laptev Cordelia Schmid Andrew Zisserman 30 96 0 09 Dec 2019
IKEA Furniture Assembly Environment for Long-Horizon Complex Manipulation Tasks Youngwoon Lee E. Hu Zhengyu Yang Alexander Yin Joseph J. Lim 31 120 0 17 Nov 2019
Arena: A General Evaluation Platform and Building Toolkit for Multi-Agent Intelligence Yuhang Song Andrzej Wojcicki Thomas Lukasiewicz Jianyi Wang Abi Aryan Zhenghua Xu Mai Xu Zihan Ding Lianlong Wu AI4CE ELM 21 33 0 17 May 2019
Meta-Sim: Learning to Generate Synthetic Datasets Amlan Kar Aayush Prakash Ming-Yu Liu Eric Cameracci Justin Yuan Matt Rusiniak David Acuna Antonio Torralba Sanja Fidler 16 247 0 25 Apr 2019