Title
VideoGameBench: Can Vision-Language Models complete popular video games? Alex Zhang Thomas Griffiths Karthik Narasimhan Ofir Press VLM 46 0 0 23 May 2025
CaPo: Cooperative Plan Optimization for Efficient Embodied Multi-Agent Cooperation Jie Liu Pan Zhou Yingjun Du Ah-Hwee Tan Cees G. M. Snoek Jan-Jakob Sonke E. Gavves LLMAG 58 2 0 07 Nov 2024
Object-Centric Kinodynamic Planning for Nonprehensile Robot Rearrangement Manipulation Kejia Ren Gaotian Wang A. S. Morgan Lydia E. Kavraki Kaiyu Hang 79 1 0 30 Sep 2024
A Survey on Large Language Model-Based Game Agents Sihao Hu Tiansheng Huang Gaowen Liu Ramana Rao Kompella Gaowen Liu Selim Furkan Tekin Yichang Xu Zachary Yahn Ling Liu LLMAG LM&Ro AI4CE LM&MA 97 55 0 02 Apr 2024
SoftMAC: Differentiable Soft Body Simulation with Forecast-based Contact Model and Two-way Coupling with Articulated Rigid Bodies and Clothes Min Liu Gang Yang Siyuan Luo Lin Shao 48 3 0 06 Dec 2023
Building Cooperative Embodied Agents Modularly with Large Language Models Hongxin Zhang Weihua Du Jiaming Shan Qinhong Zhou Yilun Du J. Tenenbaum Tianmin Shu Chuang Gan LLMAG LM&Ro 85 162 0 05 Jul 2023
Grounding Physical Concepts of Objects and Events Through Dynamic Visual Reasoning Zhenfang Chen Jiayuan Mao Jiajun Wu Kwan-Yee K. Wong J. Tenenbaum Chuang Gan VGen 55 94 0 30 Mar 2021
Rearrangement: A Challenge for Embodied AI Dhruv Batra Angel X. Chang Sonia Chernova Andrew J. Davison Jia Deng ... Jitendra Malik Igor Mordatch Roozbeh Mottaghi Manolis Savva Hao Su LM&Ro 65 217 0 03 Nov 2020
Watch-And-Help: A Challenge for Social Perception and Human-AI Collaboration Xavier Puig Tianmin Shu Shuang Li Zilin Wang Yuan-Hong Liao J. Tenenbaum Sanja Fidler Antonio Torralba LM&Ro 137 124 0 19 Oct 2020
Integrated Task and Motion Planning Caelan Reed Garrett Rohan Chitnis Rachel Holladay Beomjoon Kim Tom Silver L. Kaelbling Tomás Lozano-Pérez 71 492 0 02 Oct 2020
Occupancy Anticipation for Efficient Exploration and Navigation Santhosh Kumar Ramakrishnan Ziad Al-Halah Kristen Grauman EgoV 3DPC 44 164 0 21 Aug 2020
ReLMoGen: Leveraging Motion Generation in Reinforcement Learning for Mobile Manipulation Fei Xia Chengshu Li Roberto Martín-Martín Or Litany Alexander Toshev Silvio Savarese 37 77 0 18 Aug 2020
ThreeDWorld: A Platform for Interactive Multi-Modal Physical Simulation Chuang Gan Jeremy Schwartz S. Alter Damian Mrowca Martin Schrimpf ... Antonio Torralba J. DiCarlo J. Tenenbaum Josh H. McDermott Daniel L. K. Yamins VGen 112 308 0 09 Jul 2020
Object Goal Navigation using Goal-Oriented Semantic Exploration Devendra Singh Chaplot Dhiraj Gandhi Abhinav Gupta Ruslan Salakhutdinov 83 506 0 01 Jul 2020
RoboTHOR: An Open Simulation-to-Real Embodied AI Platform Matt Deitke Winson Han Alvaro Herrasti Aniruddha Kembhavi Eric Kolve ... Eli VanderBilt Matthew Wallingford Luca Weihs Mark Yatskar Ali Farhadi LM&Ro 76 235 0 14 Apr 2020
Learning to Explore using Active Neural SLAM Devendra Singh Chaplot Dhiraj Gandhi Saurabh Gupta Abhinav Gupta Ruslan Salakhutdinov 41 510 0 10 Apr 2020
SAPIEN: A SimulAted Part-based Interactive ENvironment Fanbo Xiang Yuzhe Qin Kaichun Mo Yikuan Xia Hao Zhu ... He Wang Li Yi Angel X. Chang Leonidas Guibas Hao Su 232 496 0 19 Mar 2020
Look, Listen, and Act: Towards Audio-Visual Embodied Navigation Chuang Gan Yiwei Zhang Jiajun Wu Boqing Gong J. Tenenbaum 52 138 0 25 Dec 2019
ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Tasks Mohit Shridhar Jesse Thomason Daniel Gordon Yonatan Bisk Winson Han Roozbeh Mottaghi Luke Zettlemoyer Dieter Fox LM&Ro 79 760 0 03 Dec 2019
Meta-World: A Benchmark and Evaluation for Multi-Task and Meta Reinforcement Learning Tianhe Yu Deirdre Quillen Zhanpeng He Ryan Julian Avnish Narayan Hayden Shively Adithya Bellathur Karol Hausman Chelsea Finn Sergey Levine OffRL 203 1,145 0 24 Oct 2019
CLEVRER: CoLlision Events for Video REpresentation and Reasoning Kexin Yi Yuta Saito Yunzhu Li Pushmeet Kohli Jiajun Wu Antonio Torralba J. Tenenbaum NAI 76 465 0 03 Oct 2019
RLBench: The Robot Learning Benchmark & Learning Environment Stephen James Z. Ma David Rovick Arrojo Andrew J. Davison SSL VLM OffRL 93 537 0 26 Sep 2019
The Animal-AI Environment: Training and Testing Animal-Like Artificial Cognition Benjamin Beyret José Hernández-Orallo Lucy G. Cheke Marta Halina Murray Shanahan Matthew Crosby 31 35 0 12 Sep 2019
Habitat: A Platform for Embodied AI Research Manolis Savva Abhishek Kadian Oleksandr Maksymets Yili Zhao Erik Wijmans ... Jia-Wei Liu V. Koltun Jitendra Malik Devi Parikh Dhruv Batra LM&Ro 97 1,390 0 02 Apr 2019
Combining Optimal Control and Learning for Visual Navigation in Novel Environments Somil Bansal Varun Tolani Saurabh Gupta Jitendra Malik Claire Tomlin 32 162 0 06 Mar 2019
Learning Exploration Policies for Navigation Tao Chen Saurabh Gupta Abhinav Gupta EgoV 64 237 0 05 Mar 2019
Beauty and the Beast: Optimal Methods Meet Learning for Drone Racing Elia Kaufmann Mathias Gehrig Philipp Foehn René Ranftl Alexey Dosovitskiy V. Koltun Davide Scaramuzza 47 129 0 15 Oct 2018
Gibson Env: Real-World Perception for Embodied Agents F. Xia Amir Zamir Zhi-Yang He Alexander Sax Jitendra Malik Silvio Savarese AI4CE LM&Ro 64 819 0 31 Aug 2018
VirtualHome: Simulating Household Activities via Programs Xavier Puig K. Ra Marko Boben Jiaman Li Tingwu Wang Sanja Fidler Antonio Torralba LM&Ro 76 483 0 19 Jun 2018
Look Before You Leap: Bridging Model-Free and Model-Based Reinforcement Learning for Planned-Ahead Vision-and-Language Navigation Xin Eric Wang Wenhan Xiong Hongmin Wang William Yang Wang 56 200 0 21 Mar 2018
Active model learning and diverse action sampling for task and motion planning Zi Wang Caelan Reed Garrett L. Kaelbling Tomás Lozano-Pérez 61 81 0 02 Mar 2018
Semi-parametric Topological Memory for Navigation Nikolay Savinov Alexey Dosovitskiy V. Koltun 52 379 0 01 Mar 2018
Building Generalizable Agents with a Realistic and Rich 3D Environment Yi Wu Yuxin Wu Georgia Gkioxari Yuandong Tian 3DV 115 338 0 07 Jan 2018
AI2-THOR: An Interactive 3D Environment for Visual AI Eric Kolve Roozbeh Mottaghi Winson Han Eli VanderBilt Luca Weihs ... Daniel Gordon Yuke Zhu Aniruddha Kembhavi Abhinav Gupta Ali Farhadi LM&Ro 35 1,091 0 14 Dec 2017
IQA: Visual Question Answering in Interactive Environments Daniel Gordon Aniruddha Kembhavi Mohammad Rastegari Joseph Redmon Dieter Fox Ali Farhadi LM&Ro 61 388 0 09 Dec 2017
Embodied Question Answering Abhishek Das Samyak Datta Georgia Gkioxari Stefan Lee Devi Parikh Dhruv Batra LM&Ro 71 644 0 30 Nov 2017
Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environments Peter Anderson Qi Wu Damien Teney Jake Bruce Mark Johnson Niko Sünderhauf Ian Reid Stephen Gould Anton Van Den Hengel LM&Ro 79 1,299 0 20 Nov 2017
Matterport3D: Learning from RGB-D Data in Indoor Environments Angel X. Chang Angela Dai Thomas Funkhouser Maciej Halber Matthias Nießner Manolis Savva Shuran Song Andy Zeng Yinda Zhang 3DV 3DPC 114 1,880 0 18 Sep 2017
Proximal Policy Optimization Algorithms John Schulman Filip Wolski Prafulla Dhariwal Alec Radford Oleg Klimov OffRL 236 18,685 0 20 Jul 2017
Cognitive Mapping and Planning for Visual Navigation Saurabh Gupta Varun Tolani James Davidson Sergey Levine Rahul Sukthankar Jitendra Malik 54 713 0 13 Feb 2017
DeepMind Lab Charlie Beattie Joel Z Leibo Denis Teplyashin Tom Ward Marcus Wainwright ... Stephen Gaffney Helen King Demis Hassabis Shane Legg Stig Petersen 43 241 0 12 Dec 2016
Semantic Scene Completion from a Single Depth Image Shuran Song Feng Yu Andy Zeng Angel X. Chang Manolis Savva Thomas Funkhouser 3DV 62 1,235 0 28 Nov 2016
Learning to Navigate in Complex Environments Piotr Wojciech Mirowski Razvan Pascanu Fabio Viola Hubert Soyer Andy Ballard ... Ross Goroshin Laurent Sifre Koray Kavukcuoglu D. Kumaran R. Hadsell 70 876 0 11 Nov 2016
Target-driven Visual Navigation in Indoor Scenes using Deep Reinforcement Learning Yuke Zhu Roozbeh Mottaghi Eric Kolve Joseph J. Lim Abhinav Gupta Li Fei-Fei Ali Farhadi VGen 54 1,516 0 16 Sep 2016