Title
Sonicverse: A Multisensory Simulation Platform for Embodied Household Agents that See and Hear Ruohan Gao Hao Li Gokul Dharan Zhuzhu Wang Chengshu Li Fei Xia Silvio Savarese Li Fei-Fei Jiajun Wu 34 11 0 01 Jun 2023
Modeling Dynamic Environments with Scene Graph Memory Andrey Kurenkov Michael Lingelbach Tanmay Agarwal Emily Jin Chengshu Li Ruohan Zhang Li Fei-Fei Jiajun Wu Silvio Savarese Roberto Martín-Martín 31 11 0 27 May 2023
M-EMBER: Tackling Long-Horizon Mobile Manipulation via Factorized Domain Transfer Bohan Wu Roberto Martin-Martin Li Fei-Fei 31 12 0 23 May 2023
TidyBot: Personalized Robot Assistance with Large Language Models Jimmy Wu Rika Antonova Adam Kan Marion Lepert Andy Zeng Shuran Song Jeannette Bohg Szymon Rusinkiewicz Thomas Funkhouser LM&Ro 34 284 0 09 May 2023
Causal Policy Gradient for Whole-Body Mobile Manipulation Jiaheng Hu Peter Stone Roberto Martín-Martín 37 20 0 04 May 2023
A Control-Centric Benchmark for Video Prediction Stephen Tian Chelsea Finn Jiajun Wu 39 10 0 26 Apr 2023
Moving Forward by Moving Backward: Embedding Action Impact over Action Semantics Kuo-Hao Zeng Luca Weihs Roozbeh Mottaghi Ali Farhadi 32 3 0 24 Apr 2023
CabiNet: Scaling Neural Collision Detection for Object Rearrangement with Procedural Scene Generation Adithyavairavan Murali Arsalan Mousavian Clemens Eppner Adam Fishman D. Fox OCL 3DPC LM&Ro 17 22 0 18 Apr 2023
ARNOLD: A Benchmark for Language-Grounded Task Learning With Continuous States in Realistic 3D Scenes Ran Gong Jiangyong Huang Yizhou Zhao Haoran Geng Xiaofeng Gao ... Ziheng Zhou D. Terzopoulos Song-Chun Zhu Baoxiong Jia Siyuan Huang LM&Ro 42 45 0 09 Apr 2023
Embodied Concept Learner: Self-supervised Learning of Concepts and Mapping through Instruction Following Mingyu Ding Yan Xu Zhenfang Chen David D. Cox Ping Luo J. Tenenbaum Chuang Gan LM&Ro 56 21 0 07 Apr 2023
When Learning Is Out of Reach, Reset: Generalization in Autonomous Visuomotor Reinforcement Learning Zichen Zhang Luca Weihs OffRL 24 5 0 30 Mar 2023
Boosting Reinforcement Learning and Planning with Demonstrations: A Survey Tongzhou Mu H. Su OffRL 35 1 0 23 Mar 2023
Synthetic-to-Real Domain Adaptation for Action Recognition: A Dataset and Baseline Performances Arun V. Reddy Ketul Shah William Paul Rohita Mocharla Judy Hoffman Kapil D. Katyal Dinesh Manocha Celso M. de Melo Ramalingam Chellappa 26 17 0 17 Mar 2023
Why is That a Good or Not a Good Frying Pan? -- Knowledge Representation for Functions of Objects and Tools for Design Understanding, Improvement, and Generation Seng-Beng Ho 21 1 0 10 Mar 2023
Ditto in the House: Building Articulation Models of Indoor Scenes through Interactive Perception Cheng-Chun Hsu Zhenyu Jiang Yuke Zhu 38 31 0 02 Feb 2023
Distilling Internet-Scale Vision-Language Models into Embodied Agents T. Sumers Kenneth Marino Arun Ahuja Rob Fergus Ishita Dasgupta LM&Ro 28 24 0 29 Jan 2023
LEGO-Net: Learning Regular Rearrangements of Objects in Rooms Qiuhong Anna Wei Sijie Ding Jeong Joon Park Rahul Sajnani A. Poulenard Srinath Sridhar Leonidas J. Guibas DiffM 30 61 0 23 Jan 2023
Immersive Demonstrations are the Key to Imitation Learning Kelin Li Digby Chappell Nicolás Rojas 21 7 0 22 Jan 2023
Diffusion-based Generation, Optimization, and Planning in 3D Scenes Siyuan Huang Zan Wang Puhao Li Baoxiong Jia Tengyu Liu Yixin Zhu Wei Liang Song-Chun Zhu DiffM 64 199 0 15 Jan 2023
Orbit: A Unified Simulation Framework for Interactive Robot Learning Environments Mayank Mittal C. Yu Qinxi Yu Jingzhou Liu Nikita Rudin ... Ajay Mandlekar Buck Babich Gavriel State Marco Hutter Animesh Garg 36 170 0 10 Jan 2023
Human-in-the-loop Embodied Intelligence with Interactive Simulation Environment for Surgical Robot Learning Yonghao Long Wang Wei Tao Huang Yuehao Wang Qingxu Dou 34 32 0 01 Jan 2023
Objaverse: A Universe of Annotated 3D Objects Matt Deitke Dustin Schwenk Jordi Salvador Luca Weihs Oscar Michel Eli VanderBilt Ludwig Schmidt Kiana Ehsani Aniruddha Kembhavi Ali Farhadi 29 884 0 15 Dec 2022
OpenD: A Benchmark for Language-Driven Door and Drawer Opening Yizhou Zhao Qiaozi Gao Liang Qiu Govind Thattai Gaurav Sukhatme 26 5 0 10 Dec 2022
Self-Supervised Object Goal Navigation with In-Situ Finetuning So Yeon Min Yao-Hung Hubert Tsai Wei Ding Ali Farhadi Ruslan Salakhutdinov Yonatan Bisk Jian Zhang SSL 29 7 0 09 Dec 2022
A General Purpose Supervisory Signal for Embodied Agents Kunal Pratap Singh Jordi Salvador Luca Weihs Aniruddha Kembhavi SSL 26 3 0 01 Dec 2022
RCareWorld: A Human-centric Simulation World for Caregiving Robots Ruolin Ye Wenqiang Xu Haoyuan Fu Rajat Kumar Jenamani V. Nguyen Cewu Lu Katherine Dimitropoulou T. Bhattacharjee LM&Ro 25 39 0 19 Oct 2022
Retrospectives on the Embodied AI Workshop Matt Deitke Dhruv Batra Yonatan Bisk Tommaso Campari Angel X. Chang ... Jesse Thomason Alexander Toshev Joanne Truong Luca Weihs Jiajun Wu LM&Ro 37 51 0 13 Oct 2022
VIMA: General Robot Manipulation with Multimodal Prompts Yunfan Jiang Agrim Gupta Zichen Zhang Guanzhi Wang Yongqiang Dou Yanjun Chen Li Fei-Fei Anima Anandkumar Yuke Zhu Linxi Fan LM&Ro 28 335 0 06 Oct 2022
On the Learning Mechanisms in Physical Reasoning Shiqian Li Ke Wu Chi Zhang Yixin Zhu AI4CE 44 13 0 05 Oct 2022
WorldGen: A Large Scale Generative Simulator Chahat Deep Singh R. Kumari Cornelia Fermuller N. Sanket Yiannis Aloimonos 28 4 0 03 Oct 2022
Towards Multimodal Multitask Scene Understanding Models for Indoor Mobile Agents Yao-Hung Hubert Tsai Hanlin Goh Ali Farhadi Jian Zhang 19 1 0 27 Sep 2022
Active Particle Filter Networks: Efficient Active Localization in Continuous Action Spaces and Large Maps Daniel Honerkamp Suresh Guttikonda Abhinav Valada 27 2 0 20 Sep 2022
CH-MARL: A Multimodal Benchmark for Cooperative, Heterogeneous Multi-Agent Reinforcement Learning Vasu Sharma Prasoon Goyal Kaixiang Lin Govind Thattai Qiaozi Gao Gaurav Sukhatme 31 5 0 26 Aug 2022
Learning from Unlabeled 3D Environments for Vision-and-Language Navigation Shizhe Chen Pierre-Louis Guhur Makarand Tapaswi Cordelia Schmid Ivan Laptev 55 46 0 24 Aug 2022
Multimodal Generation of Novel Action Appearances for Synthetic-to-Real Recognition of Activities of Daily Living Zdravko Marinov David Schneider Alina Roitberg Rainer Stiefelhagen VGen 29 2 0 03 Aug 2022
BusyBot: Learning to Interact, Reason, and Plan in a BusyBoard Environment Zeyi Liu Zhenjia Xu Shuran Song 35 2 0 17 Jul 2022
Finding Fallen Objects Via Asynchronous Audio-Visual Integration Chuang Gan Yi Gu Siyuan Zhou Jeremy Schwartz S. Alter James Traer Dan Gutfreund J. Tenenbaum Josh H. McDermott Antonio Torralba 47 19 0 07 Jul 2022
Wireless Channel Prediction in Partially Observed Environments Mingsheng Yin Yaqi Hu Tommy Azzino Seongjoon Kang M. Mezzavilla S. Rangan 17 2 0 03 Jul 2022
A Survey on Active Simultaneous Localization and Mapping: State of the Art and New Frontiers Julio A. Placed Jared Strader Henry Carrillo Nikolay Atanasov Vadim Indelman Luca Carlone J. A. Castellanos 25 177 0 01 Jul 2022
Good Time to Ask: A Learning Framework for Asking for Help in Embodied Visual Navigation Jenny Zhang Samson Yu Jiafei Duan Cheston Tan 31 4 0 20 Jun 2022
VLMbench: A Compositional Benchmark for Vision-and-Language Manipulation Kai Zheng Xiaotong Chen Odest Chadwicke Jenkins Qing Guo LM&Ro CoGe 21 54 0 17 Jun 2022
ProcTHOR: Large-Scale Embodied AI Using Procedural Generation Matt Deitke Eli VanderBilt Alvaro Herrasti Luca Weihs Jordi Salvador ... Winson Han Eric Kolve Ali Farhadi Aniruddha Kembhavi Roozbeh Mottaghi LM&Ro 35 235 0 14 Jun 2022
BEHAVIOR in Habitat 2.0: Simulator-Independent Logical Task Description for Benchmarking Embodied AI Agents Ziang Liu Roberto Martín-Martín F. Xia Jiajun Wu Li Fei-Fei LM&Ro 14 0 0 13 Jun 2022
Factory: Fast Contact for Robotic Assembly Yashraj S. Narang Kier Storey Iretiayo Akinola Miles Macklin Philipp Reist ... Ádám Moravánszky Gavriel State Michelle Lu Ankur Handa D. Fox 32 74 0 07 May 2022
Multi-Robot Active Mapping via Neural Bipartite Graph Matching Kai Ye Siyan Dong Qingnan Fan He-Nan Wang Li Yi F. Xia Jue Wang Baoquan Chen 12 28 0 30 Mar 2022
DreamingV2: Reinforcement Learning with Discrete World Models without Reconstruction Masashi Okada T. Taniguchi 3DV OffRL 28 22 0 01 Mar 2022
Ditto: Building Digital Twins of Articulated Objects from Interaction Zhenyu Jiang Cheng-Chun Hsu Yuke Zhu 11 104 0 16 Feb 2022
Image-based Navigation in Real-World Environments via Multiple Mid-level Representations: Fusion Models, Benchmark and Efficient Evaluation Marco Rosano Antonino Furnari Luigi Gulino C. Santoro G. Farinella EgoV 44 5 0 02 Feb 2022
Learning to Act with Affordance-Aware Multimodal Neural SLAM Zhiwei Jia Kaixiang Lin Yizhou Zhao Qiaozi Gao Govind Thattai Gaurav Sukhatme LM&Ro 31 15 0 24 Jan 2022
Simple but Effective: CLIP Embeddings for Embodied AI Apoorv Khandelwal Luca Weihs Roozbeh Mottaghi Aniruddha Kembhavi VLM LM&Ro 44 217 0 18 Nov 2021