A General Purpose Supervisory Signal for Embodied Agents

1 December 2022

Papers citing "A General Purpose Supervisory Signal for Embodied Agents"

50 / 74 papers shown

Title
Rethinking Sim2Real: Lower Fidelity Simulation Leads to Higher Sim2Real Transfer in Navigation Joanne Truong M. Rudolph Naoki Yokoyama Sonia Chernova Dhruv Batra Akshara Rai 64 41 0 21 Jul 2022
ProcTHOR: Large-Scale Embodied AI Using Procedural Generation Matt Deitke Eli VanderBilt Alvaro Herrasti Luca Weihs Jordi Salvador ... Winson Han Eric Kolve Ali Farhadi Aniruddha Kembhavi Roozbeh Mottaghi LM&Ro 85 251 0 14 Jun 2022
Habitat-Web: Learning Embodied Object-Search Strategies from Human Demonstrations at Scale Ram Ramrakhya Eric Undersander Dhruv Batra Abhishek Das LM&Ro 109 116 0 07 Apr 2022
Continuous Scene Representations for Embodied AI S. Gadre Kiana Ehsani Shuran Song Roozbeh Mottaghi 77 47 0 31 Mar 2022
Object Manipulation via Visual Target Localization Kiana Ehsani Ali Farhadi Aniruddha Kembhavi Roozbeh Mottaghi LM&Ro 48 9 0 15 Mar 2022
Towards Disturbance-Free Visual Mobile Manipulation Tianwei Ni Kiana Ehsani Luca Weihs Jordi Salvador 65 9 0 17 Dec 2021
Simple but Effective: CLIP Embeddings for Embodied AI Apoorv Khandelwal Luca Weihs Roozbeh Mottaghi Aniruddha Kembhavi VLM LM&Ro 66 226 0 18 Nov 2021
iGibson 2.0: Object-Centric Simulation for Robot Learning of Everyday Household Tasks Chengshu Li Fei Xia Roberto Martín-Martín Michael Lingelbach S. Srivastava ... Karen Liu H. Gweon Jiajun Wu Li Fei-Fei Silvio Savarese LM&Ro 202 231 0 06 Aug 2021
Spatial-Temporal Transformer for Dynamic Scene Graph Generation Yuren Cong Wentong Liao H. Ackermann Bodo Rosenhahn M. Yang ViT 33 126 0 26 Jul 2021
Habitat 2.0: Training Home Assistants to Rearrange their Habitat Andrew Szot Alexander Clegg Eric Undersander Erik Wijmans Yili Zhao ... Z. Kira V. Koltun Jitendra Malik Manolis Savva Dhruv Batra LM&Ro 90 514 0 28 Jun 2021
Differentiable SLAM-net: Learning Particle SLAM for Visual Navigation Peter Karkus Shaojun Cai David Hsu 53 66 0 17 May 2021
ManipulaTHOR: A Framework for Visual Object Manipulation Kiana Ehsani Winson Han Alvaro Herrasti Eli VanderBilt Luca Weihs Eric Kolve Aniruddha Kembhavi Roozbeh Mottaghi LM&Ro 218 127 0 22 Apr 2021
GridToPix: Training Embodied Agents with Minimal Supervision Unnat Jain Iou-Jen Liu Svetlana Lazebnik Aniruddha Kembhavi Luca Weihs Alex Schwing 50 23 0 14 Apr 2021
Visual Room Rearrangement Luca Weihs Matt Deitke Aniruddha Kembhavi Roozbeh Mottaghi LM&Ro 53 138 0 30 Mar 2021
MultiON: Benchmarking Semantic Map Memory using Multi-Object Navigation Saim Wani Shivansh Patel Unnat Jain Angel X. Chang Manolis Savva 69 106 0 07 Dec 2020
Neural Scene Graphs for Dynamic Scenes Julian Ost Fahim Mannan Nils Thuerey Julian Knodt Felix Heide GNN OCL AI4CE 87 302 0 20 Nov 2020
Rearrangement: A Challenge for Embodied AI Dhruv Batra Angel X. Chang Sonia Chernova Andrew J. Davison Jia Deng ... Jitendra Malik Igor Mordatch Roozbeh Mottaghi Manolis Savva Hao Su LM&Ro 82 217 0 03 Nov 2020
AllenAct: A Framework for Embodied AI Research Luca Weihs Jordi Salvador Klemen Kotar Unnat Jain Kuo-Hao Zeng Roozbeh Mottaghi Aniruddha Kembhavi LM&Ro AI4CE 48 72 0 28 Aug 2020
Learning Object Relation Graph and Tentative Policy for Visual Navigation Heming Du Xin Yu Liang Zheng 61 129 0 21 Jul 2020
ThreeDWorld: A Platform for Interactive Multi-Modal Physical Simulation Chuang Gan Jeremy Schwartz S. Alter Damian Mrowca Martin Schrimpf ... Antonio Torralba J. DiCarlo J. Tenenbaum Josh H. McDermott Daniel L. K. Yamins VGen 124 309 0 09 Jul 2020
Auxiliary Tasks Speed Up Learning PointGoal Navigation Joel Ye Dhruv Batra Erik Wijmans Abhishek Das 3DPC EgoV 88 79 0 09 Jul 2020
Object Goal Navigation using Goal-Oriented Semantic Exploration Devendra Singh Chaplot Dhiraj Gandhi Abhinav Gupta Ruslan Salakhutdinov 87 513 0 01 Jul 2020
ObjectNav Revisited: On Evaluation of Embodied Agents Navigating to Objects Dhruv Batra Aaron Gokaslan Aniruddha Kembhavi Oleksandr Maksymets Roozbeh Mottaghi Manolis Savva Alexander Toshev Erik Wijmans 49 254 0 23 Jun 2020
Neural Topological SLAM for Visual Navigation Devendra Singh Chaplot Ruslan Salakhutdinov Abhinav Gupta Saurabh Gupta 85 294 0 25 May 2020
Bootstrap Latent-Predictive Representations for Multitask Reinforcement Learning Z. Guo Bernardo Avila-Pires Bilal Piot Jean-Bastien Grill Florent Altché Rémi Munos M. G. Azar BDL DRL SSL 165 142 0 30 Apr 2020
RoboTHOR: An Open Simulation-to-Real Embodied AI Platform Matt Deitke Winson Han Alvaro Herrasti Aniruddha Kembhavi Eric Kolve ... Eli VanderBilt Matthew Wallingford Luca Weihs Mark Yatskar Ali Farhadi LM&Ro 86 236 0 14 Apr 2020
Learning to Explore using Active Neural SLAM Devendra Singh Chaplot Dhiraj Gandhi Saurabh Gupta Abhinav Gupta Ruslan Salakhutdinov 54 513 0 10 Apr 2020
CURL: Contrastive Unsupervised Representations for Reinforcement Learning A. Srinivas Michael Laskin Pieter Abbeel SSL DRL OffRL 81 1,084 0 08 Apr 2020
Learning 3D Semantic Scene Graphs from 3D Indoor Reconstructions Johanna Wald Helisa Dhamo Nassir Navab Federico Tombari 3DV 3DPC 63 217 0 08 Apr 2020
Beyond the Nav-Graph: Vision-and-Language Navigation in Continuous Environments Jacob Krantz Erik Wijmans Arjun Majumdar Dhruv Batra Stefan Lee 71 270 0 06 Apr 2020
SAPIEN: A SimulAted Part-based Interactive ENvironment Fanbo Xiang Yuzhe Qin Kaichun Mo Yikuan Xia Hao Zhu ... He Wang Li Yi Angel X. Chang Leonidas Guibas Hao Su 269 502 0 19 Mar 2020
3D Dynamic Scene Graphs: Actionable Spatial Perception with Places, Objects, and Humans Antoni Rosinol Arjun Gupta Marcus Abate Jingang Shi Luca Carlone 79 194 0 15 Feb 2020
A Simple Framework for Contrastive Learning of Visual Representations Ting-Li Chen Simon Kornblith Mohammad Norouzi Geoffrey E. Hinton SSL 333 18,721 0 13 Feb 2020
Look, Listen, and Act: Towards Audio-Visual Embodied Navigation Chuang Gan Yiwei Zhang Jiajun Wu Boqing Gong J. Tenenbaum 52 138 0 25 Dec 2019
Action Genome: Actions as Composition of Spatio-temporal Scene Graphs Jingwei Ji Ranjay Krishna Li Fei-Fei Juan Carlos Niebles 68 344 0 15 Dec 2019
ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Tasks Mohit Shridhar Jesse Thomason Daniel Gordon Yonatan Bisk Winson Han Roozbeh Mottaghi Luke Zettlemoyer Dieter Fox LM&Ro 104 766 0 03 Dec 2019
DD-PPO: Learning Near-Perfect PointGoal Navigators from 2.5 Billion Frames Erik Wijmans Abhishek Kadian Ari S. Morcos Stefan Lee Irfan Essa Devi Parikh Manolis Savva Dhruv Batra 78 475 0 01 Nov 2019
3D Scene Graph: A Structure for Unified Semantics, 3D Space, and Camera Iro Armeni Zhi-Yang He JunYoung Gwak Amir Zamir Martin Fischer Jitendra Malik Silvio Savarese 3DV 3DPC 89 344 0 06 Oct 2019
Improving Sample Efficiency in Model-Free Reinforcement Learning from Images Denis Yarats Amy Zhang Ilya Kostrikov Brandon Amos Joelle Pineau Rob Fergus DRL 95 445 0 02 Oct 2019
Bayesian Relational Memory for Semantic Visual Navigation Yi Wu Yuxin Wu Aviv Tamar Stuart J. Russell Georgia Gkioxari Yuandong Tian BDL 93 105 0 10 Sep 2019
Holistic++ Scene Understanding: Single-view 3D Holistic Scene Parsing and Human Pose Estimation with Human-Object Interaction and Physical Commonsense Yixin Chen Siyuan Huang Tao Yuan Siyuan Qi Yixin Zhu Song-Chun Zhu 30 118 0 04 Sep 2019
SceneGraphNet: Neural Message Passing for 3D Indoor Scene Augmentation Yang Zhou Zachary While E. Kalogerakis 3DPC 51 95 0 25 Jul 2019
Shaping Belief States with Generative Environment Models for RL Karol Gregor Danilo Jimenez Rezende F. Besse Yan Wu Hamza Merzic Aaron van den Oord OffRL AI4CE 80 119 0 21 Jun 2019
Unsupervised State Representation Learning in Atari Ankesh Anand Evan Racah Sherjil Ozair Yoshua Bengio Marc-Alexandre Côté R. Devon Hjelm SSL 51 255 0 19 Jun 2019
SplitNet: Sim2Sim and Task2Task Transfer for Embodied Visual Navigation Daniel Gordon Abhishek Kadian Devi Parikh Judy Hoffman Dhruv Batra 54 75 0 18 May 2019
Embodied Question Answering in Photorealistic Environments with Point Cloud Perception Erik Wijmans Samyak Datta Oleksandr Maksymets Abhishek Das Georgia Gkioxari Stefan Lee Irfan Essa Devi Parikh Dhruv Batra 3DPC LM&Ro 69 167 0 06 Apr 2019
Habitat: A Platform for Embodied AI Research Manolis Savva Abhishek Kadian Oleksandr Maksymets Yili Zhao Erik Wijmans ... Jia-Wei Liu V. Koltun Jitendra Malik Devi Parikh Dhruv Batra LM&Ro 99 1,401 0 02 Apr 2019
Video Relationship Reasoning using Gated Spatio-Temporal Energy Graph Yao-Hung Hubert Tsai S. Divvala Louis-Philippe Morency Ruslan Salakhutdinov Ali Farhadi 53 103 0 25 Mar 2019
A Behavioral Approach to Visual Navigation with Graph Localization Networks Kevin Chen Juan Pablo de Vicente G. Sepulveda Fei Xia Á. Soto Nathan Tsoi Silvio Savarese GNN 46 100 0 01 Mar 2019
Neural Predictive Belief Representations Z. Guo M. G. Azar Bilal Piot Bernardo Avila-Pires Rémi Munos SSL 45 81 0 15 Nov 2018