Building Generalizable Agents with a Realistic and Rich 3D Environment

7 January 2018

Papers citing "Building Generalizable Agents with a Realistic and Rich 3D Environment"

45 / 45 papers shown

Title
HA-VLN: A Benchmark for Human-Aware Navigation in Discrete-Continuous Environments with Dynamic Multi-Human Interactions, Real-World Validation, and an Open Leaderboard Yifei Dong Fengyi Wu Qi He Heng Li Minghan Li ... Yuxuan Zhou Jingdong Sun Qi Dai Zhi-Qi Cheng Alexander G. Hauptmann LM&Ro 81 0 0 18 Mar 2025
MINOS: Multimodal Indoor Simulator for Navigation in Complex Environments Manolis Savva Angel X. Chang Alexey Dosovitskiy Thomas Funkhouser V. Koltun 81 247 0 11 Dec 2017
Embodied Question Answering Abhishek Das Samyak Datta Georgia Gkioxari Stefan Lee Devi Parikh Dhruv Batra LM&Ro 93 646 0 30 Nov 2017
HoME: a Household Multimodal Environment Simon Brodeur Ethan Perez Ankesh Anand Florian Golemo Luca Herranz-Celotti Florian Strub Jean Rouat Hugo Larochelle Aaron Courville LM&Ro 76 103 0 29 Nov 2017
Matterport3D: Learning from RGB-D Data in Indoor Environments Angel X. Chang Angela Dai Thomas Funkhouser Maciej Halber Matthias Nießner Manolis Savva Shuran Song Andy Zeng Yinda Zhang 3DV 3DPC 183 1,901 0 18 Sep 2017
StarCraft II: A New Challenge for Reinforcement Learning Oriol Vinyals T. Ewalds Sergey Bartunov Petko Georgiev A. Vezhnevets ... Anthony Brunasso David Lawrence Anders Ekermo J. Repp Rodney Tsing 76 874 0 16 Aug 2017
Grounding Language for Transfer in Deep Reinforcement Learning Karthik Narasimhan Regina Barzilay Tommi Jaakkola LM&Ro OffRL 65 25 0 01 Aug 2017
DARLA: Improving Zero-Shot Transfer in Reinforcement Learning I. Higgins Arka Pal Andrei A. Rusu Loic Matthey Christopher P. Burgess Alexander Pritzel M. Botvinick Charles Blundell Alexander Lerchner DRL 107 416 0 26 Jul 2017
ELF: An Extensive, Lightweight and Flexible Research Platform for Real-time Strategy Games Yuandong Tian Qucheng Gong Wenling Shang Yuxin Wu C. L. Zitnick OffRL 53 126 0 04 Jul 2017
Gated-Attention Architectures for Task-Oriented Language Grounding Devendra Singh Chaplot Kanthashree Mysore Sathyendra Rama Kumar Pasumarthi Dheeraj Rajagopal Ruslan Salakhutdinov LM&Ro 53 279 0 22 Jun 2017
Grounded Language Learning in a Simulated 3D World Karl Moritz Hermann Felix Hill Simon Green Fumin Wang Ryan Faulkner ... Denis Teplyashin Marcus Wainwright C. Apps Demis Hassabis Phil Blunsom LM&Ro 49 306 0 20 Jun 2017
Zero-Shot Task Generalization with Multi-Task Deep Reinforcement Learning Junhyuk Oh Satinder Singh Honglak Lee Pushmeet Kohli OffRL 133 269 0 15 Jun 2017
Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environments Ryan J. Lowe Yi Wu Aviv Tamar J. Harb Pieter Abbeel Igor Mordatch 140 4,485 0 07 Jun 2017
ParlAI: A Dialog Research Software Platform Alexander H. Miller Will Feng Adam Fisch Jiasen Lu Dhruv Batra Antoine Bordes Devi Parikh Jason Weston 75 376 0 18 May 2017
Curiosity-driven Exploration by Self-supervised Prediction Deepak Pathak Pulkit Agrawal Alexei A. Efros Trevor Darrell LRM SSL 108 2,437 0 15 May 2017
Learning to Fly by Crashing Dhiraj Gandhi Lerrel Pinto Abhinav Gupta SSL 89 276 0 19 Apr 2017
Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real World Joshua Tobin Rachel Fong Alex Ray Jonas Schneider Wojciech Zaremba Pieter Abbeel 253 2,966 0 20 Mar 2017
Learning Cooperative Visual Dialog Agents with Deep Reinforcement Learning Abhishek Das Satwik Kottur J. M. F. Moura Stefan Lee Dhruv Batra OffRL 110 425 0 20 Mar 2017
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks Chelsea Finn Pieter Abbeel Sergey Levine OOD 823 11,909 0 09 Mar 2017
Neural Map: Structured Memory for Deep Reinforcement Learning Emilio Parisotto Ruslan Salakhutdinov 73 260 0 27 Feb 2017
Cognitive Mapping and Planning for Visual Navigation Saurabh Gupta Varun Tolani James Davidson Sergey Levine Rahul Sukthankar Jitendra Malik 86 714 0 13 Feb 2017
Generalizing Skills with Semi-Supervised Reinforcement Learning Chelsea Finn Tianhe Yu Justin Fu Pieter Abbeel Sergey Levine OffRL SSL 84 69 0 01 Dec 2016
Semantic Scene Completion from a Single Depth Image Shuran Song Feng Yu Andy Zeng Angel X. Chang Manolis Savva Thomas Funkhouser 3DV 81 1,243 0 28 Nov 2016
Reinforcement Learning with Unsupervised Auxiliary Tasks Max Jaderberg Volodymyr Mnih Wojciech M. Czarnecki Tom Schaul Joel Z Leibo David Silver Koray Kavukcuoglu SSL 101 1,228 0 16 Nov 2016
CAD2RL: Real Single-Image Flight without a Single Real Image Fereshteh Sadeghi Sergey Levine SSL 311 817 0 13 Nov 2016
Learning to Navigate in Complex Environments Piotr Wojciech Mirowski Razvan Pascanu Fabio Viola Hubert Soyer Andy Ballard ... Ross Goroshin Laurent Sifre Koray Kavukcuoglu D. Kumaran R. Hadsell 95 880 0 11 Nov 2016
RL $^2$ : Fast Reinforcement Learning via Slow Reinforcement Learning Yan Duan John Schulman Xi Chen Peter L. Bartlett Ilya Sutskever Pieter Abbeel OffRL 96 1,019 0 09 Nov 2016
Modular Multitask Reinforcement Learning with Policy Sketches Jacob Andreas Dan Klein Sergey Levine OffRL 142 461 0 06 Nov 2016
Categorical Reparameterization with Gumbel-Softmax Eric Jang S. Gu Ben Poole BDL 334 5,364 0 03 Nov 2016
TorchCraft: a Library for Machine Learning Research on Real-Time Strategy Games Gabriel Synnaeve Nantas Nardelli Alex Auvolat Soumith Chintala Timothée Lacroix Zeming Lin Florian Richoux Nicolas Usunier GNN 50 105 0 01 Nov 2016
Sim-to-Real Robot Learning from Pixels with Progressive Nets Andrei A. Rusu Matej Vecerík Thomas Rothörl N. Heess Razvan Pascanu R. Hadsell 80 533 0 13 Oct 2016
Transfer from Simulation to Real World through Learning Deep Inverse Dynamics Model Paul Christiano Zain Shah Igor Mordatch Jonas Schneider T. Blackwell Joshua Tobin Pieter Abbeel Wojciech Zaremba PINN 59 250 0 11 Oct 2016
Towards Cognitive Exploration through Deep Reinforcement Learning for Mobile Robots L. Tai Ming-Yuan Liu 56 103 0 06 Oct 2016
Target-driven Visual Navigation in Indoor Scenes using Deep Reinforcement Learning Yuke Zhu Roozbeh Mottaghi Eric Kolve Joseph J. Lim Abhinav Gupta Li Fei-Fei Ali Farhadi VGen 68 1,524 0 16 Sep 2016
Gated-Attention Readers for Text Comprehension Bhuwan Dhingra Hanxiao Liu Zhilin Yang William W. Cohen Ruslan Salakhutdinov 68 417 0 05 Jun 2016
ViZDoom: A Doom-based AI Research Platform for Visual Reinforcement Learning Michal Kempka Marek Wydmuch Grzegorz Runc Jakub Toczek Wojciech Ja'skowski 66 697 0 06 May 2016
Value Iteration Networks Aviv Tamar Yi Wu G. Thomas Sergey Levine Pieter Abbeel 76 653 0 09 Feb 2016
Asynchronous Methods for Deep Reinforcement Learning Volodymyr Mnih Adria Puigdomenech Badia M. Berk Mirza Alex Graves Timothy Lillicrap Tim Harley David Silver Koray Kavukcuoglu 197 8,859 0 04 Feb 2016
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 2.2K 194,020 0 10 Dec 2015
Learning Continuous Control Policies by Stochastic Value Gradients N. Heess Greg Wayne David Silver Timothy Lillicrap Yuval Tassa Tom Erez 97 560 0 30 Oct 2015
Continuous control with deep reinforcement learning Timothy Lillicrap Jonathan J. Hunt Alexander Pritzel N. Heess Tom Erez Yuval Tassa David Silver Daan Wierstra 320 13,248 0 09 Sep 2015
End-to-End Training of Deep Visuomotor Policies Sergey Levine Chelsea Finn Trevor Darrell Pieter Abbeel BDL 311 3,437 0 02 Apr 2015
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 1.8K 150,115 0 22 Dec 2014
ImageNet Large Scale Visual Recognition Challenge Olga Russakovsky Jia Deng Hao Su J. Krause S. Satheesh ... A. Karpathy A. Khosla Michael S. Bernstein Alexander C. Berg Li Fei-Fei VLM ObjD 1.7K 39,547 0 01 Sep 2014
The Arcade Learning Environment: An Evaluation Platform for General Agents Marc G. Bellemare Yavar Naddaf J. Veness Michael Bowling 117 3,006 0 19 Jul 2012