Building Generalizable Agents with a Realistic and Rich 3D Environment

7 January 2018

Papers citing "Building Generalizable Agents with a Realistic and Rich 3D Environment"

50 / 225 papers shown

Title
Hierarchical and Partially Observable Goal-driven Policy Learning with Goals Relational Graph Xin Ye Yezhou Yang 27 22 0 01 Mar 2021
Unlocking Pixels for Reinforcement Learning via Implicit Attention K. Choromanski Deepali Jain Wenhao Yu Xingyou Song Jack Parker-Holder ... Aldo Pacchiano Anirban Santara Yunhao Tang Jie Tan Adrian Weller OffRL 25 3 0 08 Feb 2021
ArraMon: A Joint Navigation-Assembly Instruction Interpretation Task in Dynamic Environments Hyounghun Kim Abhaysinh Zala Graham Burri Hao Tan Joey Tianyi Zhou LM&Ro 19 16 0 15 Nov 2020
End-To-End Semi-supervised Learning for Differentiable Particle Filters Hao Wen Xiongjie Chen Georgios Papagiannis Conghui Hu Yunpeng Li 33 17 0 11 Nov 2020
Learning from THEODORE: A Synthetic Omnidirectional Top-View Indoor Dataset for Deep Transfer Learning Tobias Scheck Roman Seidel G. Hirtz 19 22 0 11 Nov 2020
Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understanding Mike Roberts Jason Ramapuram Anurag Ranjan Atulit Kumar Miguel Angel Bautista Nathan Paczan Russ Webb Joshua M. Susskind 43 368 0 04 Nov 2020
Unsupervised Domain Adaptation for Visual Navigation Shangda Li Devendra Singh Chaplot Yao-Hung Hubert Tsai Yue Wu Louis-Philippe Morency Ruslan Salakhutdinov EgoV 25 9 0 27 Oct 2020
On Embodied Visual Navigation in Real Environments Through Habitat Marco Rosano Antonino Furnari Luigi Gulino G. Farinella 14 18 0 26 Oct 2020
Visual Navigation in Real-World Indoor Environments Using End-to-End Deep Reinforcement Learning Jonáš Kulhánek Erik Derner Robert Babuška 23 39 0 21 Oct 2020
Watch-And-Help: A Challenge for Social Perception and Human-AI Collaboration Xavier Puig Tianmin Shu Shuang Li Zilin Wang Yuan-Hong Liao J. Tenenbaum Sanja Fidler Antonio Torralba LM&Ro 104 123 0 19 Oct 2020
Efficient Robotic Object Search via HIEM: Hierarchical Policy Learning with Intrinsic-Extrinsic Modeling Xin Ye Yezhou Yang 22 14 0 16 Oct 2020
Towards Target-Driven Visual Navigation in Indoor Scenes via Generative Imitation Learning Qiaoyun Wu Xiaoxi Gong Kai Xu Dinesh Manocha Jingxuan Dong Jun Wang 16 31 0 30 Sep 2020
Generative Language-Grounded Policy in Vision-and-Language Navigation with Bayes' Rule Shuhei Kurita Kyunghyun Cho LM&Ro 14 23 0 16 Sep 2020
Multimodal Aggregation Approach for Memory Vision-Voice Indoor Navigation with Meta-Learning Liqi Yan Dongfang Liu Yaoxian Song Changbin (Brad) Yu 14 14 0 01 Sep 2020
Next-Best View Policy for 3D Reconstruction Daryl Peralta Joel Casimiro A. M. Nilles Justine Aletta Aguilar Rowel Atienza R. Cajote 8 49 0 28 Aug 2020
Meta-Sim2: Unsupervised Learning of Scene Structure for Synthetic Data Generation Jeevan Devaranjan Amlan Kar Sanja Fidler 20 88 0 20 Aug 2020
OpenRooms: An End-to-End Open Framework for Photorealistic Indoor Scene Datasets Zhengqin Li Ting Yu S. Sang Sarah Wang Meng Song ... Hong-Xing Yu Kalyan Sunkavalli Milovs Havsan R. Ramamoorthi Manmohan Chandraker 3DV 28 84 0 25 Jul 2020
PackIt: A Virtual Environment for Geometric Planning Ankit Goyal Jia Deng 35 13 0 21 Jul 2020
Seeing the Un-Scene: Learning Amodal Semantic Maps for Room Navigation Medhini Narasimhan Erik Wijmans Xinlei Chen Trevor Darrell Dhruv Batra Devi Parikh Amanpreet Singh 20 56 0 20 Jul 2020
ThreeDWorld: A Platform for Interactive Multi-Modal Physical Simulation Chuang Gan Jeremy Schwartz S. Alter Damian Mrowca Martin Schrimpf ... Antonio Torralba J. DiCarlo J. Tenenbaum Josh H. McDermott Daniel L. K. Yamins VGen 53 303 0 09 Jul 2020
Learning to simulate complex scenes Zhenfeng Xue W. Mao Liang Zheng 3DV 14 6 0 25 Jun 2020
Human Instruction-Following with Deep Reinforcement Learning via Transfer-Learning from Text Felix Hill Soňa Mokrá Nathaniel Wong Tim Harley LM&Ro 19 81 0 19 May 2020
SurfelGAN: Synthesizing Realistic Sensor Data for Autonomous Driving Zhenpei Yang Yuning Chai Dragomir Anguelov Yin Zhou Pei Sun D. Erhan Sean M. Rafferty Henrik Kretzschmar 21 100 0 08 May 2020
Improving Target-driven Visual Navigation with Attention on 3D Spatial Relationships Yunlian Lv Ning Xie Yimin Shi Zijiao Wang H. Shen 19 0 0 29 Apr 2020
Spatial Action Maps for Mobile Manipulation Jimmy Wu Xingyuan Sun Andy Zeng Shuran Song Johnny Lee Szymon Rusinkiewicz Thomas Funkhouser 19 70 0 20 Apr 2020
Dark, Beyond Deep: A Paradigm Shift to Cognitive AI with Humanlike Common Sense Yixin Zhu Tao Gao Lifeng Fan Siyuan Huang Mark Edmonds ... Chi Zhang Siyuan Qi Ying Nian Wu J. Tenenbaum Song-Chun Zhu 24 128 0 20 Apr 2020
Zero-Shot Compositional Policy Learning via Language Grounding Tianshi Cao Jingkang Wang Yining Zhang S. Manivasagam LM&Ro 34 1 0 15 Apr 2020
RoboTHOR: An Open Simulation-to-Real Embodied AI Platform Matt Deitke Winson Han Alvaro Herrasti Aniruddha Kembhavi Eric Kolve ... Eli VanderBilt Matthew Wallingford Luca Weihs Mark Yatskar Ali Farhadi LM&Ro 29 231 0 14 Apr 2020
SAPIEN: A SimulAted Part-based Interactive ENvironment Fanbo Xiang Yuzhe Qin Kaichun Mo Yikuan Xia Hao Zhu ... He-Nan Wang Li Yi Angel X. Chang Leonidas J. Guibas Hao Su 218 487 0 19 Mar 2020
Vision-Dialog Navigation by Exploring Cross-modal Memory Yi Zhu Fengda Zhu Zhaohuan Zhan Bingqian Lin Jianbin Jiao Xiaojun Chang Xiaodan Liang VLM 32 49 0 15 Mar 2020
Environment-agnostic Multitask Learning for Natural Language Grounded Navigation Qing Guo Vihan Jain Eugene Ie William Yang Wang Zornitsa Kozareva Sujith Ravi LM&Ro 32 63 0 01 Mar 2020
Multiplicative Gaussian Particle Filter Xuan Su W. Lee Zhen Zhang 14 2 0 29 Feb 2020
From Seeing to Moving: A Survey on Learning for Visual Indoor Navigation (VIN) Xin Ye Yezhou Yang SSL 20 16 0 26 Feb 2020
Level Three Synthetic Fingerprint Generation André Brasil Vieira Wyzykowski Maurício Pamplona Segundo Rubisley de P. Lemes 28 26 0 05 Feb 2020
Exploiting Language Instructions for Interpretable and Compositional Reinforcement Learning Michiel van der Meer Matteo Pirotta Elia Bruni 14 1 0 13 Jan 2020
Learning to Move with Affordance Maps William Qi Ravi Teja Mullapudi Saurabh Gupta Deva Ramanan 16 35 0 08 Jan 2020
Reinforcement Learning-based Visual Navigation with Information-Theoretic Regularization Qiaoyun Wu Kai Xu Jun Wang Mingliang Xu Xiaoxi Gong Dinesh Manocha 6 30 0 09 Dec 2019
Simultaneous Mapping and Target Driven Navigation G. Georgakis Yimeng Li Jana Kosecka 17 16 0 18 Nov 2019
Vision-Language Navigation with Self-Supervised Auxiliary Reasoning Tasks Fengda Zhu Yi Zhu Xiaojun Chang Xiaodan Liang LRM 14 238 0 18 Nov 2019
Unsupervised Reinforcement Learning of Transferable Meta-Skills for Embodied Navigation Juncheng Li Qing Guo Siliang Tang Haizhou Shi Fei Wu Yueting Zhuang William Yang Wang SSL 30 68 0 18 Nov 2019
Language coverage and generalization in RNN-based continuous sentence embeddings for interacting agents Luca Herranz-Celotti Simon Brodeur Jean Rouat 22 0 0 05 Nov 2019
Influence-Based Multi-Agent Exploration Tonghan Wang Jianhao Wang Yi Wu Chongjie Zhang 16 137 0 12 Oct 2019
CATER: A diagnostic dataset for Compositional Actions and TEmporal Reasoning Rohit Girdhar Deva Ramanan 19 176 0 10 Oct 2019
CityLearn: Diverse Real-World Environments for Sample-Efficient Navigation Policy Learning Marvin Chancán Michael Milford SSL 22 5 0 10 Oct 2019
Synthetic Data for Deep Learning Sergey I. Nikolenko 46 348 0 25 Sep 2019
Learning Visuomotor Policies for Aerial Navigation Using Cross-Modal Representations Rogerio Bonatti Ratnesh Madaan Vibhav Vineet S. Scherer Ashish Kapoor SSL 23 39 0 16 Sep 2019
Bayesian Relational Memory for Semantic Visual Navigation Yi Wu Yuxin Wu Aviv Tamar Stuart J. Russell Georgia Gkioxari Yuandong Tian BDL 18 104 0 10 Sep 2019
Planning Beyond the Sensing Horizon Using a Learned Context M. Everett Justin Miller Jonathan P. How 16 15 0 24 Aug 2019
Training Deep Learning Models via Synthetic Data: Application in Unmanned Aerial Vehicles A. Kamilaris Corjan van den Brink S. Karatsiolis 11 15 0 18 Aug 2019
PHYRE: A New Benchmark for Physical Reasoning A. Bakhtin L. V. D. van der Maaten Justin Johnson Laura Gustafson Ross B. Girshick LRM 14 121 0 15 Aug 2019