Communicative Learning with Natural Gestures for Embodied Navigation Agents with Human-in-the-Scene

5 August 2021

Qi Wu

Papers citing "Communicative Learning with Natural Gestures for Embodied Navigation Agents with Human-in-the-Scene"

50 / 52 papers shown

Title
Individual vs. Joint Perception: a Pragmatic Model of Pointing as Communicative Smithian Helping Kaiwen Jiang Stephanie Stacy Chuyu Wei Adelpha Chan Federico Rossano Yixin Zhu Tao Gao 35 5 0 03 Jun 2021
Learning Triadic Belief Dynamics in Nonverbal Communication from Videos Lifeng Fan Shuwen Qiu Zilong Zheng Tao Gao Song-Chun Zhu Yixin Zhu 36 24 0 07 Apr 2021
ALFWorld: Aligning Text and Embodied Environments for Interactive Learning Mohit Shridhar Xingdi Yuan Marc-Alexandre Côté Yonatan Bisk Adam Trischler Matthew J. Hausknecht LM&Ro LLMAG 94 443 0 08 Oct 2020
AllenAct: A Framework for Embodied AI Research Luca Weihs Jordi Salvador Klemen Kotar Unnat Jain Kuo-Hao Zeng Roozbeh Mottaghi Aniruddha Kembhavi LM&Ro AI4CE 61 75 0 28 Aug 2020
ObjectNav Revisited: On Evaluation of Embodied Agents Navigating to Objects Dhruv Batra Aaron Gokaslan Aniruddha Kembhavi Oleksandr Maksymets Roozbeh Mottaghi Manolis Savva Alexander Toshev Erik Wijmans 57 260 0 23 Jun 2020
Dark, Beyond Deep: A Paradigm Shift to Cognitive AI with Humanlike Common Sense Yixin Zhu Tao Gao Lifeng Fan Siyuan Huang Mark Edmonds ... Chi Zhang Siyuan Qi Ying Nian Wu J. Tenenbaum Song-Chun Zhu 102 130 0 20 Apr 2020
Towards Learning a Generic Agent for Vision-and-Language Navigation via Pre-training Weituo Hao Chunyuan Li Xiujun Li Lawrence Carin Jianfeng Gao LM&Ro 90 280 0 25 Feb 2020
Look, Listen, and Act: Towards Audio-Visual Embodied Navigation Chuang Gan Yiwei Zhang Jiajun Wu Boqing Gong J. Tenenbaum 68 139 0 25 Dec 2019
ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Tasks Mohit Shridhar Jesse Thomason Daniel Gordon Yonatan Bisk Winson Han Roozbeh Mottaghi Luke Zettlemoyer Dieter Fox LM&Ro 120 779 0 03 Dec 2019
Vision-Language Navigation with Self-Supervised Auxiliary Reasoning Tasks Fengda Zhu Yi Zhu Xiaojun Chang Xiaodan Liang LRM 70 243 0 18 Nov 2019
Help, Anna! Visual Navigation with Natural Multimodal Assistance via Retrospective Curiosity-Encouraging Imitation Learning Khanh Nguyen Hal Daumé LM&Ro EgoV 218 151 0 04 Sep 2019
Vision-and-Dialog Navigation Jesse Thomason Michael Murray Maya Cakmak Luke Zettlemoyer LM&Ro 97 330 0 10 Jul 2019
Towards Social Artificial Intelligence: Nonverbal Social Signal Prediction in A Triadic Interaction Hanbyul Joo Tomas Simon M. Cikara Yaser Sheikh 65 94 0 10 Jun 2019
OK-VQA: A Visual Question Answering Benchmark Requiring External Knowledge Kenneth Marino Mohammad Rastegari Ali Farhadi Roozbeh Mottaghi 117 1,092 0 31 May 2019
Pushing the Envelope for RGB-based Dense 3D Hand Pose Estimation via Neural Rendering Seungryul Baek K. Kim Tae-Kyun Kim 3DH 80 215 0 08 Apr 2019
VRGym: A Virtual Testbed for Physical and Interactive AI Xu Xie Hangxin Liu Zhenliang Zhang Yuxing Qiu Feng Gao Siyuan Qi Yixin Zhu Song-Chun Zhu 44 27 0 02 Apr 2019
Habitat: A Platform for Embodied AI Research Manolis Savva Abhishek Kadian Oleksandr Maksymets Yili Zhao Erik Wijmans ... Jia-Wei Liu V. Koltun Jitendra Malik Devi Parikh Dhruv Batra LM&Ro 126 1,423 0 02 Apr 2019
Recursive Visual Attention in Visual Dialog Yulei Niu Hanwang Zhang Manli Zhang Jianhong Zhang Zhiwu Lu Ji-Rong Wen 88 119 0 06 Dec 2018
Touchdown: Natural Language Navigation and Spatial Reasoning in Visual Street Environments Howard Chen Alane Suhr Dipendra Kumar Misra Noah Snavely Yoav Artzi 84 390 0 29 Nov 2018
Reinforced Cross-Modal Matching and Self-Supervised Imitation Learning for Vision-Language Navigation Xin Eric Wang Qiuyuan Huang Asli Celikyilmaz Jianfeng Gao Dinghan Shen Yuan-fang Wang William Yang Wang Lei Zhang LM&Ro SSL 117 541 0 25 Nov 2018
Neural Modular Control for Embodied Question Answering Abhishek Das Georgia Gkioxari Stefan Lee Devi Parikh Dhruv Batra LM&Ro 189 130 0 26 Oct 2018
BabyAI: A Platform to Study the Sample Efficiency of Grounded Language Learning Maxime Chevalier-Boisvert Dzmitry Bahdanau Salem Lahlou Lucas Willems Chitwan Saharia Thien Huu Nguyen Yoshua Bengio ELM 90 241 0 18 Oct 2018
Visual Semantic Navigation using Scene Priors Wei Yang Xinyu Wang Ali Farhadi Abhinav Gupta Roozbeh Mottaghi LM&Ro 83 325 0 15 Oct 2018
Mapping Instructions to Actions in 3D Environments with Visual Goal Prediction Dipendra Kumar Misra Andrew Bennett Valts Blukis Eyvind Niklasson Max Shatkhin Yoav Artzi LM&Ro 84 188 0 04 Sep 2018
Gibson Env: Real-World Perception for Embodied Agents F. Xia Amir Zamir Zhi-Yang He Alexander Sax Jitendra Malik Silvio Savarese AI4CE LM&Ro 79 829 0 31 Aug 2018
On Evaluation of Embodied Navigation Agents Peter Anderson Angel X. Chang Devendra Singh Chaplot Alexey Dosovitskiy Saurabh Gupta ... Jana Kosecka Jitendra Malik Roozbeh Mottaghi Manolis Savva Amir Zamir 120 805 0 18 Jul 2018
VirtualHome: Simulating Household Activities via Programs Xavier Puig K. Ra Marko Boben Jiaman Li Tingwu Wang Sanja Fidler Antonio Torralba LM&Ro 100 500 0 19 Jun 2018
Speaker-Follower Models for Vision-and-Language Navigation Daniel Fried Ronghang Hu Volkan Cirik Anna Rohrbach Jacob Andreas Louis-Philippe Morency Taylor Berg-Kirkpatrick Kate Saenko Dan Klein Trevor Darrell LM&Ro LRM 319 505 0 07 Jun 2018
Visual Representations for Semantic Target Driven Navigation Arsalan Mousavian Alexander Toshev Marek Fiser Jana Kosecka Ayzaan Wahid James Davidson 70 202 0 15 May 2018
Interactive Grounded Language Acquisition and Generalization in a 2D World Haonan Yu Haichao Zhang Wenyuan Xu LLMAG LM&Ro 148 79 0 31 Jan 2018
CHALET: Cornell House Agent Learning Environment Claudia Yan Dipendra Kumar Misra Andrew Bennett Aaron Walsman Yonatan Bisk Yoav Artzi LM&Ro 76 93 0 23 Jan 2018
Building Generalizable Agents with a Realistic and Rich 3D Environment Yi Wu Yuxin Wu Georgia Gkioxari Yuandong Tian 3DV 135 339 0 07 Jan 2018
AI2-THOR: An Interactive 3D Environment for Visual AI Eric Kolve Roozbeh Mottaghi Winson Han Eli VanderBilt Luca Weihs ... Daniel Gordon Yuke Zhu Aniruddha Kembhavi Abhinav Gupta Ali Farhadi LM&Ro 84 1,111 0 14 Dec 2017
MINOS: Multimodal Indoor Simulator for Navigation in Complex Environments Manolis Savva Angel X. Chang Alexey Dosovitskiy Thomas Funkhouser V. Koltun 87 247 0 11 Dec 2017
IQA: Visual Question Answering in Interactive Environments Daniel Gordon Aniruddha Kembhavi Mohammad Rastegari Joseph Redmon Dieter Fox Ali Farhadi LM&Ro 93 391 0 09 Dec 2017
Embodied Question Answering Abhishek Das Samyak Datta Georgia Gkioxari Stefan Lee Devi Parikh Dhruv Batra LM&Ro 100 651 0 30 Nov 2017
HoME: a Household Multimodal Environment Simon Brodeur Ethan Perez Ankesh Anand Florian Golemo Luca Herranz-Celotti Florian Strub Jean Rouat Hugo Larochelle Aaron Courville LM&Ro 95 103 0 29 Nov 2017
Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environments Peter Anderson Qi Wu Damien Teney Jake Bruce Mark Johnson Niko Sünderhauf Ian Reid Stephen Gould Anton Van Den Hengel LM&Ro 108 1,324 0 20 Nov 2017
Matterport3D: Learning from RGB-D Data in Indoor Environments Angel X. Chang Angela Dai Thomas Funkhouser Maciej Halber Matthias Nießner Manolis Savva Shuran Song Andy Zeng Yinda Zhang 3DV 3DPC 208 1,917 0 18 Sep 2017
Proximal Policy Optimization Algorithms John Schulman Filip Wolski Prafulla Dhariwal Alec Radford Oleg Klimov OffRL 544 19,296 0 20 Jul 2017
Gated-Attention Architectures for Task-Oriented Language Grounding Devendra Singh Chaplot Kanthashree Mysore Sathyendra Rama Kumar Pasumarthi Dheeraj Rajagopal Ruslan Salakhutdinov LM&Ro 63 279 0 22 Jun 2017
Grounded Language Learning in a Simulated 3D World Karl Moritz Hermann Felix Hill Simon Green Fumin Wang Ryan Faulkner ... Denis Teplyashin Marcus Wainwright C. Apps Demis Hassabis Phil Blunsom LM&Ro 77 306 0 20 Jun 2017
First-Person Hand Action Benchmark with RGB-D Videos and 3D Hand Pose Annotations Guillermo Garcia-Hernando Shanxin Yuan Seungryul Baek Tae-Kyun Kim EgoV 75 489 0 08 Apr 2017
Cognitive Mapping and Planning for Visual Navigation Saurabh Gupta Varun Tolani James Davidson Sergey Levine Rahul Sukthankar Jitendra Malik 91 715 0 13 Feb 2017
DeepMind Lab Charlie Beattie Joel Z Leibo Denis Teplyashin Tom Ward Marcus Wainwright ... Stephen Gaffney Helen King Demis Hassabis Shane Legg Stig Petersen 52 241 0 12 Dec 2016
Show and Tell: Lessons learned from the 2015 MSCOCO Image Captioning Challenge Oriol Vinyals Alexander Toshev Samy Bengio D. Erhan 113 854 0 21 Sep 2016
Target-driven Visual Navigation in Indoor Scenes using Deep Reinforcement Learning Yuke Zhu Roozbeh Mottaghi Eric Kolve Joseph J. Lim Abhinav Gupta Li Fei-Fei Ali Farhadi VGen 73 1,527 0 16 Sep 2016
ViZDoom: A Doom-based AI Research Platform for Visual Reinforcement Learning Michal Kempka Marek Wydmuch Grzegorz Runc Jakub Toczek Wojciech Ja'skowski 82 700 0 06 May 2016
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 2.2K 194,510 0 10 Dec 2015
VQA: Visual Question Answering Aishwarya Agrawal Jiasen Lu Stanislaw Antol Margaret Mitchell C. L. Zitnick Dhruv Batra Devi Parikh CoGe 226 5,509 0 03 May 2015