A modular vision language navigation and manipulation framework for long horizon compositional tasks in indoor environment

19 January 2021

Papers citing "A modular vision language navigation and manipulation framework for long horizon compositional tasks in indoor environment"

33 / 33 papers shown

Title
A Persistent Spatial Semantic Representation for High-level Natural Language Instruction Execution Valts Blukis Chris Paxton Dieter Fox Animesh Garg Yoav Artzi LM&Ro 236 135 0 12 Jul 2021
Hierarchical Task Learning from Language Instructions with Unified Transformers and Self-Monitoring Yichi Zhang J. Chai 30 78 0 07 Jun 2021
AdaBins: Depth Estimation using Adaptive Bins S. Bhat Ibraheem Alhashim Peter Wonka 3DV MDE ViT 77 845 0 28 Nov 2020
Learning to Explore using Active Neural SLAM Devendra Singh Chaplot Dhiraj Gandhi Saurabh Gupta Abhinav Gupta Ruslan Salakhutdinov 27 510 0 10 Apr 2020
Vision-Dialog Navigation by Exploring Cross-modal Memory Yi Zhu Fengda Zhu Zhaohuan Zhan Bingqian Lin Jianbin Jiao Xiaojun Chang Xiaodan Liang VLM 45 49 0 15 Mar 2020
ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Tasks Mohit Shridhar Jesse Thomason Daniel Gordon Yonatan Bisk Winson Han Roozbeh Mottaghi Luke Zettlemoyer Dieter Fox LM&Ro 73 758 0 03 Dec 2019
Chasing Ghosts: Instruction Following as Bayesian State Tracking Peter Anderson Ayush Shrivastava Devi Parikh Dhruv Batra Stefan Lee 37 73 0 03 Jul 2019
Cross-Modal Self-Attention Network for Referring Image Segmentation Linwei Ye Mrigank Rochan Zhi Liu Yang Wang EgoV 15 472 0 09 Apr 2019
CANet: Class-Agnostic Segmentation Networks with Iterative Refinement and Attentive Few-Shot Learning Chi Zhang Guosheng Lin Fayao Liu Rui Yao Chunhua Shen VLM SSeg 53 540 0 06 Mar 2019
A Behavioral Approach to Visual Navigation with Graph Localization Networks Kevin Chen Juan Pablo de Vicente G. Sepulveda Fei Xia Á. Soto Nathan Tsoi Silvio Savarese GNN 38 100 0 01 Mar 2019
BERT for Joint Intent Classification and Slot Filling Qian Chen Zhu Zhuo Wen Wang VLM 38 551 0 28 Feb 2019
Reinforced Cross-Modal Matching and Self-Supervised Imitation Learning for Vision-Language Navigation Xin Eric Wang Qiuyuan Huang Asli Celikyilmaz Jianfeng Gao Dinghan Shen Yuan-fang Wang William Yang Wang Lei Zhang LM&Ro SSL 58 534 0 25 Nov 2018
Translating Navigation Instructions in Natural Language to a High-Level Plan for Behavioral Robot Navigation Xiaoxue Zang Ashwini Pokle Nathan Tsoi Kevin Chen Juan Carlos Niebles Á. Soto Silvio Savarese LM&Ro 24 30 0 24 Sep 2018
Mapping Instructions to Actions in 3D Environments with Visual Goal Prediction Dipendra Kumar Misra Andrew Bennett Valts Blukis Eyvind Niklasson Max Shatkhin Yoav Artzi LM&Ro 56 186 0 04 Sep 2018
Gated Path Planning Networks Lisa Lee Emilio Parisotto Devendra Singh Chaplot Eric Xing Ruslan Salakhutdinov 98 81 0 17 Jun 2018
Scheduled Policy Optimization for Natural Language Communication with Intelligent Agents Wenhan Xiong Xiaoxiao Guo Mo Yu Shiyu Chang Bowen Zhou William Yang Wang LLMAG OffRL 41 7 0 16 Jun 2018
Situated Mapping of Sequential Instructions to Actions with Single-step Reward Observation Alane Suhr Yoav Artzi 31 33 0 25 May 2018
Look Before You Leap: Bridging Model-Free and Model-Based Reinforcement Learning for Planned-Ahead Vision-and-Language Navigation Xin Eric Wang Wenhan Xiong Hongmin Wang William Yang Wang 53 200 0 21 Mar 2018
AI2-THOR: An Interactive 3D Environment for Visual AI Eric Kolve Roozbeh Mottaghi Winson Han Eli VanderBilt Luca Weihs ... Daniel Gordon Yuke Zhu Aniruddha Kembhavi Abhinav Gupta Ali Farhadi LM&Ro 32 1,091 0 14 Dec 2017
Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environments Peter Anderson Qi Wu Damien Teney Jake Bruce Mark Johnson Niko Sünderhauf Ian Reid Stephen Gould Anton Van Den Hengel LM&Ro 71 1,299 0 20 Nov 2017
End-to-End Navigation in Unknown Environments using Neural Networks Arbaaz Khan Clark Zhang Nikolay Atanasov Konstantinos Karydis Daniel D. Lee Vijay Kumar 21 7 0 24 Jul 2017
Neural SLAM: Learning to Explore with External Memory Jingwei Zhang L. Tai Ming-Yuan Liu Joschka Boedecker Wolfram Burgard 59 71 0 29 Jun 2017
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 341 129,831 0 12 Jun 2017
Mapping Instructions and Visual Observations to Actions with Reinforcement Learning Dipendra Kumar Misra John Langford Yoav Artzi 52 247 0 28 Apr 2017
PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation C. Qi Hao Su Kaichun Mo Leonidas Guibas 3DH 3DPC 3DV PINN 385 14,191 0 02 Dec 2016
Bidirectional Attention Flow for Machine Comprehension Minjoon Seo Aniruddha Kembhavi Ali Farhadi Hannaneh Hajishirzi 105 2,088 0 05 Nov 2016
Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation Yonghui Wu M. Schuster Zhiwen Chen Quoc V. Le Mohammad Norouzi ... Alex Rudnick Oriol Vinyals G. Corrado Macduff Hughes J. Dean AIMat 788 6,768 0 26 Sep 2016
Dynamic Memory Networks for Visual and Textual Question Answering Caiming Xiong Stephen Merity R. Socher 49 753 0 04 Mar 2016
Value Iteration Networks Aviv Tamar Yi Wu G. Thomas Sergey Levine Pieter Abbeel 54 650 0 09 Feb 2016
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 1.2K 192,638 0 10 Dec 2015
What to talk about and how? Selective Generation using LSTMs with Coarse-to-Fine Alignment Hongyuan Mei Joey Tianyi Zhou Matthew R. Walter 44 289 0 02 Sep 2015
Listen, Attend, and Walk: Neural Mapping of Navigational Instructions to Action Sequences Hongyuan Mei Joey Tianyi Zhou Matthew R. Walter LM&Ro 61 242 0 12 Jun 2015
U-Net: Convolutional Networks for Biomedical Image Segmentation Olaf Ronneberger Philipp Fischer Thomas Brox SSeg 3DV 989 76,547 0 18 May 2015