Mapping Instructions to Actions in 3D Environments with Visual Goal Prediction

4 September 2018

Papers citing "Mapping Instructions to Actions in 3D Environments with Visual Goal Prediction"

33 / 133 papers shown

Title
Human Instruction-Following with Deep Reinforcement Learning via Transfer-Learning from Text Felix Hill Soňa Mokrá Nathaniel Wong Tim Harley LM&Ro 24 81 0 19 May 2020
What is Learned in Visually Grounded Neural Syntax Acquisition Noriyuki Kojima Hadar Averbuch-Elor Alexander M. Rush Yoav Artzi 11 20 0 04 May 2020
Robust and Interpretable Grounding of Spatial References with Relation Networks Tsung-Yen Yang Andrew S. Lan Karthik Narasimham 27 12 0 02 May 2020
Beyond the Nav-Graph: Vision-and-Language Navigation in Continuous Environments Jacob Krantz Erik Wijmans Arjun Majumdar Dhruv Batra Stefan Lee 24 266 0 06 Apr 2020
Modulating Bottom-Up and Top-Down Visual Processing via Language-Conditional Filters .Ilker Kesen Ozan Arkan Can Erkut Erdem Aykut Erdem Deniz Yuret VLM 13 1 0 28 Mar 2020
Deep compositional robotic planners that follow natural language commands Yen-Ling Kuo Boris Katz Andrei Barbu LM&Ro 26 22 0 12 Feb 2020
Retouchdown: Adding Touchdown to StreetLearn as a Shareable Resource for Language Grounding Tasks in Street View Harsh Mehta Yoav Artzi Jason Baldridge Eugene Ie Piotr Wojciech Mirowski 14 25 0 10 Jan 2020
ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Tasks Mohit Shridhar Jesse Thomason Daniel Gordon Yonatan Bisk Winson Han Roozbeh Mottaghi Luke Zettlemoyer Dieter Fox LM&Ro 51 747 0 03 Dec 2019
Question-Conditioned Counterfactual Image Generation for VQA Jingjing Pan Yash Goyal Stefan Lee EgoV OOD 14 19 0 14 Nov 2019
A Narration-based Reward Shaping Approach using Grounded Natural Language Commands Nicholas R. Waytowich Sean L. Barton Vernon J. Lawhern Garrett A. Warnell OffRL 24 17 0 31 Oct 2019
Learning to Map Natural Language Instructions to Physical Quadcopter Control using Simulated Flight Valts Blukis Yannick Terme Eyvind Niklasson Ross A. Knepper Yoav Artzi 11 74 0 21 Oct 2019
HIGhER : Improving instruction following with Hindsight Generation for Experience Replay Geoffrey Cideron Mathieu Seurin Florian Strub Olivier Pietquin 32 37 0 21 Oct 2019
Executing Instructions in Situated Collaborative Interactions Alane Suhr Claudia Yan Jack Schluger Stanley Yu Hadi Khader Marwa Mouallem Iris Zhang Yoav Artzi 17 88 0 08 Oct 2019
RUN through the Streets: A New Dataset and Baseline Models for Realistic Urban Navigation Tzuf Paz-Argaman Reut Tsarfaty 19 18 0 19 Sep 2019
Help, Anna! Visual Navigation with Natural Multimodal Assistance via Retrospective Curiosity-Encouraging Imitation Learning Khanh Nguyen Hal Daumé LM&Ro EgoV 183 150 0 04 Sep 2019
Language Tasks and Language Games: On Methodology in Current Natural Language Processing Research David Schlangen 27 18 0 28 Aug 2019
Pre-Learning Environment Representations for Data-Efficient Neural Instruction Following David Gaddy Dan Klein 24 11 0 23 Jul 2019
Trends in Integration of Vision and Language Research: A Survey of Tasks, Datasets, and Methods Aditya Mogadala M. Kalimuthu Dietrich Klakow VLM 25 132 0 22 Jul 2019
General Evaluation for Instruction Conditioned Navigation using Dynamic Time Warping Gabriel Ilharco Vihan Jain Alexander Ku Eugene Ie Jason Baldridge 14 93 0 11 Jul 2019
Chasing Ghosts: Instruction Following as Bayesian State Tracking Peter Anderson Ayush Shrivastava Devi Parikh Dhruv Batra Stefan Lee 22 72 0 03 Jul 2019
Are You Looking? Grounding to Multiple Modalities in Vision-and-Language Navigation Ronghang Hu Daniel Fried Anna Rohrbach Dan Klein Trevor Darrell Kate Saenko 8 97 0 02 Jun 2019
Stay on the Path: Instruction Fidelity in Vision-and-Language Navigation Vihan Jain Gabriel Ilharco Alexander Ku Ashish Vaswani Eugene Ie Jason Baldridge LM&Ro 16 179 0 29 May 2019
Tactical Rewind: Self-Correction via Backtracking in Vision-and-Language Navigation Liyiming Ke Xiujun Li Yonatan Bisk Ari Holtzman Zhe Gan Jingjing Liu Jianfeng Gao Yejin Choi S. Srinivasa 36 167 0 06 Mar 2019
Embodied Multimodal Multitask Learning Devendra Singh Chaplot Lisa Lee Ruslan Salakhutdinov Devi Parikh Dhruv Batra LM&Ro 24 24 0 04 Feb 2019
Vision-based Navigation with Language-based Assistance via Imitation Learning with Indirect Intervention Khanh Nguyen Debadeepta Dey Chris Brockett W. Dolan LM&Ro 15 130 0 10 Dec 2018
Touchdown: Natural Language Navigation and Spatial Reasoning in Visual Street Environments Howard Chen Alane Suhr Dipendra Kumar Misra Noah Snavely Yoav Artzi 42 383 0 29 Nov 2018
Early Fusion for Goal Directed Robotic Vision Aaron Walsman Yonatan Bisk Saadia Gabriel Dipendra Kumar Misra Yoav Artzi Yejin Choi Dieter Fox 9 9 0 21 Nov 2018
Mapping Navigation Instructions to Continuous Control Actions with Position-Visitation Prediction Valts Blukis Dipendra Kumar Misra Ross A. Knepper Yoav Artzi 19 81 0 10 Nov 2018
Value-based Search in Execution Space for Mapping Instructions to Programs Dor Muhlgay Jonathan Herzig Jonathan Berant 25 6 0 02 Nov 2018
Shifting the Baseline: Single Modality Performance on Visual Navigation & QA Jesse Thomason Daniel Gordon Yonatan Bisk 31 75 0 01 Nov 2018
A Corpus for Reasoning About Natural Language Grounded in Photographs Alane Suhr Stephanie Zhou Ally Zhang Iris Zhang Huajun Bai Yoav Artzi LRM 39 589 0 01 Nov 2018
Speaker-Follower Models for Vision-and-Language Navigation Daniel Fried Ronghang Hu Volkan Cirik Anna Rohrbach Jacob Andreas Louis-Philippe Morency Taylor Berg-Kirkpatrick Kate Saenko Dan Klein Trevor Darrell LM&Ro LRM 260 498 0 07 Jun 2018
Understanding Early Word Learning in Situated Artificial Agents Felix Hill S. Clark Karl Moritz Hermann Phil Blunsom LM&Ro 19 32 0 26 Oct 2017