Listen, Attend, and Walk: Neural Mapping of Navigational Instructions to Action Sequences

12 June 2015

Papers citing "Listen, Attend, and Walk: Neural Mapping of Navigational Instructions to Action Sequences"

38 / 38 papers shown

Title
Combinatorial Optimization via LLM-driven Iterated Fine-tuning Pranjal Awasthi Sreenivas Gollapudi Ravi Kumar Kamesh Munagala 68 0 0 10 Mar 2025
BAKU: An Efficient Transformer for Multi-Task Policy Learning Siddhant Haldar Zhuoran Peng Lerrel Pinto OffRL 44 28 0 11 Jun 2024
Aspect-based Sentiment Evaluation of Chess Moves (ASSESS): an NLP-based Method for Evaluating Chess Strategies from Textbooks Haifa Alrdahi R. Batista-Navarro 47 0 0 10 May 2024
Automated Action Model Acquisition from Narrative Texts RUIQI LI Leyang Cui Songtuan Lin P. Haslum 23 2 0 17 Jul 2023
Conceptual Reinforcement Learning for Language-Conditioned Tasks Shaohui Peng Xingui Hu Rui Zhang Jiaming Guo Qi Yi Rui Chen Zidong Du Ling Li Qi Guo Yunji Chen OffRL 41 8 0 09 Mar 2023
A New Path: Scaling Vision-and-Language Navigation with Synthetic Instructions and Imitation Learning Aishwarya Kamath Peter Anderson Su Wang Jing Yu Koh Alexander Ku Austin Waters Yinfei Yang Jason Baldridge Zarana Parekh LM&Ro 22 45 0 06 Oct 2022
LM-Nav: Robotic Navigation with Large Pre-Trained Models of Language, Vision, and Action Dhruv Shah B. Osinski Brian Ichter Sergey Levine LM&Ro 158 437 0 10 Jul 2022
Inferring Rewards from Language in Context Jessy Lin Daniel Fried Dan Klein Anca Dragan LM&Ro 29 54 0 05 Apr 2022
EnvEdit: Environment Editing for Vision-and-Language Navigation Jialu Li Hao Tan Joey Tianyi Zhou 31 80 0 29 Mar 2022
Learning Invariable Semantical Representation from Language for Extensible Policy Generalization Yihan Li Jinsheng Ren Tianrun Xu Tianren Zhang Haichuan Gao Feng Chen 21 1 0 26 Jan 2022
Learning Language-Conditioned Robot Behavior from Offline Data and Crowd-Sourced Annotation Suraj Nair E. Mitchell Kevin Chen Brian Ichter Silvio Savarese Chelsea Finn LM&Ro OffRL 37 154 0 02 Sep 2021
GPT3-to-plan: Extracting plans from text using GPT-3 Alberto Olmo S. Sreedharan S. Kambhampati 18 45 0 14 Jun 2021
Language Understanding for Field and Service Robots in a Priori Unknown Environments Matthew R. Walter Siddharth Patki Andrea F. Daniele E. Fahnestock Felix Duvallet Sachithra Hemachandra Jean Oh A. Stentz Nicholas Roy T. Howard LM&Ro 25 8 0 21 May 2021
Towards Navigation by Reasoning over Spatial Configurations Yue Zhang Quan Guo Parisa Kordjamshidi LLMAG 31 17 0 14 May 2021
Episodic Transformer for Vision-and-Language Navigation Alexander Pashevich Cordelia Schmid Chen Sun LM&Ro 43 193 0 13 May 2021
Diagnosing Vision-and-Language Navigation: What Really Matters Wanrong Zhu Yuankai Qi P. Narayana Kazoo Sone Sugato Basu Qing Guo Qi Wu Miguel P. Eckstein Luu Anh Tuan LM&Ro 27 50 0 30 Mar 2021
Synthesis of Compositional Animations from Textual Descriptions Anindita Ghosh N. Cheema Cennet Oguz Christian Theobalt P. Slusallek 31 170 0 26 Mar 2021
Structured Scene Memory for Vision-Language Navigation Hanqing Wang Wenguan Wang Wei Liang Caiming Xiong Jianbing Shen LM&Ro 32 114 0 05 Mar 2021
Interactive Learning from Activity Description Khanh Nguyen Dipendra Kumar Misra Robert Schapire Miroslav Dudík Patrick Shafto 47 34 0 13 Feb 2021
Spoken Language Interaction with Robots: Research Issues and Recommendations, Report from the NSF Future Directions Workshop M. Marge C. Espy-Wilson Roger K. Moore 26 78 0 11 Nov 2020
Sim-to-Real Transfer for Vision-and-Language Navigation Peter Anderson Ayush Shrivastava Joanne Truong Arjun Majumdar Devi Parikh Dhruv Batra Stefan Lee LM&Ro 36 106 0 07 Nov 2020
Compositional Networks Enable Systematic Generalization for Grounded Language Understanding Yen-Ling Kuo Boris Katz Andrei Barbu 34 22 0 06 Aug 2020
From SPMRL to NMRL: What Did We Learn (and Unlearn) in a Decade of Parsing Morphologically-Rich Languages (MRLs)? Reut Tsarfaty Dan Bareket Stav Klein Amit Seker 16 39 0 04 May 2020
A Benchmark for Systematic Generalization in Grounded Language Understanding Laura Ruis Jacob Andreas Marco Baroni Diane Bouchacourt Brenden M. Lake 13 138 0 11 Mar 2020
Tactical Rewind: Self-Correction via Backtracking in Vision-and-Language Navigation Liyiming Ke Xiujun Li Yonatan Bisk Ari Holtzman Zhe Gan Jingjing Liu Jianfeng Gao Yejin Choi S. Srinivasa 36 166 0 06 Mar 2019
Learning To Follow Directions in Street View Karl Moritz Hermann Mateusz Malinowski Piotr Wojciech Mirowski Andras Banki-Horvath Keith Anderson R. Hadsell SSL 21 66 0 01 Mar 2019
BabyAI: A Platform to Study the Sample Efficiency of Grounded Language Learning Maxime Chevalier-Boisvert Dzmitry Bahdanau Salem Lahlou Lucas Willems Chitwan Saharia Thien Huu Nguyen Yoshua Bengio ELM 33 232 0 18 Oct 2018
Visual Semantic Navigation using Scene Priors Wei Yang Xinyu Wang Ali Farhadi Abhinav Gupta Roozbeh Mottaghi LM&Ro 33 320 0 15 Oct 2018
VirtualHome: Simulating Household Activities via Programs Xavier Puig K. Ra Marko Boben Jiaman Li Tingwu Wang Sanja Fidler Antonio Torralba LM&Ro 30 477 0 19 Jun 2018
Learning to Understand Goal Specifications by Modelling Reward Dzmitry Bahdanau Felix Hill Jan Leike Edward Hughes Seyedarian Hosseini Pushmeet Kohli Edward Grefenstette 24 157 0 05 Jun 2018
FollowNet: Robot Navigation by Following Natural Language Directions with Deep Reinforcement Learning Pararth Shah Marek Fiser Aleksandra Faust J. Kew Dilek Z. Hakkani-Tür 19 52 0 16 May 2018
Look Before You Leap: Bridging Model-Free and Model-Based Reinforcement Learning for Planned-Ahead Vision-and-Language Navigation Xin Eric Wang Wenhan Xiong Hongmin Wang William Yang Wang 33 198 0 21 Mar 2018
Efficient Large-Scale Multi-Modal Classification D. Kiela Edouard Grave Armand Joulin Tomáš Mikolov 35 141 0 06 Feb 2018
Zero-Shot Task Generalization with Multi-Task Deep Reinforcement Learning Junhyuk Oh Satinder Singh Honglak Lee Pushmeet Kohli OffRL 22 269 0 15 Jun 2017
Multimodal Machine Learning: A Survey and Taxonomy T. Baltrušaitis Chaitanya Ahuja Louis-Philippe Morency 15 2,865 0 26 May 2017
Visual Dialog Abhishek Das Satwik Kottur Khushi Gupta Avi Singh Deshraj Yadav José M. F. Moura Devi Parikh Dhruv Batra 69 990 0 26 Nov 2016
Coherent Dialogue with Attention-based Language Models Hongyuan Mei Joey Tianyi Zhou Matthew R. Walter AuLLM 32 83 0 21 Nov 2016
Semantic Parsing with Semi-Supervised Sequential Autoencoders Tomás Kociský Gábor Melis Edward Grefenstette Chris Dyer Wang Ling Phil Blunsom Karl Moritz Hermann 30 79 0 29 Sep 2016