FollowNet: Robot Navigation by Following Natural Language Directions with Deep Reinforcement Learning

16 May 2018

Papers citing "FollowNet: Robot Navigation by Following Natural Language Directions with Deep Reinforcement Learning"

33 / 33 papers shown

Title
Speech-Guided Sequential Planning for Autonomous Navigation using Large Language Model Meta AI 3 (Llama3) Alkesh K. Srivastava Philip Dames LLMAG LM&Ro 48 1 0 13 Jul 2024
Computation Offloading with Multiple Agents in Edge-Computing-Supported IoT Shihao Shen Yiwen Han Xiaofei Wang Yan Wang OffRL 13 79 0 01 Aug 2023
Simple Embodied Language Learning as a Byproduct of Meta-Reinforcement Learning E. Liu S. Suri Tong Mu Allan Zhou Chelsea Finn LLMAG LM&Ro 23 2 0 14 Jun 2023
Robot path planning using deep reinforcement learning Miguel Quinones-Ramirez Jorge Ríos-Martínez Víctor Uc Cetina SSL 25 5 0 17 Feb 2023
Temporal Video-Language Alignment Network for Reward Shaping in Reinforcement Learning Ziyuan Cao Reshma A. Ramachandra K. Yu 28 2 0 08 Feb 2023
Bridging the Gap: Using Deep Acoustic Representations to Learn Grounded Language from Percepts and Raw Speech Gaoussou Youssouf Kebe Luke E. Richards Edward Raff Francis Ferraro Cynthia Matuszek SSL 22 5 0 27 Dec 2021
Grounding Linguistic Commands to Navigable Regions N. Rufus Kanishk Jain U. R. Nair Vineet Gandhi K. M. Krishna LM&Ro 23 11 0 24 Dec 2021
AB-Mapper: Attention and BicNet Based Multi-agent Path Finding for Dynamic Crowded Environment Huifeng Guan Yuan Gao Ming Zhao Yong Yang Fuqin Deng Tin Lun Lam 29 2 0 02 Oct 2021
SASRA: Semantically-aware Spatio-temporal Reasoning Agent for Vision-and-Language Navigation in Continuous Environments Muhammad Zubair Irshad Niluthpol Chowdhury Mithun Zachary Seymour Han-Pang Chiu S. Samarasekera Rakesh Kumar LM&Ro 26 49 0 26 Aug 2021
Visual Perspective Taking for Opponent Behavior Modeling Boyuan Chen Yuhang Hu Robert Kwiatkowski Shuran Song Hod Lipson 13 11 0 11 May 2021
Hierarchical Cross-Modal Agent for Robotics Vision-and-Language Navigation Muhammad Zubair Irshad Chih-Yao Ma Z. Kira LM&Ro 30 49 0 21 Apr 2021
A Survey on Deep Reinforcement Learning for Audio-Based Applications S. Latif Heriberto Cuayáhuitl Farrukh Pervez Fahad Shamshad Hafiz Shehbaz Ali Erik Cambria OffRL 47 73 0 01 Jan 2021
ArraMon: A Joint Navigation-Assembly Instruction Interpretation Task in Dynamic Environments Hyounghun Kim Abhaysinh Zala Graham Burri Hao Tan Joey Tianyi Zhou LM&Ro 27 16 0 15 Nov 2020
Few-shot Object Grounding and Mapping for Natural Language Robot Instruction Following Valts Blukis Ross A. Knepper Yoav Artzi LM&Ro 18 33 0 14 Nov 2020
Visual Navigation in Real-World Indoor Environments Using End-to-End Deep Reinforcement Learning Jonáš Kulhánek Erik Derner Robert Babuška 31 39 0 21 Oct 2020
DeComplex: Task planning from complex natural instructions by a collocating robot Pradip Pramanick H. Barua Chayan Sarkar 6 18 0 23 Aug 2020
Compositional Networks Enable Systematic Generalization for Grounded Language Understanding Yen-Ling Kuo Boris Katz Andrei Barbu 34 22 0 06 Aug 2020
Spatial Action Maps for Mobile Manipulation Jimmy Wu Xingyuan Sun Andy Zeng Shuran Song Johnny Lee Szymon Rusinkiewicz Thomas Funkhouser 24 70 0 20 Apr 2020
Deep compositional robotic planners that follow natural language commands Yen-Ling Kuo Boris Katz Andrei Barbu LM&Ro 26 22 0 12 Feb 2020
A Narration-based Reward Shaping Approach using Grounded Natural Language Commands Nicholas R. Waytowich Sean L. Barton Vernon J. Lawhern Garrett A. Warnell OffRL 16 17 0 31 Oct 2019
Learning to Map Natural Language Instructions to Physical Quadcopter Control using Simulated Flight Valts Blukis Yannick Terme Eyvind Niklasson Ross A. Knepper Yoav Artzi 6 74 0 21 Oct 2019
Conditional Driving from Natural Language Instructions Junha Roh Chris Paxton Andrzej Pronobis Ali Farhadi Dieter Fox LM&Ro 8 33 0 16 Oct 2019
Search on the Replay Buffer: Bridging Planning and Reinforcement Learning Benjamin Eysenbach Ruslan Salakhutdinov Sergey Levine OffRL 29 284 0 12 Jun 2019
Stay on the Path: Instruction Fidelity in Vision-and-Language Navigation Vihan Jain Gabriel Ilharco Alexander Ku Ashish Vaswani Eugene Ie Jason Baldridge LM&Ro 14 178 0 29 May 2019
Evolving Rewards to Automate Reinforcement Learning Aleksandra Faust Anthony G. Francis Dar Mehta 20 50 0 18 May 2019
Enabling Robots to Understand Incomplete Natural Language Instructions Using Commonsense Reasoning Haonan Chen Hao Tan Alan Kuntz Joey Tianyi Zhou Ron Alterovitz LM&Ro LRM 7 45 0 29 Apr 2019
Grounding Natural Language Commands to StarCraft II Game States for Narration-Guided Reinforcement Learning Nicholas R. Waytowich Sean L. Barton Vernon J. Lawhern Ethan Stump Garrett A. Warnell 11 15 0 24 Apr 2019
Learning To Follow Directions in Street View Karl Moritz Hermann Mateusz Malinowski Piotr Wojciech Mirowski Andras Banki-Horvath Keith Anderson R. Hadsell SSL 16 66 0 01 Mar 2019
Improving Grounded Natural Language Understanding through Human-Robot Dialog Jesse Thomason Aishwarya Padmakumar Jivko Sinapov Nick Walker Yuqian Jiang Harel Yedidsion Justin W. Hart Peter Stone Raymond J. Mooney LM&Ro 14 76 0 01 Mar 2019
From Language to Goals: Inverse Reinforcement Learning for Vision-Based Instruction Following Justin Fu Anoop Korattikara Balan Sergey Levine S. Guadarrama OffRL LM&Ro 16 123 0 20 Feb 2019
Learning to Navigate the Web Izzeddin Gur U. Rückert Aleksandra Faust Dilek Z. Hakkani-Tür 17 65 0 21 Dec 2018
Mapping Navigation Instructions to Continuous Control Actions with Position-Visitation Prediction Valts Blukis Dipendra Kumar Misra Ross A. Knepper Yoav Artzi 11 81 0 10 Nov 2018
Resolving Referring Expressions in Images With Labeled Elements Nevan Wichers Dilek Z. Hakkani-Tür Jindong Chen 14 7 0 24 Oct 2018