Vision-Language Interpreter for Robot Task Planning

2 November 2023

Keisuke Shirai

C. C. Beltran-Hernandez

Papers citing "Vision-Language Interpreter for Robot Task Planning"

25 / 25 papers shown

Title
Mapping User Trust in Vision Language Models: Research Landscape, Challenges, and Prospects Agnese Chiatti Sara Bernardini Lara Shibelski Godoy Piccolo Viola Schiaffonati Matteo Matteucci 65 0 0 08 May 2025
KeyMPs: One-Shot Vision-Language Guided Motion Generation by Sequencing DMPs for Occlusion-Rich Tasks Edgar Anarossi Yuhwan Kwon Hirotaka Tahara Shohei Tanaka Keisuke Shirai Masashi Hamaya C. C. Beltran-Hernandez Atsushi Hashimoto Takamitsu Matsubara 37 0 0 14 Apr 2025
Domain-Conditioned Scene Graphs for State-Grounded Task Planning Jonas Herzog Jiangpin Liu Yue Wang LM&Ro 56 0 0 09 Apr 2025
LLMs as Planning Modelers: A Survey for Leveraging Large Language Models to Construct Automated Planning Models Marcus Tantakoun Xiaodan Zhu Christian Muise 38 3 0 22 Mar 2025
LLM+MAP: Bimanual Robot Task Planning using Large Language Models and Planning Domain Definition Language Kun-Mo Chu Xufeng Zhao C. Weber Stefan Wermter LLMAG LM&Ro 57 1 0 21 Mar 2025
World Modeling Makes a Better Planner: Dual Preference Optimization for Embodied Task Planning Siyin Wang Zhaoye Fei Qinyuan Cheng S. Zhang Panpan Cai Jinlan Fu Xipeng Qiu 50 1 0 13 Mar 2025
STAR: A Foundation Model-driven Framework for Robust Task Planning and Failure Recovery in Robotic Systems Md. Sadman Sakib Yu Sun 49 0 0 08 Mar 2025
GSCE: A Prompt Framework with Enhanced Reasoning for Reliable LLM-driven Drone Control Wenhao Wang Yanyan Li Long Jiao Jiawei Yuan 86 1 0 18 Feb 2025
Planning with Vision-Language Models and a Use Case in Robot-Assisted Teaching Xuzhe Dang Lada Kudláčková Stefan Edelkamp LM&Ro 3DV 46 2 0 29 Jan 2025
CaStL: Constraints as Specifications through LLM Translation for Long-Horizon Task and Motion Planning Weihang Guo Zachary Kingston Lydia E. Kavraki 45 2 0 29 Oct 2024
Real-World Cooking Robot System from Recipes Based on Food State Recognition Using Foundation Models and PDDL Naoaki Kanazawa Kento Kawaharazuka Yoshiki Obinata Kei Okada Masayuki Inaba LM&Ro 32 0 0 03 Oct 2024
Fast and Accurate Task Planning using Neuro-Symbolic Language Models and Multi-level Goal Decomposition Minseo Kwon Yaesol Kim Young J. Kim 39 3 0 28 Sep 2024
MultiTalk: Introspective and Extrospective Dialogue for Human-Environment-LLM Alignment Venkata Naren Devarakonda Ali Umut Kaypak Shuaihang Yuan Prashanth Krishnamurthy Yi Fang Farshad Khorrami LLMAG 47 0 0 24 Sep 2024
Can-Do! A Dataset and Neuro-Symbolic Grounded Framework for Embodied Planning with Large Multimodal Models Yew Ken Chia Qi Sun Lidong Bing Soujanya Poria LM&Ro 34 1 0 22 Sep 2024
AlignBot: Aligning VLM-powered Customized Task Planning with User Reminders Through Fine-Tuning for Household Robots Zhaxizhuoma Pengan Chen Ziniu Wu Jiawei Sun Dong Wang Peng Zhou Nieqing Cao Yan Ding Bin Zhao Xuelong Li 46 4 0 18 Sep 2024
ReplanVLM: Replanning Robotic Tasks with Visual Language Models Aoran Mei Guo-Niu Zhu Huaxiang Zhang Zhongxue Gan 38 12 0 31 Jul 2024
A Survey of Language-Based Communication in Robotics William Hunt Sarvapali D. Ramchurn Mohammad D. Soorati LM&Ro 65 12 0 06 Jun 2024
Real-World Robot Applications of Foundation Models: A Review Kento Kawaharazuka T. Matsushima Andrew Gambardella Jiaxian Guo Chris Paxton Andy Zeng OffRL VLM LM&Ro 51 47 0 08 Feb 2024
On the Prospects of Incorporating Large Language Models (LLMs) in Automated Planning and Scheduling (APS) Vishal Pallagani Kaushik Roy Bharath Muppasani F. Fabiano Andrea Loreggia K. Murugesan Biplav Srivastava F. Rossi L. Horesh Amit P. Sheth 31 40 0 04 Jan 2024
BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models Junnan Li Dongxu Li Silvio Savarese Steven C. H. Hoi VLM MLLM 320 4,261 0 30 Jan 2023
ProgPrompt: Generating Situated Robot Task Plans using Large Language Models Ishika Singh Valts Blukis Arsalan Mousavian Ankit Goyal Danfei Xu Jonathan Tremblay Dieter Fox Jesse Thomason Animesh Garg LM&Ro LLMAG 123 626 0 22 Sep 2022
Large Language Models are Zero-Shot Reasoners Takeshi Kojima S. Gu Machel Reid Yutaka Matsuo Yusuke Iwasawa ReLM LRM 328 4,139 0 24 May 2022
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models Jason W. Wei Xuezhi Wang Dale Schuurmans Maarten Bosma Brian Ichter F. Xia Ed H. Chi Quoc Le Denny Zhou LM&Ro LRM AI4CE ReLM 416 8,559 0 28 Jan 2022
Skill Induction and Planning with Latent Language Pratyusha Sharma Antonio Torralba Jacob Andreas LM&Ro 202 108 0 04 Oct 2021
Grounding Predicates through Actions Toki Migimatsu Jeannette Bohg 150 32 0 29 Sep 2021