ProgPrompt: Generating Situated Robot Task Plans using Large Language Models

22 September 2022

Papers citing "ProgPrompt: Generating Situated Robot Task Plans using Large Language Models"

50 / 460 papers shown

Title
Enhancing Multi-Agent Systems via Reinforcement Learning with LLM-based Planner and Graph-based Policy Ziqi Jia Junjie Li Xiaoyang Qu Jianzong Wang LLMAG 89 0 0 13 Mar 2025
World Modeling Makes a Better Planner: Dual Preference Optimization for Embodied Task Planning Siyin Wang Zhaoye Fei Qinyuan Cheng Shanghang Zhang Panpan Cai Jinlan Fu Xipeng Qiu 81 2 0 13 Mar 2025
IMPACT: Intelligent Motion Planning with Acceptable Contact Trajectories via Vision-Language Models Yiyang Ling Karan Owalekar Oluwatobiloba Adesanya Erdem Bıyık Daniel Seita 82 2 0 13 Mar 2025
NVP-HRI: Zero Shot Natural Voice and Posture-based Human-Robot Interaction via Large Language Model Yuzhi Lai Shenghai Yuan Youssef Nassar Mingyu Fan T. Weber Matthias Rätsch LM&Ro 128 3 0 12 Mar 2025
FAM-HRI: Foundation-Model Assisted Multi-Modal Human-Robot Interaction Combining Gaze and Speech Yuzhi Lai Shenghai Yuan Boya Zhang Benjamin Kiefer Peizheng Li Tianchen Deng Andreas Zell 73 1 0 11 Mar 2025
LTLCodeGen: Code Generation of Syntactically Correct Temporal Logic for Robot Task Planning Behrad Rabiei Mahesh Kumar A.R. Zhirui Dai Surya L.S.R. Pilla Qiyue Dong Nikolay Atanasov LM&Ro 94 0 0 10 Mar 2025
Navigating Motion Agents in Dynamic and Cluttered Environments through LLM Reasoning Yubo Zhao Qi Wu Yifan Wang Yu-Wing Tai Chi-Keung Tang LLMAG LRM 509 0 0 10 Mar 2025
AutoMisty: A Multi-Agent LLM Framework for Automated Code Generation in the Misty Social Robot Xiao Wang Lu Dong Sahana Rangasrinivasan Ifeoma Nwogu S. Setlur Venugopal Govindaraju 76 0 0 09 Mar 2025
STAR: A Foundation Model-driven Framework for Robust Task Planning and Failure Recovery in Robotic Systems Md. Sadman Sakib Yu Sun 89 0 0 08 Mar 2025
Zero-Shot Peg Insertion: Identifying Mating Holes and Estimating SE(2) Poses with Vision-Language Models Masaru Yajima Kei Ota Asako Kanezaki Rei Kawakami 119 0 0 08 Mar 2025
Look Before You Leap: Using Serialized State Machine for Language Conditioned Robotic Manipulation Tong Mu Yihao Liu Mehran Armand 95 0 0 07 Mar 2025
A Generative System for Robot-to-Human Handovers: from Intent Inference to Spatial Configuration Imagery Hanxin Zhang Abdulqader Dhafer Zhou Daniel Hao Hongbiao Dong 94 0 0 05 Mar 2025
FlowPlan: Zero-Shot Task Planning with LLM Flow Engineering for Robotic Instruction Following Zijun Lin Chao Tang Hanjing Ye Kuanqi Cai 106 0 0 04 Mar 2025
Code-as-Symbolic-Planner: Foundation Model-Based Robot Planning via Symbolic Code Generation Yuxiao Chen Yilun Hao Yang Zhang Chuchu Fan LRM 109 2 0 03 Mar 2025
NeSyC: A Neuro-symbolic Continual Learner For Complex Embodied Tasks In Open Domains Wonje Choi Jinwoo Park Sanghyun Ahn Daehee Lee Honguk Woo 445 1 0 02 Mar 2025
Never too Prim to Swim: An LLM-Enhanced RL-based Adaptive S-Surface Controller for AUVs under Extreme Sea Conditions Guanwen Xie Jingzehua Xu Yimian Ding Zhi Zhang Shuai Zhang Yongqian Li 76 0 0 01 Mar 2025
Complex LLM Planning via Automated Heuristics Discovery Hongyi Ling Shubham Parashar Sambhav Khurana Blake Olson Anwesha Basu Gaurangi Sinha Zhuowen Tu James Caverlee Shuiwang Ji 157 3 0 26 Feb 2025
BOSS: Benchmark for Observation Space Shift in Long-Horizon Task Yue Yang Linfeng Zhao Mingyu Ding Gedas Bertasius D. Szafir 118 0 0 24 Feb 2025
USPilot: An Embodied Robotic Assistant Ultrasound System with Large Language Model Enhanced Graph Planner Mingcong Chen Siqi Fan Guanglin Cao Yun-hui Liu Hongbin Liu 110 0 0 18 Feb 2025
RobotIQ: Empowering Mobile Robots with Human-Level Planning for Real-World Execution Emmanuel K. Raptis Athanasios Ch. Kapoutsis Elias B. Kosmatopoulos LM&Ro 125 0 0 18 Feb 2025
SELP: Generating Safe and Efficient Task Plans for Robot Agents with Large Language Models Yi Wu Z. Xiong Yiran Hu Shreyash S. Iyengar Nan Jiang Aniket Bera Lin Tan Suresh Jagannathan LM&Ro LLMAG 168 4 0 17 Feb 2025
PCGRLLM: Large Language Model-Driven Reward Design for Procedural Content Generation Reinforcement Learning In-Chang Baek Sung-Hyun Kim Sam Earle Zehua Jiang Noh Jin-Ha Julian Togelius Kyung-Joong Kim 80 2 0 15 Feb 2025
3D-Grounded Vision-Language Framework for Robotic Task Planning: Automated Prompt Synthesis and Supervised Reasoning Guoqin Tang Qingxuan Jia Zeyuan Huang Gang Chen Ning Ji Zhipeng Yao 112 0 0 13 Feb 2025
HAMSTER: Hierarchical Action Models For Open-World Robot Manipulation Yi Li Yuquan Deng Jing Zhang Joel Jang Marius Memme ... Fabio Ramos Dieter Fox Anqi Li Abhishek Gupta Ankit Goyal LM&Ro 198 18 0 08 Feb 2025
Temporal Representation Alignment: Successor Features Enable Emergent Compositionality in Robot Instruction Following Vivek Myers Bill Chunyuan Zheng Anca Dragan Kuan Fang Sergey Levine 200 1 0 08 Feb 2025
Anticipate & Act : Integrating LLMs and Classical Planning for Efficient Task Execution in Household Environments Raghav Arora Shivam Singh Karthik Swaminathan Ahana Datta Snehasis Banerjee Brojeshwar Bhowmick Krishna Murthy Jatavallabhula Mohan Sridharan M. Krishna LLMAG 122 11 0 04 Feb 2025
Robust Mobile Robot Path Planning via LLM-Based Dynamic Waypoint Generation Muhammad Taha Tariq Congqing Wang Yasir Hussain 174 1 0 28 Jan 2025
ENTER: Event Based Interpretable Reasoning for VideoQA Hammad A. Ayyubi Junzhang Liu Ali Asgarov Zaber Ibn Abdul Hakim Najibul Haque Sarker ... Md. Atabuzzaman Xudong Lin Naveen Reddy Dyava Shih-Fu Chang Chris Thomas NAI 323 3 0 24 Jan 2025
LAMS: LLM-Driven Automatic Mode Switching for Assistive Teleoperation Yiran Tao Jehan Yang Dan Ding Zackory Erickson 98 1 0 15 Jan 2025
OmniManip: Towards General Robotic Manipulation via Object-Centric Interaction Primitives as Spatial Constraints Mingjie Pan Jiyao Zhang Tianshu Wu Yinghao Zhao Wenlong Gao Hao Dong LM&Ro 117 13 0 08 Jan 2025
BTGenBot: Behavior Tree Generation for Robotic Tasks with Lightweight LLMs Riccardo Andrea Izzo Gianluca Bardaro Matteo Matteucci LM&Ro 98 8 0 08 Jan 2025
LLM+AL: Bridging Large Language Models and Action Languages for Complex Reasoning about Actions Adam Ishay Joohyung Lee LRM 101 4 0 01 Jan 2025
TalkWithMachines: Enhancing Human-Robot Interaction for Interpretable Industrial Robotics Through Large/Vision Language Models Ammar N. Abbas Csaba Beleznai LM&Ro 131 2 0 19 Dec 2024
RoboMatrix: A Skill-centric Hierarchical Framework for Scalable Robot Task Planning and Execution in Open-World Weixin Mao Weiheng Zhong Zhou Jiang Dong Fang Zhongyue Zhang ... Fan Jia Tiancai Wang Haoqiang Fan Osamu Yoshie Osamu Yoshie 231 7 0 29 Nov 2024
RoboSpatial: Teaching Spatial Understanding to 2D and 3D Vision-Language Models for Robotics Chan Hee Song Valts Blukis Jonathan Tremblay Stephen Tyree Yu-Chuan Su Stan Birchfield 247 20 0 25 Nov 2024
TrojanRobot: Physical-World Backdoor Attacks Against VLM-based Robotic Manipulation Xiaobei Wang Hewen Pan Hangtao Zhang Minghui Li Shengshan Hu ... Peijin Guo Yichen Wang Wei Wan Aishan Liu L. Zhang AAML 178 9 0 18 Nov 2024
Robot Tasks with Fuzzy Time Requirements from Natural Language Instructions Sascha Sucker Michael Neubauer Dominik Henrich 53 1 0 14 Nov 2024
Open-World Task and Motion Planning via Vision-Language Model Inferred Constraints Nishanth Kumar F. Ramos Dieter Fox Caelan Reed Garrett Tomás Lozano-Pérez Leslie Pack Kaelbling Caelan Reed Garrett LRM LM&Ro 146 5 0 13 Nov 2024
RT-Grasp: Reasoning Tuning Robotic Grasping via Multi-modal Large Language Model Jinxuan Xu Shiyu Jin Yutian Lei Yuqian Zhang Liangjun Zhang LRM 73 7 0 07 Nov 2024
Vision Language Models are In-Context Value Learners Yecheng Jason Ma Joey Hejna Ayzaan Wahid Chuyuan Fu Dhruv Shah ... Dinesh Jayaraman Wenhao Yu Tingnan Zhang Dorsa Sadigh Fei Xia 101 10 0 07 Nov 2024
Understanding Generative AI in Robot Logic Parametrization Yuna Hwang Arissa J. Sato Pragathi Praveena N. White Bilge Mutlu LM&Ro 60 1 0 06 Nov 2024
Vocal Sandbox: Continual Learning and Adaptation for Situated Human-Robot Collaboration J. Grannen Siddharth Karamcheti Suvir Mirchandani Percy Liang Dorsa Sadigh 90 2 0 04 Nov 2024
AutoVFX: Physically Realistic Video Editing from Natural Language Instructions Hao-Yu Hsu Zhi-Hao Lin Albert Zhai Hongchi Xia Shenlong Wang VGen 109 11 0 04 Nov 2024
Eurekaverse: Environment Curriculum Generation via Large Language Models William Liang Sam Wang Hung-Ju Wang Osbert Bastani Dinesh Jayaraman Yecheng Jason Ma SyDa 134 3 0 04 Nov 2024
A Comparison of Prompt Engineering Techniques for Task Planning and Execution in Service Robotics Jonas Bode Bastian Patzold Raphael Memmesheimer Sven Behnke 82 3 0 30 Oct 2024
LiP-LLM: Integrating Linear Programming and dependency graph with Large Language Models for multi-robot task planning Kazuma Obata Tatsuya Aoki Takato Horii Tadahiro Taniguchi Takayuki Nagai 72 8 0 28 Oct 2024
EnvBridge: Bridging Diverse Environments with Cross-Environment Knowledge Transfer for Embodied AI Tomoyuki Kagaya Yuxuan Lou Thong Jing Yuan Subramanian Lakshmi J. Karlekar ... Natsuki Murakami Akira Kinose Koki Oguri Felix Wick Yang You 35 0 0 22 Oct 2024
Combining Ontological Knowledge and Large Language Model for User-Friendly Service Robots Haru Nakajima Jun Miura LM&Ro 74 1 0 22 Oct 2024
CoT-TL: Low-Resource Temporal Knowledge Representation of Planning Instructions Using Chain-of-Thought Reasoning Kumar Manas Stefan Zwicklbauer Adrian Paschke LRM LM&Ro 62 2 0 21 Oct 2024
A Large Language Model-Driven Reward Design Framework via Dynamic Feedback for Reinforcement Learning Shengjie Sun Runze Liu Jiafei Lyu J. Yang L. Zhang Xiu Li LRM 85 6 0 18 Oct 2024