ProgPrompt: Generating Situated Robot Task Plans using Large Language Models

22 September 2022

Papers citing "ProgPrompt: Generating Situated Robot Task Plans using Large Language Models"

50 / 460 papers shown

Title
ExploRLLM: Guiding Exploration in Reinforcement Learning with Large Language Models Runyu Ma Jelle Luijkx Zlatan Ajanović Jens Kober LM&Ro LRM 119 9 0 14 Mar 2024
CoPa: General Robotic Manipulation through Spatial Constraints of Parts with Foundation Models Haoxu Huang Fanqi Lin Yingdong Hu Shengjie Wang Yang Gao 106 61 0 13 Mar 2024
LTGC: Long-tail Recognition via Leveraging LLMs-driven Generated Content QiHao Zhao Yalun Dai Hao Li Wei Hu Fan Zhang Jun Liu 87 17 0 09 Mar 2024
Why Not Use Your Textbook? Knowledge-Enhanced Procedure Planning of Instructional Videos Kumaranage Ravindu Yasas Nagasinghe Honglu Zhou Malitha Gunawardhana Martin Renqiang Min Daniel Harari Muhammad Haris Khan 105 7 0 05 Mar 2024
Large Language Model-Based Evolutionary Optimizer: Reasoning with elitism Shuvayan Brahmachary Subodh M. Joshi Aniruddha Panda K. Koneripalli A. Sagotra Harshil Patel Ankush Sharma Ameya Dilip Jagtap Kaushic Kalyanaraman LRM 114 22 0 04 Mar 2024
Leveraging Prompt-Based Large Language Models: Predicting Pandemic Health Decisions and Outcomes Through Social Media Language Xi Ding Buse Carik Uma Sushmitha Gunturi Valerie F. Reyna Eugenia H Rho 53 8 0 01 Mar 2024
RL-GPT: Integrating Reinforcement Learning and Code-as-policy Shaoteng Liu Haoqi Yuan Minda Hu Yanwei Li Yukang Chen Shu Liu Zongqing Lu Jiaya Jia LLMAG 111 17 0 29 Feb 2024
PhyGrasp: Generalizing Robotic Grasping with Physics-informed Large Multimodal Models Dingkun Guo Yuqi Xiang Shuqi Zhao Xinghao Zhu Masayoshi Tomizuka Mingyu Ding Wei Zhan 88 11 0 26 Feb 2024
RoboGrind: Intuitive and Interactive Surface Treatment with Industrial Robots Benjamin Alt Florian Stöckl Silvan Müller Christopher Braun Julian Raible ... Darko Katic Rainer Jäkel Michael Beetz Marcus Strand Marco F. Huber AI4CE 69 2 0 26 Feb 2024
RoboCodeX: Multimodal Code Generation for Robotic Behavior Synthesis Yao Mu Junting Chen Qinglong Zhang Shoufa Chen Qiaojun Yu ... Wenhai Wang Jifeng Dai Yu Qiao Mingyu Ding Ping Luo 104 24 0 25 Feb 2024
Empowering Large Language Model Agents through Action Learning Haiteng Zhao Chang Ma Guoyin Wang Jing Su Lingpeng Kong Jingjing Xu Zhi-Hong Deng Hongxia Yang LM&Ro LLMAG 92 12 0 24 Feb 2024
Safe Task Planning for Language-Instructed Multi-Robot Systems using Conformal Prediction Jun Wang Guocheng He Y. Kantaros 81 13 0 23 Feb 2024
CyberDemo: Augmenting Simulated Human Demonstration for Real-World Dexterous Manipulation Jun Wang Yuzhe Qin Kaiming Kuang Yigit Korkmaz Akhilan Gurumoorthy Hao Su Xiaolong Wang 95 20 0 22 Feb 2024
RoboScript: Code Generation for Free-Form Manipulation Tasks across Real and Simulation Junting Chen Yao Mu Qiaojun Yu Tianming Wei Silang Wu ... Wenqi Shao Yu Qiao Huazhe Xu Mingyu Ding Ping Luo LM&Ro 85 12 0 22 Feb 2024
A Survey on Knowledge Distillation of Large Language Models Xiaohan Xu Ming Li Chongyang Tao Tao Shen Reynold Cheng Jinyang Li Can Xu Dacheng Tao Dinesh Manocha KELM VLM 173 135 0 20 Feb 2024
Learning to Learn Faster from Human Feedback with Language Model Predictive Control Jacky Liang Fei Xia Wenhao Yu Andy Zeng Montse Gonzalez Arenas ... N. Heess Kanishka Rao Nik Stewart Jie Tan Carolina Parada LM&Ro 124 35 0 18 Feb 2024
AutoGPT+P: Affordance-based Task Planning with Large Language Models Timo Birr Christoph Pohl Abdelrahman Younes Tamim Asfour LM&Ro 93 19 0 16 Feb 2024
Grounding LLMs For Robot Task Planning Using Closed-loop State Feedback V. Bhat Ali Umut Kaypak Prashanth Krishnamurthy Ramesh Karri Farshad Khorrami LM&Ro 111 18 0 13 Feb 2024
LoTa-Bench: Benchmarking Language-oriented Task Planners for Embodied Agents Jae-Woo Choi Youngwoo Yoon Hyobin Ong Jaehong Kim Minsu Jang 72 18 0 13 Feb 2024
PIVOT: Iterative Visual Prompting Elicits Actionable Knowledge for VLMs Soroush Nasiriany Fei Xia Wenhao Yu Ted Xiao Jacky Liang ... Karol Hausman N. Heess Chelsea Finn Sergey Levine Brian Ichter LM&Ro LRM 94 114 0 12 Feb 2024
Reasoning Grasping via Multimodal Large Language Model Shiyu Jin Jinxuan Xu Yutian Lei Liangjun Zhang LRM 104 21 0 09 Feb 2024
Introspective Planning: Aligning Robots' Uncertainty with Inherent Task Ambiguity Kaiqu Liang Zixu Zhang J. F. Fisac LLMAG 159 8 0 09 Feb 2024
Real-World Robot Applications of Foundation Models: A Review Kento Kawaharazuka T. Matsushima Andrew Gambardella Jiaxian Guo Chris Paxton Andy Zeng OffRL VLM LM&Ro 116 54 0 08 Feb 2024
InCoRo: In-Context Learning for Robotics Control with Feedback Loops Jiaqiang Ye Zhu Carla Gomez Cano David Vazquez Bermudez Michal Drozdzal LRM 77 8 0 07 Feb 2024
Automatic Robotic Development through Collaborative Framework by Large Language Models Zhirong Luan Yujun Lai Rundong Huang Xiaruiqi Lan Liangjun Chen Badong Chen LLMAG 50 1 0 06 Feb 2024
A Survey on Robotics with Foundation Models: toward Embodied AI Zhiyuan Xu Kun Wu Junjie Wen Jinming Li Ning Liu Zhengping Che Jian Tang AI4CE LRM LM&Ro 89 29 0 04 Feb 2024
Affordable Generative Agents Yangbin Yu Qin Zhang Junyou Li Qiang Fu Deheng Ye LLMAG AI4CE 97 7 0 03 Feb 2024
Executable Code Actions Elicit Better LLM Agents Xingyao Wang Yangyi Chen Lifan Yuan Yizhe Zhang Yunzhu Li Hao Peng Heng Ji ELM LLMAG LM&Ro 137 167 0 01 Feb 2024
A Survey on Generative AI and LLM for Video Generation, Understanding, and Streaming Pengyuan Zhou Lin Wang Zhi Liu Yanbin Hao Pan Hui Sasu Tarkoma J. Kangasharju VGen 116 30 0 30 Jan 2024
CognitiveOS: Large Multimodal Model based System to Endow Any Type of Robot with Generative AI Artem Lykov Mikhail Konenkov Koffivi Fidele Gbagbe Mikhail Litvinov D. Davletshin A. Fedoseev Miguel Altamirano Cabrera Robinroy Peter Dzmitry Tsetserukou LM&Ro 86 5 0 29 Jan 2024
VIALM: A Survey and Benchmark of Visually Impaired Assistance with Large Models Yi Zhao Yilin Zhang Rong Xiang Jing Li Hillming Li 71 16 0 29 Jan 2024
MResT: Multi-Resolution Sensing for Real-Time Control with Vision-Language Models Saumya Saxena Mohit Sharma Oliver Kroemer 85 4 0 25 Jan 2024
True Knowledge Comes from Practice: Aligning LLMs with Embodied Environments via Reinforcement Learning Weihao Tan Wentao Zhang Shanqi Liu Longtao Zheng Xinrun Wang Bo An OffRL 109 22 0 25 Jan 2024
OK-Robot: What Really Matters in Integrating Open-Knowledge Models for Robotics Peiqi Liu Yaswanth Orru Jay Vakil Chris Paxton Nur Muhammad (Mahi) Shafiullah Lerrel Pinto LM&Ro VLM 142 38 0 22 Jan 2024
BETA: Binarized Energy-Efficient Transformer Accelerator at the Edge Yuhao Ji Chao Fang Zhongfeng Wang 66 3 0 22 Jan 2024
PhotoScout: Synthesis-Powered Multi-Modal Image Search Celeste Barnaby Qiaochu Chen Chenglong Wang Işıl Dillig 95 3 0 19 Jan 2024
LangProp: A code optimization framework using Large Language Models applied to driving Shu Ishida Gianluca Corrado George Fedoseev Hudson Yeo Lloyd Russell Jamie Shotton João F. Henriques Anthony Hu 113 11 0 18 Jan 2024
Mutual Enhancement of Large Language and Reinforcement Learning Models through Bi-Directional Feedback Mechanisms: A Planning Case Study Shangding Gu LLMAG 110 0 0 12 Jan 2024
Large Language Models for Robotics: Opportunities, Challenges, and Perspectives Jiaqi Wang Zihao Wu Yiwei Li Hanqi Jiang Peng Shu ... Lin Zhao Bao Ge Xiang Li Tianming Liu Shu Zhang LM&Ro 97 75 0 09 Jan 2024
RePLan: Robotic Replanning with Perception and Language Models Marta Skreta Zihan Zhou Jia Lin Yuan Kourosh Darvish Alán Aspuru-Guzik Animesh Garg LM&Ro LRM 125 26 0 08 Jan 2024
LLMs for Robotic Object Disambiguation Connie Jiang Yiqing Xu David Hsu LM&Ro 62 1 0 07 Jan 2024
Unified-IO 2: Scaling Autoregressive Multimodal Models with Vision, Language, Audio, and Action Jiasen Lu Christopher Clark Sangho Lee Zichen Zhang Savya Khosla Ryan Marten Derek Hoiem Aniruddha Kembhavi VLM MLLM 102 175 0 28 Dec 2023
LLM-SAP: Large Language Models Situational Awareness Based Planning Liman Wang Hanyang Zhong LLMAG 113 2 0 26 Dec 2023
Assessing the Impact of Prompting Methods on ChatGPT's Mathematical Capabilities Yuhao Chen Chloe Wong Hanwen Yang Juan Aguenza Sai Bhujangari ... Eric Phuong Minghao Liu Raja Kumar Vanshika Vats James Davis 90 1 0 22 Dec 2023
Plan, Posture and Go: Towards Open-World Text-to-Motion Generation Jinpeng Liu Wen-Dao Dai Chunyu Wang Yiji Cheng Yansong Tang Xin Tong VGen DiffM 122 19 0 22 Dec 2023
Learning Top-k Subtask Planning Tree based on Discriminative Representation Pre-training for Decision Making Jingqing Ruan Kaishen Wang Qingyang Zhang Dengpeng Xing Bo Xu 101 0 0 18 Dec 2023
Iterative Motion Editing with Natural Language Purvi Goel Kuan-Chieh Wang Chenxi Liu Kayvon Fatahalian DiffM 127 22 0 15 Dec 2023
LLM-MARS: Large Language Model for Behavior Tree Generation and NLP-enhanced Dialogue in Multi-Agent Robot Systems Artem Lykov Maria Dronova Nikolay Naglov Mikhail Litvinov Sergei Satsevich Artem Bazhenov Vladimir Berman Aleksei Shcherbak Dzmitry Tsetserukou LLMAG LM&Ro 107 15 0 14 Dec 2023
LiFT: Unsupervised Reinforcement Learning with Foundation Models as Teachers Taewook Nam Juyong Lee Jesse Zhang Sung Ju Hwang Joseph J Lim Karl Pertsch OffRL LRM 101 8 0 14 Dec 2023
Toward General-Purpose Robots via Foundation Models: A Survey and Meta-Analysis Yafei Hu Quanting Xie Vidhi Jain Jonathan M Francis Jay Patrikar ... Xiaolong Wang Sebastian A. Scherer Z. Kira Fei Xia Yonatan Bisk LM&Ro AI4CE 133 74 0 14 Dec 2023