LLM-Planner: Few-Shot Grounded Planning for Embodied Agents with Large Language Models

8 December 2022

Wei-Lun Chao

Papers citing "LLM-Planner: Few-Shot Grounded Planning for Embodied Agents with Large Language Models"

50 / 281 papers shown

Title
Large Language Model Aided QoS Prediction for Service Recommendation Huiying Liu Zekun Zhang Honghao Li Qilin Wu Yiwen Zhang 18 1 0 05 Aug 2024
Language-driven Grasp Detection with Mask-guided Attention Tuan V. Vo M. Vu Baoru Huang An Vuong Ngan Le T. Vo Anh Nguyen 34 3 0 29 Jul 2024
ReALFRED: An Embodied Instruction Following Benchmark in Photo-Realistic Environments Taewoong Kim Cheolhong Min Byeonghwi Kim Jinyeon Kim Wonje Jeung Jonghyun Choi LM&Ro 40 4 0 26 Jul 2024
HAPFI: History-Aware Planning based on Fused Information Sujin Jeon Suyeon Shin Byoung-Tak Zhang 39 0 0 23 Jul 2024
KoMA: Knowledge-driven Multi-agent Framework for Autonomous Driving with Large Language Models Kemou Jiang Xuan Cai Zhiyong Cui Aoyong Li Yilong Ren Haiyang Yu Hao Yang Daocheng Fu Licheng Wen Pinlong Cai LLMAG 50 8 0 19 Jul 2024
Words2Contact: Identifying Support Contacts from Verbal Instructions Using Foundation Models Dionis Totsila Quentin Rouxel Jean-Baptiste Mouret S. Ivaldi 38 1 0 19 Jul 2024
Baba Is AI: Break the Rules to Beat the Benchmark Nathan Cloos Meagan Jens Michelangelo Naim Yen-Ling Kuo Ignacio Cases Andrei Barbu Christopher J. Cueva VLM 23 1 0 18 Jul 2024
BadRobot: Jailbreaking Embodied LLMs in the Physical World Hangtao Zhang Chenyu Zhu Xianlong Wang Ziqi Zhou Yichen Wang ... Shengshan Hu Leo Yu Zhang Aishan Liu Peijin Guo Leo Yu Zhang LM&Ro 53 7 0 16 Jul 2024
Situated Instruction Following So Yeon Min Xavi Puig Devendra Singh Chaplot Tsung-Yen Yang Akshara Rai Priyam Parashar Ruslan Salakhutdinov Yonatan Bisk Roozbeh Mottaghi 38 1 0 15 Jul 2024
ChatLogic: Integrating Logic Programming with Large Language Models for Multi-Step Reasoning Zhongsheng Wang Jiamou Liu Qiming Bao Hongfei Rong Jingfeng Zhang KELM LRM 45 4 0 14 Jul 2024
VLMPC: Vision-Language Model Predictive Control for Robotic Manipulation Wentao Zhao Jiaming Chen Ziyu Meng Donghui Mao Ran Song Wei Zhang 43 8 0 13 Jul 2024
Converging Paradigms: The Synergy of Symbolic and Connectionist AI in LLM-Empowered Autonomous Agents Haoyi Xiong Zhiyuan Wang Xuhong Li Jiang Bian Zeke Xie Shahid Mumtaz Laura E. Barnes LLMAG 36 7 0 11 Jul 2024
Aligning Cyber Space with Physical World: A Comprehensive Survey on Embodied AI Yang Liu Weixing Chen Yongjie Bai Xiaodan Liang Guanbin Li Wen Gao Liang Lin LM&Ro SyDa AI4CE 51 50 0 09 Jul 2024
FinCon: A Synthesized LLM Multi-Agent System with Conceptual Verbal Reinforcement for Enhanced Financial Decision Making Yangyang Yu Zhiyuan Yao Haohang Li Zhiyang Deng Yupeng Cao ... Guojun Xiong Yueru He Jimin Huang Dong Li Qianqian Xie AIFin LLMAG 42 14 0 09 Jul 2024
VoxAct-B: Voxel-Based Acting and Stabilizing Policy for Bimanual Manipulation I-Chun Arthur Liu Sicheng He Daniel Seita Gaurav Sukhatme LM&Ro 43 11 0 04 Jul 2024
CRAB: Cross-environment Agent Benchmark for Multimodal Language Model Agents Tianqi Xu Linyao Chen Dai-Jie Wu Yanjun Chen Zecheng Zhang ... Shilong Liu Bochen Qian Philip H. S. Torr Guohao Li Bernard Ghanem 54 14 0 01 Jul 2024
ROS-LLM: A ROS framework for embodied AI with task feedback and structured reasoning Christopher E. Mower Yuhui Wan Hongzhan Yu Antoine Grosnit Jonas Gonzalez-Billandon ... Kun Shao Xingyue Quan Jianye Hao Jun Wang Haitham Bou-Ammar LM&Ro LLMAG 29 8 0 28 Jun 2024
Towards Open-World Grasping with Large Vision-Language Models Georgios Tziafas H. Kasaei LM&Ro LRM 37 12 0 26 Jun 2024
LLCoach: Generating Robot Soccer Plans using Multi-Role Large Language Models Michele Brienza Emanuele Musumeci Vincenzo Suriani Daniele Affinita A. Pennisi Daniele Nardi D. Bloisi LLMAG LM&Ro 41 1 0 26 Jun 2024
Open-vocabulary Mobile Manipulation in Unseen Dynamic Environments with 3D Semantic Maps Dicong Qiu Wenzong Ma Zhenfu Pan Hui Xiong Junwei Liang LM&Ro 39 7 0 26 Jun 2024
Towards Natural Language-Driven Assembly Using Foundation Models O. Joglekar Tal Lancewicki Shir Kozlovsky Vladimir Tchuiev Zohar Feldman Dotan Di Castro LM&Ro 37 0 0 23 Jun 2024
Look Further Ahead: Testing the Limits of GPT-4 in Path Planning Mohamed Aghzal Erion Plaku Ziyu Yao ELM 36 6 0 17 Jun 2024
Embodied Instruction Following in Unknown Environments Zhenyu Wu Ziwei Wang Xiuwei Xu Jiwen Lu Haibin Yan LM&Ro 33 4 0 17 Jun 2024
Enabling robots to follow abstract instructions and complete complex dynamic tasks Ruaridh Mon-Williams Gen Li Ran Long Wenqian Du Chris Lucas LM&Ro 45 3 0 17 Jun 2024
RoboGolf: Mastering Real-World Minigolf with a Reflective Multi-Modality Vision-Language Model Hantao Zhou Tianying Ji Lukas Sommerhalder Michael Goerner Norman Hendrich Jianwei Zhang Fuchun Sun Huazhe Xu 50 0 0 14 Jun 2024
Details Make a Difference: Object State-Sensitive Neurorobotic Task Planning Xiaowen Sun Xufeng Zhao Jae Hee Lee Wenhao Lu Matthias Kerzel Stefan Wermter LM&Ro 39 2 0 14 Jun 2024
Language-driven Grasp Detection An Dinh Vuong Minh Nhat Vu Baoru Huang Nghia Nguyen Hieu Le T. Vo Anh Nguyen VLM 41 19 0 13 Jun 2024
Scaling Value Iteration Networks to 5000 Layers for Extreme Long-Term Planning Yuhui Wang Qingyuan Wu Weida Li Dylan R. Ashley Francesco Faccio Chao Huang Jürgen Schmidhuber AI4CE 26 0 0 12 Jun 2024
A Survey of Language-Based Communication in Robotics William Hunt Sarvapali D. Ramchurn Mohammad D. Soorati LM&Ro 65 12 0 06 Jun 2024
InterPreT: Interactive Predicate Learning from Language Feedback for Generalizable Task Planning Muzhi Han Yifeng Zhu Song-Chun Zhu Yingnian Wu Yuke Zhu 32 21 0 30 May 2024
Correctable Landmark Discovery via Large Models for Vision-Language Navigation Bingqian Lin Yunshuang Nie Ziming Wei Yi Zhu Hang Xu Shikui Ma Jianzhuang Liu Xiaodan Liang LM&Ro 37 6 0 29 May 2024
Adaptive In-conversation Team Building for Language Model Agents Linxin Song Jiale Liu Jieyu Zhang Shaokun Zhang Ao Luo Shijian Wang Qingyun Wu Chi Wang LLMAG 71 10 0 29 May 2024
VICtoR: Learning Hierarchical Vision-Instruction Correlation Rewards for Long-horizon Manipulation Kuo-Han Hung Pang-Chi Lo Jia-Fong Yeh Han-Yuan Hsu Yi-Ting Chen Winston H. Hsu 33 0 0 26 May 2024
AutoManual: Generating Instruction Manuals by LLM Agents via Interactive Environmental Learning Minghao Chen Yihang Li Yanting Yang Shiyu Yu Binbin Lin Xiaofei He LLMAG 38 1 0 25 May 2024
Towards Efficient LLM Grounding for Embodied Multi-Agent Collaboration Yang Zhang Shixin Yang Chenjia Bai Fei Wu Xiu Li Zhen Wang Xuelong Li LLMAG 36 25 0 23 May 2024
Agent Planning with World Knowledge Model Shuofei Qiao Runnan Fang Ningyu Zhang Yuqi Zhu Xiang Chen Shumin Deng Yong-jia Jiang Pengjun Xie Fei Huang Huajun Chen LLMAG LM&Ro 95 14 0 23 May 2024
A Survey on Vision-Language-Action Models for Embodied AI Yueen Ma Zixing Song Yuzheng Zhuang Jianye Hao Irwin King LM&Ro 82 42 0 23 May 2024
MeteoRA: Multiple-tasks Embedded LoRA for Large Language Models Jingwei Xu Junyu Lai Yunpeng Huang MoE MoMe 38 8 0 19 May 2024
Motion Avatar: Generate Human and Animal Avatars with Arbitrary Motion Zeyu Zhang Yiran Wang Biao Wu Shuo Chen Zhiyuan Zhang Shiya Huang Wenbo Zhang Meng Fang Ling-Hao Chen Yang Zhao VGen 43 6 0 18 May 2024
When LLMs step into the 3D World: A Survey and Meta-Analysis of 3D Tasks via Multi-modal Large Language Models Xianzheng Ma Yash Bhalgat Brandon Smart Shuai Chen Xinghui Li ... Matthias Nießner Ian D Reid Angel X. Chang Iro Laina V. Prisacariu LRM 33 13 0 16 May 2024
Integrating Intent Understanding and Optimal Behavior Planning for Behavior Tree Generation from Human Instructions Xinglin Chen Yishuai Cai Yunxin Mao Minglong Li Wenjing Yang Weixia Xu Ji Wang 51 6 0 13 May 2024
HELPER-X: A Unified Instructable Embodied Agent to Tackle Four Interactive Vision-Language Domains with Memory-Augmented Language Models Gabriel H. Sarch Sahil Somani Raghav Kapoor Michael J. Tarr Katerina Fragkiadaki LM&Ro LLMAG 34 3 0 29 Apr 2024
From Persona to Personalization: A Survey on Role-Playing Language Agents Jiangjie Chen Xintao Wang Rui Xu Siyu Yuan Yikai Zhang ... Caiyu Hu Siye Wu Scott Ren Ziquan Fu Yanghua Xiao 62 77 0 28 Apr 2024
Socratic Planner: Self-QA-Based Zero-Shot Planning for Embodied Instruction Following Suyeon Shin Sujin Jeon Junghyun Kim Gi-Cheon Kang Byoung-Tak Zhang LLMAG 36 0 0 21 Apr 2024
AgentKit: Flow Engineering with Graphs, not Coding Yue Wu Yewen Fan So Yeon Min Shrimai Prabhumoye Stephen Marcus McAleer Yonatan Bisk Ruslan Salakhutdinov Yuanzhi Li Tom Michael Mitchell AI4CE 46 0 0 17 Apr 2024
Towards Human Awareness in Robot Task Planning with Large Language Models Yuchen Liu Luigi Palmieri Sebastian Koch Ilche Georgievski Marco Aiello LM&Ro 29 6 0 17 Apr 2024
OVAL-Prompt: Open-Vocabulary Affordance Localization for Robot Manipulation through LLM Affordance-Grounding Edmond Tong Anthony Opipari Stanley Lewis Zhen Zeng Odest Chadwicke Jenkins LM&Ro 18 11 0 17 Apr 2024
Generating consistent PDDL domains with Large Language Models Pavel Smirnov Frank Joublin Antonello Ceravola Michael Gienger 48 7 0 11 Apr 2024
Do We Really Need a Complex Agent System? Distill Embodied Agent into a Single Model Zhonghan Zhao Ke Ma Wenhao Chai Xuan Wang Kewei Chen Dongxu Guo Yanting Zhang Hongwei Wang Gaoang Wang 40 14 0 06 Apr 2024
Capabilities of Large Language Models in Control Engineering: A Benchmark Study on GPT-4, Claude 3 Opus, and Gemini 1.0 Ultra Darioush Kevian U. Syed Xing-ming Guo Aaron J. Havens Geir Dullerud Peter M. Seiler Lianhui Qin Bin Hu ELM 44 29 0 04 Apr 2024