ProgPrompt: Generating Situated Robot Task Plans using Large Language Models

22 September 2022

Papers citing "ProgPrompt: Generating Situated Robot Task Plans using Large Language Models"

50 / 460 papers shown

Title
Foundation Models in Robotics: Applications, Challenges, and the Future Roya Firoozi Johnathan Tucker Stephen Tian Anirudha Majumdar Jiankai Sun ... Brian Ichter Danny Driess Jiajun Wu Cewu Lu Mac Schwager LM&Ro AI4CE LRM VLM 108 161 0 13 Dec 2023
ThinkBot: Embodied Instruction Following with Thought Chain Reasoning Guanxing Lu Ziwei Wang Changliu Liu Jiwen Lu Yansong Tang LRM 78 12 0 12 Dec 2023
Interactive Planning Using Large Language Models for Partially Observable Robotics Tasks Lingfeng Sun Devesh K. Jha Chiori Hori Siddarth Jain Radu Corcodel Xinghao Zhu Masayoshi Tomizuka Diego Romeres LM&Ro LLMAG 94 24 0 11 Dec 2023
DiffVL: Scaling Up Soft Body Manipulation using Vision-Language Driven Differentiable Physics Zhiao Huang Feng Chen Yewen Pu Chun-Tse Lin Hao Su Chuang Gan 76 5 0 11 Dec 2023
Vision-based Learning for Drones: A Survey Jiaping Xiao Rangya Zhang Yuhang Zhang Mir Feroskhan 68 5 0 08 Dec 2023
Chain of Code: Reasoning with a Language Model-Augmented Code Emulator Chengshu Li Jacky Liang Andy Zeng Xinyun Chen Karol Hausman Dorsa Sadigh Sergey Levine Fei-Fei Li Fei Xia Brian Ichter LLMAG LRM 105 83 0 07 Dec 2023
LaMPilot: An Open Benchmark Dataset for Autonomous Driving with Language Model Programs Yunsheng Ma Can Cui Xu Cao Wenqian Ye Peiran Liu ... Rohit Gupta Kyungtae Han Aniket Bera James M. Rehg Ziran Wang 69 45 0 07 Dec 2023
Human Demonstrations are Generalizable Knowledge for Robots Te Cui Guangyan Chen Tianxing Zhou Zicai Peng Mengxiao Hu Haoyang Lu Haizhou Li Meiling Wang Yi Yang Yufeng Yue LM&Ro 90 6 0 05 Dec 2023
Foundation Models for Weather and Climate Data Understanding: A Comprehensive Survey Shengchao Chen Guodong Long Jing Jiang Dikai Liu Chengqi Zhang SyDa AI4CE 129 25 0 05 Dec 2023
SAGE: Bridging Semantic and Actionable Parts for GEneralizable Manipulation of Articulated Objects Haoran Geng Songlin Wei Congyue Deng Bokui Shen He Wang Leonidas Guibas LM&Ro 83 3 0 03 Dec 2023
Swarm-GPT: Combining Large Language Models with Safe Motion Planning for Robot Choreography Design Aoran Jiao Tanmay P. Patel Sanjmi Khurana Anna-Mariya Korol Lukas Brunke V. K. Adajania Utku Çulha Siqi Zhou Angela P. Schoellig 88 16 0 02 Dec 2023
Look Before You Leap: Unveiling the Power of GPT-4V in Robotic Vision-Language Planning Yingdong Hu Fanqi Lin Tong Zhang Li Yi Yang Gao LM&Ro 176 124 0 29 Nov 2023
LLM-State: Open World State Representation for Long-horizon Task Planning with Large Language Model Siwei Chen Anxing Xiao David Hsu LM&Ro 79 8 0 29 Nov 2023
LEAP: LLM-Generation of Egocentric Action Programs Eadom Dessalene Michael Maynord Cornelia Fermuller Yiannis Aloimonos 85 2 0 29 Nov 2023
RoboGPT: an intelligent agent of making embodied long-term decisions for daily instruction tasks Yaran Chen Wenbo Cui Yuanwen Chen Mining Tan Xinyao Zhang Dong Zhao He Wang LM&Ro LLMAG 78 0 0 27 Nov 2023
Robot Learning in the Era of Foundation Models: A Survey Xuan Xiao Jiahang Liu Zhipeng Wang Yanmin Zhou Yong Qi Qian Cheng Bin He Shuo Jiang AI4CE LM&Ro 158 29 0 24 Nov 2023
De-fine: Decomposing and Refining Visual Programs with Auto-Feedback Minghe Gao Juncheng Li Hao Fei Liang Pang Wei Ji Guoming Wang Wenqiao Zhang Siliang Tang Yueting Zhuang 73 9 0 21 Nov 2023
A Survey on Multimodal Large Language Models for Autonomous Driving Can Cui Yunsheng Ma Xu Cao Wenqian Ye Yang Zhou ... Xinrui Yan Shuqi Mei Jianguo Cao Ziran Wang Chao Zheng 169 291 0 21 Nov 2023
GPT-4V(ision) for Robotics: Multimodal Task Planning from Human Demonstration Naoki Wake Atsushi Kanehira Kazuhiro Sasabuchi Jun Takamatsu Katsushi Ikeuchi LM&Ro 81 69 0 20 Nov 2023
Deploying and Evaluating LLMs to Program Service Mobile Robots Zichao Hu Francesca Lucchetti Claire Schlesinger Yash Saxena Anders Freeman Sadanand Modak Arjun Guha Joydeep Biswas 93 41 0 18 Nov 2023
Distilling and Retrieving Generalizable Knowledge for Robot Manipulation via Language Corrections Lihan Zha Yuchen Cui Li-Heng Lin Minae Kwon Montse Gonzalez Arenas Andy Zeng Fei Xia Dorsa Sadigh 109 37 0 17 Nov 2023
Code Models are Zero-shot Precondition Reasoners Lajanugen Logeswaran Sungryull Sohn Yiwei Lyu Anthony Z. Liu Dong-Ki Kim Dongsub Shim Moontae Lee Honglak Lee LRM 62 2 0 16 Nov 2023
JARVIS-1: Open-World Multi-task Agents with Memory-Augmented Multimodal Language Models Zihao Wang Shaofei Cai Hoang Trung-Dung Yonggang Jin Jinbing Hou ... Zhaofeng He Zilong Zheng Yaodong Yang Xiaojian Ma Yitao Liang LLMAG LM&Ro 121 108 0 10 Nov 2023
Everything of Thoughts: Defying the Law of Penrose Triangle for Thought Generation Ruomeng Ding Chaoyun Zhang Lu Wang Yong Xu Ming-Jie Ma Wei Zhang Si Qin Saravan Rajmohan Qingwei Lin Dongmei Zhang LRM 113 68 0 07 Nov 2023
Kinematic-aware Prompting for Generalizable Articulated Object Manipulation with LLMs Wenke Xia Dong Wang Xincheng Pang Zhigang Wang Bin Zhao Di Hu Xuelong Li LM&Ro 115 21 0 06 Nov 2023
Vision-Language Interpreter for Robot Task Planning Keisuke Shirai C. C. Beltran-Hernandez Masashi Hamaya Atsushi Hashimoto Shohei Tanaka Kento Kawaharazuka Kazutoshi Tanaka Yoshitaka Ushiku Shinsuke Mori LM&Ro 88 29 0 02 Nov 2023
M2T2: Multi-Task Masked Transformer for Object-centric Pick and Place Wentao Yuan Adithyavairavan Murali Arsalan Mousavian Dieter Fox 104 24 0 02 Nov 2023
CoLLM: Integrating Collaborative Embeddings into Large Language Models for Recommendation Yang Zhang Fuli Feng Jizhi Zhang Keqin Bao Qifan Wang Xiangnan He 97 88 0 30 Oct 2023
Interactive Robot Learning from Verbal Correction Huihan Liu Alice Chen Yuke Zhu Adith Swaminathan Andrey Kolobov Ching-An Cheng KELM LM&Ro 102 15 0 26 Oct 2023
Conditionally Combining Robot Skills using Large Language Models K.R. Zentner Ryan Julian Brian Ichter Gaurav Sukhatme 56 1 0 25 Oct 2023
WebWISE: Web Interface Control and Sequential Exploration with Large Language Models Heyi Tao TV Sethuraman Michal Shlapentokh-Rothman Derek Hoiem LLMAG 116 6 0 24 Oct 2023
Creative Robot Tool Use with Large Language Models Mengdi Xu Peide Huang Wenhao Yu Shiqi Liu Xilun Zhang Yaru Niu Tingnan Zhang Fei Xia Jie Tan Ding Zhao LM&Ro LLMAG 112 42 0 19 Oct 2023
Eureka: Human-Level Reward Design via Coding Large Language Models Yecheng Jason Ma William Liang Guanzhi Wang De-An Huang Osbert Bastani Dinesh Jayaraman Yuke Zhu Linxi Fan A. Anandkumar 85 325 0 19 Oct 2023
Exploring Large Language Models as a Source of Common-Sense Knowledge for Robots Felix Ocker J. Deigmöller Julian Eggert LM&Ro 74 9 0 19 Oct 2023
Navigation with Large Language Models: Semantic Guesswork as a Heuristic for Planning Dhruv Shah Michael Equi B. Osinski Fei Xia Brian Ichter Sergey Levine 3DV LM&Ro 94 102 0 16 Oct 2023
Bootstrap Your Own Skills: Learning to Solve New Tasks with Large Language Model Guidance Jesse Zhang Jiahui Zhang Karl Pertsch Ziyi Liu Xiang Ren Minsuk Chang Shao-Hua Sun Joseph J Lim LLMAG LM&Ro 198 65 0 16 Oct 2023
Interactive Task Planning with Language Models Boyi Li Philipp Wu Pieter Abbeel Jitendra Malik LM&Ro 114 38 0 16 Oct 2023
Penetrative AI: Making LLMs Comprehend the Physical World Huatao Xu Liying Han Qirui Yang Mo Li Mani Srivastava 75 62 0 14 Oct 2023
LgTS: Dynamic Task Sampling using LLM-generated sub-goals for Reinforcement Learning Agents Yash Shukla Wenchang Gao Vasanth Sarathy Alvaro Velasquez Robert Wright Jivko Sinapov 119 11 0 14 Oct 2023
Compositional Abilities Emerge Multiplicatively: Exploring Diffusion Models on a Synthetic Task Maya Okawa Ekdeep Singh Lubana Robert P. Dick Hidenori Tanaka CoGe DiffM 119 65 0 13 Oct 2023
LLaMA Rider: Spurring Large Language Models to Explore the Open World Yicheng Feng Yuxuan Wang Jiazheng Liu Sipeng Zheng Zongqing Lu LLMAG LRM 80 18 0 13 Oct 2023
Tree-Planner: Efficient Close-loop Task Planning with Large Language Models Mengkang Hu Yao Mu Xinmiao Yu Mingyu Ding Shiguang Wu Wenqi Shao Qiguang Chen Bin Wang Yu Qiao Ping Luo LLMAG 115 39 0 12 Oct 2023
LangNav: Language as a Perceptual Representation for Navigation Bowen Pan Yikang Shen SouYoung Jin Rogerio Feris Aude Oliva Phillip Isola Yoon Kim LM&Ro 93 21 0 11 Oct 2023
CoPAL: Corrective Planning of Robot Actions with Large Language Models Frank Joublin Antonello Ceravola Pavel Smirnov Felix Ocker Joerg Deigmoeller Anna Belardinelli Chao Wang Stephan Hasler Daniel Tanneberg Michael Gienger LM&Ro LLMAG 110 37 0 11 Oct 2023
Words into Action: Learning Diverse Humanoid Robot Behaviors using Language Guided Iterative Motion Refinement K. N. Kumar Irfan Essa Sehoon Ha 74 6 0 10 Oct 2023
Compositional Semantics for Open Vocabulary Spatio-semantic Representations Robin Karlsson Francisco Lepe-Salazar K. Takeda VLM 78 1 0 08 Oct 2023
LanguageMPC: Large Language Models as Decision Makers for Autonomous Driving Hao Sha Yao Mu Yuxuan Jiang Li Chen Chenfeng Xu Ping Luo Shengbo Eben Li Masayoshi Tomizuka Wei Zhan Mingyu Ding 265 179 0 04 Oct 2023
Cook2LTL: Translating Cooking Recipes to LTL Formulae using Large Language Models A. Mavrogiannis Christoforos Mavrogiannis Yiannis Aloimonos LM&Ro 71 12 0 29 Sep 2023
OceanChat: Piloting Autonomous Underwater Vehicles in Natural Language Jia Huang Mengxue Hou Junkai Wang Fumin Zhang 87 5 0 27 Sep 2023
DynaCon: Dynamic Robot Planner with Contextual Awareness via LLMs Gyeongmin Kim Taehyeon Kim S. S. Kannan Vishnunandan L. N. Venkatesh Dong-Hoe Kim Byung-Cheol Min 26 4 0 27 Sep 2023