Learning Compositional Behaviors from Demonstration and Language

28 May 2025

Author Contacts:

Papers citing "Learning Compositional Behaviors from Demonstration and Language"

50 / 67 papers shown

Title
Symbolically-Guided Visual Plan Inference from Uncurated Video Data Wenyan Yang Ahmet Tikna Yi Zhao Yuying Zhang Luigi Palopoli Marco Roveri Joni Pajarinen VGen 48 0 0 13 May 2025
LLMs as Planning Modelers: A Survey for Leveraging Large Language Models to Construct Automated Planning Models Marcus Tantakoun Xiaodan Zhu Christian Muise 89 6 0 22 Mar 2025
Learning Generalizable Language-Conditioned Cloth Manipulation from Long Demonstrations Hanyi Zhao Jinxuan Zhu Zihao Yan Yichen Li Yuhong Deng Xueqian Wang SSL 109 0 0 06 Mar 2025
Bilevel Learning for Bilevel Planning Bowen Li Tom Silver Sebastian A. Scherer Alexander G. Gray 232 2 0 12 Feb 2025
From Pixels to Predicates: Learning Symbolic World Models via Pretrained Vision-Language Models Ashay Athalye Nishanth Kumar Tom Silver Yichao Liang Tomás Lozano-Pérez Leslie Pack Kaelbling Leslie Kaelbling LM&Ro 67 6 0 31 Dec 2024
InterPreT: Interactive Predicate Learning from Language Feedback for Generalizable Task Planning Muzhi Han Yifeng Zhu Song-Chun Zhu Yingnian Wu Yuke Zhu 64 27 0 30 May 2024
Plan-Seq-Learn: Language Model Guided RL for Solving Long Horizon Robotics Tasks Murtaza Dalal Tarun Chiruvolu Devendra Singh Chaplot Ruslan Salakhutdinov LM&Ro 102 43 0 02 May 2024
Generating consistent PDDL domains with Large Language Models Pavel Smirnov Frank Joublin Antonello Ceravola Michael Gienger 75 9 0 11 Apr 2024
Yell At Your Robot: Improving On-the-Fly from Language Corrections Lucy Xiaoyang Shi Zheyuan Hu Tony Zhao Archit Sharma Karl Pertsch Jianlan Luo Sergey Levine Chelsea Finn LM&Ro 117 68 0 19 Mar 2024
MOSAIC: A Modular System for Assistive and Interactive Cooking Huaxiaoyue Wang Kushal Kedia Juntao Ren Rahma Abdullah Atiksh Bhardwaj ... Maximus Adrian Pace Yash Sharma Xiangwan Sun Neha Sunkara Sanjiban Choudhury 73 13 0 29 Feb 2024
From Real World to Logic and Back: Learning Generalizable Relational Concepts For Long Horizon Robot Planning Naman Shah Jayesh Nagpal Pulkit Verma NAI 78 9 0 19 Feb 2024
3D Diffuser Actor: Policy Diffusion with 3D Scene Representations Tsung-Wei Ke N. Gkanatsios Katerina Fragkiadaki VGen 77 124 0 16 Feb 2024
LLMs Can't Plan, But Can Help Planning in LLM-Modulo Frameworks Subbarao Kambhampati Karthik Valmeekam L. Guan Mudit Verma Kaya Stechly Siddhant Bhambri Lucas Saldyt Anil Murthy LRM 118 123 0 02 Feb 2024
RePLan: Robotic Replanning with Perception and Language Models Marta Skreta Zihan Zhou Jia Lin Yuan Kourosh Darvish Alán Aspuru-Guzik Animesh Garg LM&Ro LRM 76 26 0 08 Jan 2024
Symbolic Manipulation Planning with Discovered Object and Relational Predicates Alper Ahmetoglu Erhan Öztop Emre Ugur 76 6 0 02 Jan 2024
Learning adaptive planning representations with natural language guidance L. Wong Jiayuan Mao Pratyusha Sharma Zachary S. Siegel Jiahai Feng Noa Korneev Joshua B. Tenenbaum Jacob Andreas LM&Ro 68 28 0 13 Dec 2023
Look Before You Leap: Unveiling the Power of GPT-4V in Robotic Vision-Language Planning Yingdong Hu Fanqi Lin Tong Zhang Li Yi Yang Gao LM&Ro 142 120 0 29 Nov 2023
LOTUS: Continual Imitation Learning for Robot Manipulation Through Unsupervised Skill Discovery Weikang Wan Yifeng Zhu Rutav Shah Yuke Zhu SSL LM&Ro VLM CLL 69 26 0 03 Nov 2023
Human-in-the-Loop Task and Motion Planning for Imitation Learning Ajay Mandlekar Caelan Reed Garrett Danfei Xu Dieter Fox 85 17 0 24 Oct 2023
Universal Visual Decomposer: Long-Horizon Manipulation Made Easy Zichen Zhang Yunshuang Li Osbert Bastani Abhishek Gupta Dinesh Jayaraman Yecheng Jason Ma Luca Weihs 68 19 0 12 Oct 2023
Cook2LTL: Translating Cooking Recipes to LTL Formulae using Large Language Models A. Mavrogiannis Christoforos Mavrogiannis Yiannis Aloimonos LM&Ro 53 12 0 29 Sep 2023
Multi-Stage Cable Routing through Hierarchical Imitation Learning Jianlan Luo Charles Xu Xinyang Geng Gilbert Feng Kuan Fang L. Tan S. Schaal Sergey Levine 80 57 0 18 Jul 2023
Embodied Task Planning with Large Language Models Zhenyu Wu Ziwei Wang Xiuwei Xu Jiwen Lu Haibin Yan LM&Ro LLMAG 52 74 0 04 Jul 2023
RoboCook: Long-Horizon Elasto-Plastic Object Manipulation with Diverse Tools Haochen Shi Huazhe Xu Samuel Clarke Yunzhu Li Jiajun Wu LM&Ro 56 62 0 26 Jun 2023
AutoTAMP: Autoregressive Task and Motion Planning with LLMs as Translators and Checkers Yongchao Chen Jacob Arkin Charles Dawson Yang Zhang Nicholas Roy Chuchu Fan LRM 59 110 0 10 Jun 2023
Recognize Anything: A Strong Image Tagging Model Youcai Zhang Xinyu Huang Jinyu Ma Zhaoyang Li Zhaochuan Luo ... Tong Luo Yaqian Li Siyi Liu Yandong Guo Lei Zhang VLM 111 238 0 06 Jun 2023
Ghost in the Minecraft: Generally Capable Agents for Open-World Environments via Large Language Models with Text-based Knowledge and Memory Xizhou Zhu Yuntao Chen Hao Tian Chenxin Tao Weijie Su ... Lewei Lu Xiaogang Wang Yu Qiao Zhaoxiang Zhang Jifeng Dai LLMAG LM&Ro 69 233 0 25 May 2023
On the Planning Abilities of Large Language Models : A Critical Investigation Karthik Valmeekam Matthew Marquez S. Sreedharan Subbarao Kambhampati LLMAG LRM 48 233 0 25 May 2023
Reasoning with Language Model is Planning with World Model Shibo Hao Yi Gu Haodi Ma Joshua Jiahua Hong Zhen Wang D. Wang Zhiting Hu ReLM LRM LLMAG 136 579 0 24 May 2023
Leveraging Pre-trained Large Language Models to Construct and Utilize World Models for Model-based Task Planning L. Guan Karthik Valmeekam S. Sreedharan Subbarao Kambhampati LLMAG 65 172 0 24 May 2023
Generalized Planning in PDDL Domains with Pretrained Large Language Models Tom Silver Soham Dan Kavitha Srinivas J. Tenenbaum L. Kaelbling Michael Katz ELM LRM 89 128 0 18 May 2023
Latent Space Planning for Multi-Object Manipulation with Environment-Aware Relational Classifiers Yixuan Huang Nichols Crawford Taylor Adam Conkey Weiyu Liu Tucker Hermans 78 7 0 18 May 2023
Language Models Meet World Models: Embodied Experiences Enhance Language Models Jiannan Xiang Tianhua Tao Yi Gu Tianmin Shu Zirui Wang Zichao Yang Zhiting Hu ALM LLMAG LM&Ro CLL 68 103 0 18 May 2023
LLM+P: Empowering Large Language Models with Optimal Planning Proficiency B. Liu Yuqian Jiang Xiaohan Zhang Qian Liu Shiqi Zhang Joydeep Biswas Peter Stone LM&Ro LLMAG 81 412 0 22 Apr 2023
ChatGPT Empowered Long-Step Robot Control in Various Environments: A Case Application Naoki Wake Atsushi Kanehira Kazuhiro Sasabuchi Jun Takamatsu Katsushi Ikeuchi LM&Ro 63 83 0 08 Apr 2023
Text2Motion: From Natural Language Instructions to Feasible Plans Kevin Qinghong Lin Christopher Agia Toki Migimatsu Marco Pavone Jeannette Bohg LM&Ro 66 280 0 21 Mar 2023
Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection Shilong Liu Zhaoyang Zeng Tianhe Ren Feng Li Hao Zhang ... Chun-yue Li Jianwei Yang Hang Su Jun Zhu Lei Zhang ObjD 184 1,971 0 09 Mar 2023
Diffusion Policy: Visuomotor Policy Learning via Action Diffusion Cheng Chi Zhenjia Xu S. Feng Eric A. Cousineau Yilun Du Benjamin Burchfiel Russ Tedrake Shuran Song 347 1,189 0 07 Mar 2023
PaLM-E: An Embodied Multimodal Language Model Danny Driess F. Xia Mehdi S. M. Sajjadi Corey Lynch Aakanksha Chowdhery ... Marc Toussaint Klaus Greff Andy Zeng Igor Mordatch Peter R. Florence LM&Ro 109 1,648 0 06 Mar 2023
MimicPlay: Long-Horizon Imitation Learning by Watching Human Play Chen Wang Linxi Fan Jiankai Sun Ruohan Zhang Li Fei-Fei Danfei Xu Yuke Zhu Anima Anandkumar 120 192 0 24 Feb 2023
Translating Natural Language to Planning Goals with Large-Language Models Yaqi Xie Chenyao Yu Tongyao Zhu Jinbin Bai Ze Gong Harold Soh LM&Ro LRM 72 147 0 10 Feb 2023
Do Embodied Agents Dream of Pixelated Sheep: Embodied Decision Making using Language Guided World Modelling Kolby Nottingham Prithviraj Ammanabrolu Alane Suhr Yejin Choi Hannaneh Hajishirzi Sameer Singh Roy Fox LLMAG LM&Ro 76 82 0 28 Jan 2023
Sequence-Based Plan Feasibility Prediction for Efficient Task and Motion Planning Zhutian Yang Caelan Reed Garrett Tomás Lozano-Pérez Leslie Kaelbling Dieter Fox 91 26 0 03 Nov 2022
Grounding Language with Visual Affordances over Unstructured Data Oier Mees Jessica Borja-Diaz Wolfram Burgard LM&Ro 171 112 0 04 Oct 2022
ProgPrompt: Generating Situated Robot Task Plans using Large Language Models Ishika Singh Valts Blukis Arsalan Mousavian Ankit Goyal Danfei Xu Jonathan Tremblay Dieter Fox Jesse Thomason Animesh Garg LM&Ro LLMAG 166 655 0 22 Sep 2022
Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulation Mohit Shridhar Lucas Manuelli Dieter Fox LM&Ro 255 493 0 12 Sep 2022
What Matters in Language Conditioned Robotic Imitation Learning over Unstructured Data Oier Mees Lukás Hermann Wolfram Burgard LM&Ro 103 153 0 13 Apr 2022
Do As I Can, Not As I Say: Grounding Language in Robotic Affordances Michael Ahn Anthony Brohan Noah Brown Yevgen Chebotar Omar Cortes ... Ted Xiao Peng Xu Sichun Xu Mengyuan Yan Andy Zeng LM&Ro 184 1,961 0 04 Apr 2022
Predicate Invention for Bilevel Planning Tom Silver Rohan Chitnis Nishanth Kumar Willie McClinton Tomás Lozano-Pérez L. Kaelbling J. Tenenbaum 178 42 0 17 Mar 2022
Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agents Wenlong Huang Pieter Abbeel Deepak Pathak Igor Mordatch LM&Ro 90 1,108 0 18 Jan 2022