Neural Task Programming: Learning to Generalize Across Hierarchical Tasks

4 October 2017

Li Fei-Fei

Silvio Savarese

ArXiv PDF HTML

Papers citing "Neural Task Programming: Learning to Generalize Across Hierarchical Tasks"

50 / 116 papers shown

Title
RobotIQ: Empowering Mobile Robots with Human-Level Planning for Real-World Execution Emmanuel K. Raptis Athanasios Ch. Kapoutsis Elias B. Kosmatopoulos LM&Ro 82 0 0 18 Feb 2025
DeformPAM: Data-Efficient Learning for Long-horizon Deformable Object Manipulation via Preference-based Action Alignment Wendi Chen Han Xue Fangyuan Zhou Yuan Fang Cewu Lu 46 1 0 15 Oct 2024
BUMBLE: Unifying Reasoning and Acting with Vision-Language Models for Building-wide Mobile Manipulation Rutav Shah Albert Yu Yifeng Zhu Yuke Zhu Roberto Martín-Martín LM&Ro 45 6 0 08 Oct 2024
Points2Plans: From Point Clouds to Long-Horizon Plans with Composable Relational Dynamics Yixuan Huang Christopher Agia Jimmy Wu Tucker Hermans Jeannette Bohg 3DPC 49 1 0 27 Aug 2024
Language models are robotic planners: reframing plans as goal refinement graphs Ateeq Sharfuddin Travis Breaux LLMAG LM&Ro 32 1 0 22 Jul 2024
Task and Motion Planning for Execution in the Real Tianyang Pan Rahul Shome Lydia E. Kavraki 58 2 0 05 Jun 2024
RoboMP $^2$ : A Robotic Multimodal Perception-Planning Framework with Multimodal Large Language Models Qi Lv Haochuan Li Xiang Deng Rui Shao Michael Yu Wang Liqiang Nie LRM LM&Ro 42 1 0 07 Apr 2024
A Survey of Optimization-based Task and Motion Planning: From Classical To Learning Approaches Zhigen Zhao Shuo Cheng Yan Ding Ziyi Zhou Shiqi Zhang Danfei Xu Ye Zhao 46 22 0 03 Apr 2024
Learning Alternative Ways of Performing a Task David Nieves Maria Jose Ram’irez Quintana Carlos Monserrat Aranda Cesar Ferri José Hernández-Orallo 27 2 0 03 Apr 2024
OAKINK2: A Dataset of Bimanual Hands-Object Manipulation in Complex Task Completion Xinyu Zhan Lixin Yang Yifei Zhao Kangrui Mao Hanlin Xu Zenan Lin Kailin Li Cewu Lu 38 20 0 28 Mar 2024
InfoCon: Concept Discovery with Generative and Discriminative Informativeness Ruizhe Liu Qian Luo Yanchao Yang 40 2 0 14 Mar 2024
Efficient Data Collection for Robotic Manipulation via Compositional Generalization Jensen Gao Annie Xie Ted Xiao Chelsea Finn Dorsa Sadigh 29 19 0 08 Mar 2024
One-shot Imitation in a Non-Stationary Environment via Multi-Modal Skill Sangwoo Shin Daehee Lee Minjong Yoo Woo Kyung Kim Honguk Woo 32 10 0 13 Feb 2024
Learning by Watching: A Review of Video-based Learning Approaches for Robot Manipulation Chrisantus Eze Christopher Crick SSL 82 12 0 11 Feb 2024
Neural Slot Interpreters: Grounding Object Semantics in Emergent Slot Representations Bhishma Dedhia N. Jha OCL 54 1 0 02 Feb 2024
Explicit-Implicit Subgoal Planning for Long-Horizon Tasks with Sparse Reward Fangyuan Wang Anqing Duan Peng Zhou Shengzeng Huo Guodong Guo Chenguang Yang D. Navarro-Alarcon OffRL VLM 41 0 0 25 Dec 2023
SkillDiffuser: Interpretable Hierarchical Planning via Skill Abstractions in Diffusion-Based Task Execution Zhixuan Liang Yao Mu Hengbo Ma Masayoshi Tomizuka Mingyu Ding Ping Luo 33 38 0 18 Dec 2023
Look Before You Leap: Unveiling the Power of GPT-4V in Robotic Vision-Language Planning Yingdong Hu Fanqi Lin Tong Zhang Li Yi Yang Gao LM&Ro 91 102 0 29 Nov 2023
Universal Visual Decomposer: Long-Horizon Manipulation Made Easy Zichen Zhang Yunshuang Li Osbert Bastani Abhishek Gupta Dinesh Jayaraman Yecheng Jason Ma Luca Weihs 37 17 0 12 Oct 2023
Compositional Servoing by Recombining Demonstrations Max Argus Abhijeet Nayak Martin Buchner Silvio Galesso Abhinav Valada Thomas Brox 33 0 0 06 Oct 2023
Knowledge-Driven Robot Program Synthesis from Human VR Demonstrations Bastian Alt Franklin Kenghagho Kenfack Andrei Haidu Darko Katic Rainer Jäkel Michael Beetz 25 1 0 05 Jun 2023
Chain-of-Thought Predictive Control Zhiwei Jia Vineet Thumuluri Fangchen Liu Ling-Hao Chen Zhiao Huang H. Su LM&Ro 39 20 0 03 Apr 2023
Errors are Useful Prompts: Instruction Guided Task Programming with Verifier-Assisted Iterative Prompting Marta Skreta Naruki Yoshikawa Sebastian Arellano-Rubach Zhi Ji L. B. Kristensen Kourosh Darvish Alán Aspuru-Guzik Florian Shkurti Animesh Garg 80 56 0 24 Mar 2023
Hierarchical Neural Program Synthesis Linghan Zhong Ryan Lindeborg Jesse Zhang Joseph J. Lim Shao-Hua Sun 32 9 0 09 Mar 2023
Grounded Decoding: Guiding Text Generation with Grounded Models for Embodied Agents Wenlong Huang Fei Xia Dhruv Shah Danny Driess Andy Zeng ... Pete Florence Igor Mordatch Sergey Levine Karol Hausman Brian Ichter LM&Ro 27 42 0 01 Mar 2023
MimicPlay: Long-Horizon Imitation Learning by Watching Human Play Chen Wang Linxi Fan Jiankai Sun Ruohan Zhang Li Fei-Fei Danfei Xu Yuke Zhu Anima Anandkumar 44 184 0 24 Feb 2023
Multimodal Subtask Graph Generation from Instructional Videos Y. Jang Sungryull Sohn Lajanugen Logeswaran Tiange Luo Moontae Lee Ho Hin Lee 28 10 0 17 Feb 2023
Cross-Domain Transfer via Semantic Skill Imitation Karl Pertsch Ruta Desai Vikash Kumar Franziska Meier Joseph J. Lim Dhruv Batra Akshara Rai LM&Ro 16 18 0 14 Dec 2022
NeuroCERIL: Robotic Imitation Learning via Hierarchical Cause-Effect Reasoning in Programmable Attractor Neural Networks Gregory P. Davis Garrett E. Katz R. Gentili J. Reggia NAI 35 1 0 11 Nov 2022
LEAGUE: Guided Skill Learning and Abstraction for Long-Horizon Manipulation Shuo Cheng Danfei Xu 54 37 0 23 Oct 2022
STAP: Sequencing Task-Agnostic Policies Christopher Agia Toki Migimatsu Jiajun Wu Jeannette Bohg 43 19 0 21 Oct 2022
Generating Executable Action Plans with Environmentally-Aware Language Models Maitrey Gramopadhye D. Szafir LM&Ro LLMAG 23 22 0 10 Oct 2022
ProgPrompt: Generating Situated Robot Task Plans using Large Language Models Ishika Singh Valts Blukis Arsalan Mousavian Ankit Goyal Danfei Xu Jonathan Tremblay Dieter Fox Jesse Thomason Animesh Garg LM&Ro LLMAG 123 626 0 22 Sep 2022
Latent Plans for Task-Agnostic Offline Reinforcement Learning Erick Rosete-Beas Oier Mees Gabriel Kalweit Joschka Boedecker Wolfram Burgard OffRL 39 81 0 19 Sep 2022
How to Reuse and Compose Knowledge for a Lifetime of Tasks: A Survey on Continual Learning and Functional Composition Jorge Armando Mendez Mendez Eric Eaton KELM CLL 32 27 0 15 Jul 2022
Inner Monologue: Embodied Reasoning through Planning with Language Models Wenlong Huang F. Xia Ted Xiao Harris Chan Jacky Liang ... Tomas Jackson Linda Luu Sergey Levine Karol Hausman Brian Ichter LLMAG LM&Ro LRM 41 860 0 12 Jul 2022
TASKOGRAPHY: Evaluating robot task planning over large 3D scene graphs Christopher Agia Krishna Murthy Jatavallabhula M. Khodeir O. Mikšík Vibhav Vineet Mustafa Mukadam Liam Paull Florian Shkurti 27 68 0 11 Jul 2022
Fast Inference and Transfer of Compositional Task Structures for Few-shot Task Generalization Sungryull Sohn Hyunjae Woo Jongwook Choi lyubing qiang Izzeddin Gur Aleksandra Faust Honglak Lee BDL OffRL 31 3 0 25 May 2022
Chain of Thought Imitation with Procedure Cloning Mengjiao Yang Dale Schuurmans Pieter Abbeel Ofir Nachum OffRL 32 30 0 22 May 2022
Creative Problem Solving in Artificially Intelligent Agents: A Survey and Framework Evana Gizzi Lakshmi Nair Sonia Chernova Jivko Sinapov AI4CE 29 13 0 21 Apr 2022
Do As I Can, Not As I Say: Grounding Language in Robotic Affordances Michael Ahn Anthony Brohan Noah Brown Yevgen Chebotar Omar Cortes ... Ted Xiao Peng Xu Sichun Xu Mengyuan Yan Andy Zeng LM&Ro 60 1,853 0 04 Apr 2022
Learning Parameterized Task Structure for Generalization to Unseen Entities Anthony Z. Liu Sungryull Sohn Mahdi Qazwini Honglak Lee 9 6 0 28 Mar 2022
Learning Sensorimotor Primitives of Sequential Manipulation Tasks from Visual Demonstrations Junchi Liang Bowen Wen Kostas Bekris Abdeslam Boularias SSL 10 12 0 08 Mar 2022
LISA: Learning Interpretable Skill Abstractions from Language Divyansh Garg Skanda Vaidyanath Kuno Kim Jiaming Song Stefano Ermon LM&Ro OffRL 156 29 0 28 Feb 2022
Transporters with Visual Foresight for Solving Unseen Rearrangement Tasks Hongtao Wu Jikai Ye Xin Meng Chris Paxton Gregory Chirikjian 74 17 0 22 Feb 2022
STIR $^2$ : Reward Relabelling for combined Reinforcement and Imitation Learning on sparse-reward tasks Jesús Bujalance Martín Fabien Moutarde OffRL 33 2 0 11 Jan 2022
Ex-DoF: Expansion of Action Degree-of-Freedom with Virtual Camera Rotation for Omnidirectional Image Kosuke Tahara Noriaki Hirose 36 2 0 24 Nov 2021
Generation Drawing/Grinding Trajectoy Based on Hierarchical CVAE Masahiro Aita Keito Sugawara S. Sakaino T. Tsuji 4 1 0 22 Nov 2021
Visual Goal-Directed Meta-Learning with Contextual Planning Networks Corban G. Rivera D. Handelman 39 0 0 18 Nov 2021
GRI: General Reinforced Imitation and its Application to Vision-Based Autonomous Driving Raphael Chekroun Marin Toromanoff Sascha Hornauer Fabien Moutarde 39 60 0 16 Nov 2021