Bootstrap Your Own Skills: Learning to Solve New Tasks with Large Language Model Guidance

16 October 2023

Xiang Ren

Papers citing "Bootstrap Your Own Skills: Learning to Solve New Tasks with Large Language Model Guidance"

50 / 57 papers shown

Title
Real-Time Verification of Embodied Reasoning for Generative Skill Acquisition Bo Yue Shuqi Guo Kaiyu Hu Chujiao Wang Benyou Wang Kui Jia Guiliang Liu LRM 17 0 0 16 May 2025
ReWiND: Language-Guided Rewards Teach Robot Policies without New Demonstrations Jiahui Zhang Yusen Luo Abrar Anwar S. Sontakke Joseph J. Lim Jesse Thomason Erdem Biyik Jesse Zhang OffRL LM&Ro 17 0 0 16 May 2025
Sample Efficient Reinforcement Learning via Large Vision Language Model Distillation Donghoon Lee Tung M. Luu Younghwan Lee Chang D. Yoo OffRL VLM 9 0 0 16 May 2025
A Survey of Personalization: From RAG to Agent Xiaopeng Li Pengyue Jia Derong Xu Yi Wen Yingyi Zhang ... X. Li Y. Liu Huifeng Guo Ruiming Tang Xiangyu Zhao 3DV AI4TS AI4CE 44 0 0 14 Apr 2025
Reward Generation via Large Vision-Language Model in Offline Reinforcement Learning Younghwan Lee Tung M. Luu Donghoon Lee Chang D. Yoo 3DV VLM OffRL 41 0 0 03 Apr 2025
SENSEI: Semantic Exploration Guided by Foundation Models to Learn Versatile World Models Cansu Sancaktar Christian Gumbsch Andrii Zadaianchuk Pavel Kolev Georg Martius LM&Ro VLM 61 1 0 03 Mar 2025
The Evolving Landscape of LLM- and VLM-Integrated Reinforcement Learning Sheila Schoepp Masoud Jafaripour Yingyue Cao Tianpei Yang Fatemeh Abdollahi Shadan Golestan Zahin Sufiyan Osmar Zaiane Matthew E. Taylor OffRL LM&Ro 46 0 0 24 Feb 2025
Learn from the Past: Language-conditioned Object Rearrangement with Large Language Models Guanqun Cao Ryan Mckenna Erich Graf John Oyekan LM&Ro 127 0 0 30 Jan 2025
Latent Reward: LLM-Empowered Credit Assignment in Episodic Reinforcement Learning Yun Qu Yuhang Jiang Boyuan Wang Yixiu Mao Cheems Wang Chang-Shu Liu Xiangyang Ji 80 2 0 10 Jan 2025
AnyBimanual: Transferring Unimanual Policy for General Bimanual Manipulation Guanxing Lu Tengbo Yu Haoyuan Deng Season Si Chen Yansong Tang Ziwei Wang 77 3 0 09 Dec 2024
Vision Language Models are In-Context Value Learners Yecheng Jason Ma Joey Hejna Ayzaan Wahid Chuyuan Fu Dhruv Shah ... Dinesh Jayaraman Wenhao Yu Tingnan Zhang Dorsa Sadigh Fei Xia 54 5 0 07 Nov 2024
Defining and Evaluating Physical Safety for Large Language Models Yung-Chen Tang Pin-Yu Chen Tsung-Yi Ho ELM 32 2 0 04 Nov 2024
Eurekaverse: Environment Curriculum Generation via Large Language Models William Liang Sam Wang Hung-Ju Wang Osbert Bastani Dinesh Jayaraman Yecheng Jason Ma SyDa 36 1 0 04 Nov 2024
Local Policies Enable Zero-shot Long-horizon Manipulation Murtaza Dalal Min Liu Walter Talbott Chen Chen Deepak Pathak Jian Zhang Ruslan Salakhutdinov 38 3 0 29 Oct 2024
Generative AI Agents in Autonomous Machines: A Safety Perspective Jason J. Jabbour Vijay Janapa Reddi AI4CE 43 4 0 20 Oct 2024
Grounding Large Language Models In Embodied Environment With Imperfect World Models Haolan Liu Jishen Zhao LLMAG SyDa AI4CE 28 0 0 03 Oct 2024
Choices are More Important than Efforts: LLM Enables Efficient Multi-Agent Exploration Yun Qu Boyuan Wang Yuhang Jiang Jianzhun Shao Yixiu Mao Cheems Wang Chang Liu Xiangyang Ji 46 4 0 03 Oct 2024
RAG-Modulo: Solving Sequential Tasks using Experience, Critics, and Language Models Abhinav Jain Chris Jermaine Vaibhav Unhelkar KELM LLMAG 31 1 0 18 Sep 2024
AnyBipe: An End-to-End Framework for Training and Deploying Bipedal Robots Guided by Large Language Models Yifei Yao Wentao He Chenyu Gu Jiaheng Du Fuwei Tan Zhen Zhu Junguo Lu OffRL 31 2 0 13 Sep 2024
LLMs are Superior Feedback Providers: Bootstrapping Reasoning for Lie Detection with Self-Generated Feedback Tanushree Banerjee Richard Zhu Runzhe Yang Karthik Narasimhan 37 2 0 25 Aug 2024
Semantic Skill Grounding for Embodied Instruction-Following in Cross-Domain Environments Sangwoo Shin Takehiro Matsuoka Youngsoo Jang Moontae Lee Kazuya Yoshida 38 0 0 02 Aug 2024
Tulip Agent -- Enabling LLM-Based Agents to Solve Tasks Using Large Tool Libraries Felix Ocker Daniel Tanneberg Julian Eggert Michael Gienger LLMAG LM&Ro VLM 42 5 0 31 Jul 2024
Enhancing Agent Learning through World Dynamics Modeling Zhiyuan Sun Haochen Shi Marc-Alexandre Côté Glen Berseth Xingdi Yuan Bang Liu 52 3 0 25 Jul 2024
No Size Fits All: The Perils and Pitfalls of Leveraging LLMs Vary with Company Size Ashok Urlana Charaka Vinayak Kumar B. Garlapati Ajeet Kumar Singh Rahul Mishra 35 1 0 21 Jul 2024
Large Language Model Agents for Improving Engagement with Behavior Change Interventions: Application to Digital Mindfulness Harsh Kumar Suhyeon Yoo Angela M. Zavaleta Bernuy Jiakai Shi Huayin Luo Joseph Jay Williams Anastasia Kuzminykh Ashton Anderson Rachel Kornfield 45 1 0 03 Jul 2024
Sparse Diffusion Policy: A Sparse, Reusable, and Flexible Policy for Robot Learning Yixiao Wang Yifei Zhang Mingxiao Huo Ran Tian Xiang Zhang ... Chenfeng Xu Pengliang Ji Wei Zhan Mingyu Ding M. Tomizuka MoE 36 18 0 01 Jul 2024
HYPERmotion: Learning Hybrid Behavior Planning for Autonomous Loco-manipulation Jin Wang Rui Dai Weijie Wang Luca Rossini Francesco Ruscelli Nikos Tsagarakis 39 4 0 20 Jun 2024
AIC MLLM: Autonomous Interactive Correction MLLM for Robust Robotic Manipulation Chuyan Xiong Chengyu Shen Xiaoqi Li Kaichen Zhou Jiaming Liu Ruiping Wang Hao Dong LRM 34 10 0 17 Jun 2024
World Models with Hints of Large Language Models for Goal Achieving Zeyuan Liu Ziyu Huan Xiyao Wang Jiafei Lyu Jian Tao Xiu Li Furong Huang Huazhe Xu LM&Ro LRM AI4CE 46 1 0 11 Jun 2024
DrEureka: Language Model Guided Sim-To-Real Transfer Yecheng Jason Ma William Liang Hung-Ju Wang Sam Wang Yuke Zhu Linxi Fan Osbert Bastani Dinesh Jayaraman 77 43 0 04 Jun 2024
FuRL: Visual-Language Models as Fuzzy Rewards for Reinforcement Learning Yuwei Fu Haichao Zhang Di Wu Wei-ping Xu Benoit Boulet VLM 24 12 0 02 Jun 2024
Agentic Skill Discovery Xufeng Zhao C. Weber Stefan Wermter LM&Ro LLMAG LRM 32 2 0 23 May 2024
Meta-Control: Automatic Model-based Control Synthesis for Heterogeneous Robot Skills Tianhao Wei Liqian Ma Rui Chen Weiye Zhao Changliu Liu 45 3 0 18 May 2024
Plan-Seq-Learn: Language Model Guided RL for Solving Long Horizon Robotics Tasks Murtaza Dalal Tarun Chiruvolu Devendra Singh Chaplot Ruslan Salakhutdinov LM&Ro 36 39 0 02 May 2024
What Foundation Models can Bring for Robot Learning in Manipulation : A Survey Dingzhe Li Yixiang Jin A. Yong Hongze Yu Jun Shi Xiaoshuai Hao Peng Hao Huaping Liu Gang Hua Bin Fang AI4CE LM&Ro 72 13 0 28 Apr 2024
Large Language Models for Orchestrating Bimanual Robots Kun-Mo Chu Xufeng Zhao C. Weber Mengdi Li Wenhao Lu Stefan Wermter LM&Ro LLMAG 34 8 0 02 Apr 2024
RLingua: Improving Reinforcement Learning Sample Efficiency in Robotic Manipulations With Large Language Models Liangliang Chen Yutian Lei Shiyu Jin Ying Zhang Liangjun Zhang LM&Ro 45 8 0 11 Mar 2024
RL-GPT: Integrating Reinforcement Learning and Code-as-policy Shaoteng Liu Haoqi Yuan Minda Hu Yanwei Li Yukang Chen Shu Liu Zongqing Lu Jiaya Jia LLMAG 48 14 0 29 Feb 2024
Language-guided Skill Learning with Temporal Variational Inference Haotian Fu Pratyusha Sharma Elias Stengel-Eskin George Konidaris Nicolas Le Roux Marc-Alexandre Côté Xingdi Yuan 38 7 0 26 Feb 2024
Large Multimodal Agents: A Survey Junlin Xie Zhihong Chen Ruifei Zhang Xiang Wan Guanbin Li LM&Ro LLMAG 37 39 0 23 Feb 2024
LLMs with Industrial Lens: Deciphering the Challenges and Prospects -- A Survey Ashok Urlana Charaka Vinayak Kumar Ajeet Kumar Singh B. Garlapati S. Chalamala Rahul Mishra 35 5 0 22 Feb 2024
Talk Through It: End User Directed Manipulation Learning Carl Winge Adam Imdieke Bahaa Aldeeb Dongyeop Kang Karthik Desingh LM&Ro 43 1 0 19 Feb 2024
Hierarchical Continual Reinforcement Learning via Large Language Model Chaofan Pan Xin Yang Hao Wang Wei Wei Tianrui Li 25 2 0 25 Jan 2024
On the Prospects of Incorporating Large Language Models (LLMs) in Automated Planning and Scheduling (APS) Vishal Pallagani Kaushik Roy Bharath Muppasani F. Fabiano Andrea Loreggia K. Murugesan Biplav Srivastava F. Rossi L. Horesh Amit P. Sheth 28 40 0 04 Jan 2024
LHManip: A Dataset for Long-Horizon Language-Grounded Manipulation Tasks in Cluttered Tabletop Environments Federico Ceola Lorenzo Natale Niko Sünderhauf Krishan Rana LM&Ro 32 1 0 19 Dec 2023
LiFT: Unsupervised Reinforcement Learning with Foundation Models as Teachers Taewook Nam Juyong Lee Jesse Zhang Sung Ju Hwang Joseph J. Lim Karl Pertsch OffRL LRM 43 5 0 14 Dec 2023
Program Machine Policy: Addressing Long-Horizon Tasks by Integrating Program Synthesis and State Machines Yu-An Lin Chen-Tao Lee Guanhui. Liu Pu-Jen Cheng Shao-Hua Sun 27 0 0 27 Nov 2023
Location-Aware Visual Question Generation with Lightweight Models Nicholas Collin Suwono Justin Chih-Yao Chen Tun-Min Hung T. Huang I-Bin Liao Yung-Hui Li Lun-Wei Ku Shao-Hua Sun 15 4 0 23 Oct 2023
TAIL: Task-specific Adapters for Imitation Learning with Large Pretrained Models Zuxin Liu Jesse Zhang Kavosh Asadi Yao Liu Ding Zhao Shoham Sabach Rasool Fakoor ALM AI4CE 21 25 0 09 Oct 2023
Hierarchical Programmatic Reinforcement Learning via Learning to Compose Programs Guanhui. Liu En-Pei Hu Pu-Jen Cheng Hung-yi Lee Shao-Hua Sun 71 17 0 30 Jan 2023