Title
Improving Sample Efficiency of Reinforcement Learning with Background Knowledge from Large Language Models Fuxiang Zhang Junyou Li Yi-Chen Li Zongzhang Zhang Yang Yu Deheng Ye OffRL KELM 97 1 0 04 Jul 2024
Commonsense Reasoning for Legged Robot Adaptation with Vision-Language Models Annie S. Chen Alec M. Lessing Andy Tang Govind Chada Laura Smith Sergey Levine Chelsea Finn LM&Ro LRM 94 11 0 02 Jul 2024
Language-Guided Object-Centric Diffusion Policy for Generalizable and Collision-Aware Robotic Manipulation Hang Li Qian Feng Zhi Zheng Jianxiang Feng Zhaopeng Chen Alois Knoll 99 1 0 29 Jun 2024
Lifelong Robot Library Learning: Bootstrapping Composable and Generalizable Skills for Embodied Control with Language Models Georgios Tziafas Hamidreza Kasaei KELM LM&Ro 100 9 0 26 Jun 2024
NeBuLa: A discourse aware Minecraft Builder Akshay Chaturvedi Kate Thompson Nicholas Asher 89 4 0 26 Jun 2024
HYPERmotion: Learning Hybrid Behavior Planning for Autonomous Loco-manipulation Jin Wang Rui Dai Weijie Wang Luca Rossini Francesco Ruscelli Nikos Tsagarakis 78 5 0 20 Jun 2024
Minimal Self in Humanoid Robot "Alter3" Driven by Large Language Model Takahide Yoshida Suzune Baba A. Masumori Takashi Ikegami LM&Ro 76 3 0 17 Jun 2024
FreeMotion: MoCap-Free Human Motion Synthesis with Multimodal Large Language Models Zhikai Zhang Yitang Li Haofeng Huang Mingxian Lin Li Yi 140 3 0 15 Jun 2024
RoboGolf: Mastering Real-World Minigolf with a Reflective Multi-Modality Vision-Language Model Hantao Zhou Tianying Ji Lukas Sommerhalder Michael Goerner Norman Hendrich Jianwei Zhang Fuchun Sun Huazhe Xu 85 0 0 14 Jun 2024
GPT-Fabric: Folding and Smoothing Fabric by Leveraging Pre-Trained Foundation Models Vedant Raval Enyu Zhao Hejia Zhang Stefanos Nikolaidis Daniel Seita AI4CE 79 6 0 14 Jun 2024
DAG-Plan: Generating Directed Acyclic Dependency Graphs for Dual-Arm Cooperative Planning Zeyu Gao Yao Mu Jinye Qu Mengkang Hu Lingyue Guo Ping Luo Yanfeng Lu Ping Luo Shanghang Zhang Yanfeng Lu 131 11 0 14 Jun 2024
Discovering Preference Optimization Algorithms with and for Large Language Models Chris Xiaoxuan Lu Samuel Holt Claudio Fanconi Alex J. Chan Jakob Foerster M. Schaar R. T. Lange OffRL 114 18 0 12 Jun 2024
LLM-Craft: Robotic Crafting of Elasto-Plastic Objects with Large Language Models Alison Bartsch A. Farimani 163 7 0 12 Jun 2024
LGR2: Language Guided Reward Relabeling for Accelerating Hierarchical Reinforcement Learning Utsav Singh Pramit Bhattacharyya Vinay P. Namboodiri LM&Ro 104 1 0 09 Jun 2024
ChatPCG: Large Language Model-Driven Reward Design for Procedural Content Generation In-Chang Baek Tae-Hwa Park Jin-Ha Noh Cheong-mok Bae Kyung-Joong Kim 3DV 90 3 0 07 Jun 2024
Language Guided Skill Discovery Seungeun Rho Laura Smith Tianyu Li Sergey Levine Xue Bin Peng Sehoon Ha LM&Ro 82 6 0 07 Jun 2024
Text-to-Drive: Diverse Driving Behavior Synthesis via Large Language Models Phat Nguyen Tsun-Hsuan Wang Zhang-Wei Hong S. Karaman Daniela Rus LM&Ro 93 7 0 06 Jun 2024
A Survey of Language-Based Communication in Robotics William Hunt Sarvapali D. Ramchurn Mohammad D. Soorati LM&Ro 256 13 0 06 Jun 2024
DrEureka: Language Model Guided Sim-To-Real Transfer Yecheng Jason Ma William Liang Hung-Ju Wang Sam Wang Yuke Zhu Linxi Fan Osbert Bastani Dinesh Jayaraman 132 45 0 04 Jun 2024
Learning-based legged locomotion; state of the art and future perspectives Sehoon Ha Joonho Lee M. van de Panne Zhaoming Xie Wenhao Yu Majid Khadiv 147 20 0 03 Jun 2024
A Survey of Useful LLM Evaluation Ji-Lun Peng Sijia Cheng Egil Diau Yung-Yu Shih Po-Heng Chen Yen-Ting Lin Yun-Nung Chen LLMAG ELM 88 16 0 03 Jun 2024
REvolve: Reward Evolution with Large Language Models using Human Feedback Rishi Hazra Alkis Sygkounas Andreas Persson Amy Loutfi Pedro Zuidberg Dos Martires 106 3 0 03 Jun 2024
FuRL: Visual-Language Models as Fuzzy Rewards for Reinforcement Learning Yuwei Fu Haichao Zhang Di Wu Wei Xu Benoit Boulet VLM 123 15 0 02 Jun 2024
InterPreT: Interactive Predicate Learning from Language Feedback for Generalizable Task Planning Muzhi Han Yifeng Zhu Song-Chun Zhu Yingnian Wu Yuke Zhu 91 28 0 30 May 2024
Robo-Instruct: Simulator-Augmented Instruction Alignment For Finetuning Code LLMs Zichao Hu Junyi Jessy Li Arjun Guha Joydeep Biswas SyDa ALM 126 1 0 30 May 2024
Agentic Skill Discovery Xufeng Zhao C. Weber Stefan Wermter LM&Ro LLMAG LRM 64 2 0 23 May 2024
Towards Efficient LLM Grounding for Embodied Multi-Agent Collaboration Yang Zhang Shixin Yang Chenjia Bai Fei Wu Xiu Li Zhen Wang Xuelong Li LLMAG 117 32 0 23 May 2024
Meta-Control: Automatic Model-based Control Synthesis for Heterogeneous Robot Skills Tianhao Wei Liqian Ma Rui Chen Weiye Zhao Changliu Liu 120 4 0 18 May 2024
DiffGen: Robot Demonstration Generation via Differentiable Physics Simulation, Differentiable Rendering, and Vision-Language Model Yang Jin Jun Lv Shuqiang Jiang Cewu Lu 130 1 0 12 May 2024
Learning Reward for Robot Skills Using Large Language Models via Self-Alignment Yuwei Zeng Yao Mu Lin Shao 92 13 0 12 May 2024
Bi-VLA: Vision-Language-Action Model-Based System for Bimanual Robotic Dexterous Manipulations Koffivi Fidele Gbagbe Miguel Altamirano Cabrera Ali Alabbas Oussama Alyunes Artem Lykov Dzmitry Tsetserukou LM&Ro 88 20 0 09 May 2024
Position: Leverage Foundational Models for Black-Box Optimization Xingyou Song Yingtao Tian Robert Tjarko Lange Chansoo Lee Yujin Tang Yutian Chen 97 9 0 06 May 2024
Enhancing Q-Learning with Large Language Model Heuristics Xiefeng Wu LRM 100 0 0 06 May 2024
Plan-Seq-Learn: Language Model Guided RL for Solving Long Horizon Robotics Tasks Murtaza Dalal Tarun Chiruvolu Devendra Singh Chaplot Ruslan Salakhutdinov LM&Ro 124 44 0 02 May 2024
LEGENT: Open Platform for Embodied Agents Zhili Cheng Zhitong Wang Jinyi Hu Shengding Hu An Liu Yuge Tu Pengkai Li Lei Shi Zhiyuan Liu Maosong Sun VLM 80 7 0 28 Apr 2024
DrS: Learning Reusable Dense Rewards for Multi-Stage Tasks Tongzhou Mu Minghua Liu Hao Su OffRL 99 4 0 25 Apr 2024
GenCHiP: Generating Robot Policy Code for High-Precision and Contact-Rich Manipulation Tasks Kaylee Burns Ajinkya Jain Keegan Go Fei Xia Michael Stark S. Schaal Karol Hausman 83 6 0 09 Apr 2024
Long-horizon Locomotion and Manipulation on a Quadrupedal Robot with Large Language Models Yutao Ouyang Jinhan Li Yunfei Li Zhongyu Li Chao Yu Koushil Sreenath Yi Wu 139 15 0 08 Apr 2024
A Survey of Optimization-based Task and Motion Planning: From Classical To Learning Approaches Zhigen Zhao Shuo Cheng Yan Ding Ziyi Zhou Shiqi Zhang Danfei Xu Ye Zhao 141 24 0 03 Apr 2024
Survey on Large Language Model-Enhanced Reinforcement Learning: Concept, Taxonomy, and Methods Yuji Cao Huan Zhao Yuheng Cheng Ting Shu Guolong Liu Gaoqi Liang Junhua Zhao Yun Li LLMAG KELM OffRL LM&Ro 137 71 0 30 Mar 2024
Keypoint Action Tokens Enable In-Context Imitation Learning in Robotics Norman Di Palo Edward Johns 118 37 0 28 Mar 2024
RAIL: Robot Affordance Imagination with Large Language Models Ceng Zhang Xin Meng Dongchen Qi Gregory Chirikjian LM&Ro 73 3 0 28 Mar 2024
LORD: Large Models based Opposite Reward Design for Autonomous Driving Xin Ye Feng Tao Abhirup Mallik Burhaneddin Yaman Liu Ren OffRL 119 5 0 27 Mar 2024
ARO: Large Language Model Supervised Robotics Text2Skill Autonomous Learning Yiwen Chen Yuyao Ye Ziyi Chen Chuheng Zhang Marcelo H. Ang 54 0 0 23 Mar 2024
What Are Tools Anyway? A Survey from the Language Model Perspective Zhiruo Wang Zhoujun Cheng Hao Zhu Daniel Fried Graham Neubig 130 33 0 18 Mar 2024
Visual Preference Inference: An Image Sequence-Based Preference Reasoning in Tabletop Object Manipulation Joonhyung Lee Sangbeom Park Yongin Kwon Jemin Lee Minwook Ahn Sungjoon Choi 76 0 0 18 Mar 2024
Context-aware LLM-based Safe Control Against Latent Risks Quang Khanh Luu Xiyu Deng Anh Van Ho Yorie Nakahira 142 4 0 18 Mar 2024
NARRATE: Versatile Language Architecture for Optimal Control in Robotics Seif Ismail Antonio Arbues Ryan Cotterell René Zurbrügg Carmen Amo Alonso LM&Ro 53 5 0 16 Mar 2024
ExploRLLM: Guiding Exploration in Reinforcement Learning with Large Language Models Runyu Ma Jelle Luijkx Zlatan Ajanović Jens Kober LM&Ro LRM 123 9 0 14 Mar 2024
DeliGrasp: Inferring Object Properties with LLMs for Adaptive Grasp Policies William Xie Jensen Lavering N. Correll 68 9 0 12 Mar 2024