Title
RoboHorizon: An LLM-Assisted Multi-View World Model for Long-Horizon Robotic Manipulation Zixuan Chen Jing Huo Yangtao Chen Yang Gao 160 4 0 11 Jan 2025
Efficient Language-instructed Skill Acquisition via Reward-Policy Co-Evolution Changxin Huang Yanbin Chang Junfan Lin Junyang Liang Runhao Zeng Jianqiang Li 116 0 0 18 Dec 2024
SOLAMI: Social Vision-Language-Action Modeling for Immersive Interaction with 3D Autonomous Characters Jianping Jiang Weiye Xiao Zhengyu Lin Han Zhang Tianxiang Ren Yang Gao Zhiqian Lin Zhongang Cai Lei Yang Ziwei Liu 152 3 0 29 Nov 2024
ELEMENTAL: Interactive Learning from Demonstrations and Vision-Language Models for Reward Design in Robotics Letian Chen Nina Moorman Matthew C. Gombolay OffRL LM&Ro 200 1 0 27 Nov 2024
Don't Let Your Robot be Harmful: Responsible Robotic Manipulation via Safety-as-Policy Minheng Ni Lei Zhang Zhaoyu Chen Lefei Zhang Wangmeng Zuo Jianwei Zhang Lei Zhang W. Zuo 141 1 0 27 Nov 2024
MALMM: Multi-Agent Large Language Models for Zero-Shot Robotics Manipulation Harsh Singh Rocktim Jyoti Das Mingfei Han Preslav Nakov Ivan Laptev LM&Ro LLMAG 135 2 0 26 Nov 2024
Sampling-Based Model Predictive Control for Dexterous Manipulation on a Biomimetic Tendon-Driven Hand Adrian Hess Alexander M. Kübler Benedek Forrai Mehmet Dogar Robert K. Katzschmann 93 1 0 09 Nov 2024
Vision Language Models are In-Context Value Learners Yecheng Jason Ma Joey Hejna Ayzaan Wahid Chuyuan Fu Dhruv Shah ... Dinesh Jayaraman Wenhao Yu Tingnan Zhang Dorsa Sadigh Fei Xia 109 10 0 07 Nov 2024
Vocal Sandbox: Continual Learning and Adaptation for Situated Human-Robot Collaboration J. Grannen Siddharth Karamcheti Suvir Mirchandani Percy Liang Dorsa Sadigh 92 2 0 04 Nov 2024
Eurekaverse: Environment Curriculum Generation via Large Language Models William Liang Sam Wang Hung-Ju Wang Osbert Bastani Dinesh Jayaraman Yecheng Jason Ma SyDa 145 3 0 04 Nov 2024
Teaching Embodied Reinforcement Learning Agents: Informativeness and Diversity of Language Use Jiajun Xi Yinong He Jianing Yang Yinpei Dai Joyce Chai LM&Ro 70 3 0 31 Oct 2024
Online Intrinsic Rewards for Decision Making Agents from Large Language Model Feedback Qinqing Zheng Mikael Henaff Amy Zhang Aditya Grover Brandon Amos LLMAG OffRL 124 3 0 30 Oct 2024
On-Robot Reinforcement Learning with Goal-Contrastive Rewards Ondrej Biza Thomas Weng Lingfeng Sun Karl Schmeckpeper Tarik Kelestemur Yecheng Jason Ma Robert Platt Jan-Willem van de Meent Lawson L. S. Wong OffRL 157 0 0 25 Oct 2024
Navigating Noisy Feedback: Enhancing Reinforcement Learning with Error-Prone Language Models Muhan Lin Shuyang Shi Yue (Sophie) Guo Behdad Chalaki Vaishnav Tadiparthi Ehsan Moradi-Pari Simon Stepputtis Joseph Campbell Katia Sycara 66 2 0 22 Oct 2024
LLM-Assisted Red Teaming of Diffusion Models through "Failures Are Fated, But Can Be Faded" Som Sagar Aditya Taparia Ransalu Senanayake 39 0 0 22 Oct 2024
Generative AI Agents in Autonomous Machines: A Safety Perspective Jason J. Jabbour Vijay Janapa Reddi AI4CE 124 4 0 20 Oct 2024
A Large Language Model-Driven Reward Design Framework via Dynamic Feedback for Reinforcement Learning Shengjie Sun Runze Liu Jiafei Lyu J. Yang L. Zhang Xiu Li LRM 87 6 0 18 Oct 2024
In-Context Learning Enables Robot Action Prediction in LLMs Yida Yin Zekai Wang Yuvan Sharma Dantong Niu Trevor Darrell Roei Herzig LM&Ro 293 4 0 16 Oct 2024
VidEgoThink: Assessing Egocentric Video Understanding Capabilities for Embodied AI Sijie Cheng Kechen Fang Yangyang Yu Sicheng Zhou Yangqiu Song Ye Tian Tingguang Li Lei Han Yang Liu 113 10 0 15 Oct 2024
Large Language Model-Enhanced Reinforcement Learning for Generic Bus Holding Control Strategies Jiajie Yu Yuhong Wang Wei Ma OffRL 175 2 0 14 Oct 2024
Language-Model-Assisted Bi-Level Programming for Reward Learning from Internet Videos Harsh Mahesheka Zhixian Xie Ziyi Wang Wanxin Jin 83 0 0 11 Oct 2024
Automated Rewards via LLM-Generated Progress Functions Vishnu Sarukkai Brennan Shacklett Zander Majercik Kush S. Bhatia Christopher Ré Kayvon Fatahalian 69 1 0 11 Oct 2024
Aerial Vision-and-Language Navigation via Semantic-Topo-Metric Representation Guided LLM Reasoning Yunpeng Gao Zhigang Wang Linglin Jing Dong Wang Xuelong Li Bin Zhao 130 14 0 11 Oct 2024
SG-Nav: Online 3D Scene Graph Prompting for LLM-based Zero-shot Object Navigation Hang Yin Xiuwei Xu Zhenyu Wu Jie Zhou Jiwen Lu 107 24 0 10 Oct 2024
On the Modeling Capabilities of Large Language Models for Sequential Decision Making Martin Klissarov Devon Hjelm Alexander Toshev Bogdan Mazoure LM&Ro ELM OffRL LRM 104 2 0 08 Oct 2024
From Reward Shaping to Q-Shaping: Achieving Unbiased Learning with LLM-Guided Knowledge Xiefeng Wu OffRL 105 2 0 02 Oct 2024
Task Success Prediction for Open-Vocabulary Manipulation Based on Multi-Level Aligned Representations Miyu Goko Motonari Kambara Daichi Saito Seitaro Otsuki Komei Sugiura 78 2 0 01 Oct 2024
Helpful DoggyBot: Open-World Object Fetching using Legged Robots and Vision-Language Models Qi Wu Zipeng Fu Xuxin Cheng Xiaolong Wang Chelsea Finn LM&Ro 100 10 0 30 Sep 2024
Continuously Improving Mobile Manipulation with Autonomous Real-World RL Russell Mendonca Emmanuel Panov Bernadette Bucher Jiuguang Wang Deepak Pathak OffRL 91 7 0 30 Sep 2024
CurricuLLM: Automatic Task Curricula Design for Learning Complex Robot Skills using Large Language Models Kanghyun Ryu Qiayuan Liao Zhongyu Li Koushil Sreenath Negar Mehr Negar Mehr LM&Ro 362 4 0 27 Sep 2024
Controllable Traffic Simulation through LLM-Guided Hierarchical Chain-of-Thought Reasoning Zhiyuan Liu Leheng Li Yuning Wang Haotian Lin Zhizhe Liu Lei He Jianqiang Wang LRM 74 4 0 23 Sep 2024
Vision Language Models Can Parse Floor Plan Maps David DeFazio Hrudayangam Mehta Jeremy Blackburn Shiqi Zhang CoGe 79 0 0 19 Sep 2024
MotIF: Motion Instruction Fine-tuning Minyoung Hwang Joey Hejna Dorsa Sadigh Yonatan Bisk 86 1 0 16 Sep 2024
E2Map: Experience-and-Emotion Map for Self-Reflective Robot Navigation with Language Models Chan Kim Keonwoo Kim Mintaek Oh Hanbi Baek Jiyang Lee ... John Tucker Roya Firoozi Seung-Woo Seo Mac Schwager Seong-Woo Kim LM&Ro 148 1 0 16 Sep 2024
AnyBipe: An End-to-End Framework for Training and Deploying Bipedal Robots Guided by Large Language Models Yifei Yao Wentao He Chenyu Gu Jiaheng Du Fuwei Tan Zhen Zhu Junguo Lu OffRL 131 2 0 13 Sep 2024
Agent Workflow Memory Zora Z. Wang Jiayuan Mao Daniel Fried Graham Neubig LLMAG 126 35 0 11 Sep 2024
Game On: Towards Language Models as RL Experimenters Jingwei Zhang Thomas Lampe A. Abdolmaleki Jost Tobias Springenberg Martin Riedmiller LM&Ro 83 0 0 05 Sep 2024
EPO: Hierarchical LLM Agents with Environment Preference Optimization Qi Zhao Haotian Fu Chen Sun George Konidaris 106 11 0 28 Aug 2024
Balancing Act: Prioritization Strategies for LLM-Designed Restless Bandit Rewards Shresth Verma Niclas Boehmer Lingkai Kong Milind Tambe 155 3 0 22 Aug 2024
Automated Design of Agentic Systems Shengran Hu Cong Lu Jeff Clune AI4CE 155 62 0 15 Aug 2024
KOI: Accelerating Online Imitation Learning via Hybrid Key-state Guidance Jingxian Lu Wenke Xia Dong Wang Zhigang Wang Bin Zhao Di Hu Xuelong Li 84 3 0 06 Aug 2024
Tulip Agent -- Enabling LLM-Based Agents to Solve Tasks Using Large Tool Libraries Felix Ocker Daniel Tanneberg Julian Eggert Michael Gienger LLMAG LM&Ro VLM 88 5 0 31 Jul 2024
Social Learning through Interactions with Other Agents: A Survey Dylan Hillier Cheston Tan Jing Jiang 109 2 0 31 Jul 2024
MaxMI: A Maximal Mutual Information Criterion for Manipulation Concept Discovery Pei Zhou Yanchao Yang 83 1 0 21 Jul 2024
Adapt2Reward: Adapting Video-Language Models to Generalizable Robotic Rewards via Failure Prompts Yanting Yang Minghao Chen Qibo Qiu Jiahao Wu Wenxiao Wang Binbin Lin Ziyu Guan Xiaofei He LM&Ro 92 2 0 20 Jul 2024
LLM-Empowered State Representation for Reinforcement Learning Boyuan Wang Yun Qu Yuhang Jiang Jianzhun Shao Chang-rui Liu Wenming Yang Xiangyang Ji 93 14 0 18 Jul 2024
Affordance-Guided Reinforcement Learning via Visual Prompting Olivia Y. Lee Annie Xie Kuan Fang Karl Pertsch Chelsea Finn OffRL LM&Ro 196 10 0 14 Jul 2024
VLMPC: Vision-Language Model Predictive Control for Robotic Manipulation Wentao Zhao Jiaming Chen Ziyu Meng Donghui Mao Ran Song Wei Zhang 114 12 0 13 Jul 2024
Real-Time Anomaly Detection and Reactive Planning with Large Language Models Rohan Sinha Amine Elhafsi Christopher Agia Matthew Foutter Edward Schmerling Marco Pavone OffRL LRM 94 32 0 11 Jul 2024
$$\mathrm{E^{2}CFD}$: Towards Effective and Efficient Cost Function Design for Safe Reinforcement Learning via Large Language Model$ $\mathrm{E^{2}CFD}$ : Towards Effective and Efficient Cost Function Design for Safe Reinforcement Learning via Large Language Model Zepeng Wang Chao Ma Linjiang Zhou Libing Wu Lei Yang Xiaochuan Shi Guojun Peng OffRL 99 0 0 08 Jul 2024