Title
RLingua: Improving Reinforcement Learning Sample Efficiency in Robotic Manipulations With Large Language Models Liangliang Chen Yutian Lei Shiyu Jin Ying Zhang Liangjun Zhang LM&Ro 114 12 0 11 Mar 2024
RL-GPT: Integrating Reinforcement Learning and Code-as-policy Shaoteng Liu Haoqi Yuan Minda Hu Yanwei Li Yukang Chen Shu Liu Zongqing Lu Jiaya Jia LLMAG 114 17 0 29 Feb 2024
GSM-Plus: A Comprehensive Benchmark for Evaluating the Robustness of LLMs as Mathematical Problem Solvers Qintong Li Leyang Cui Xueliang Zhao Lingpeng Kong Wei Bi LRM 132 62 0 29 Feb 2024
ProtLLM: An Interleaved Protein-Language LLM with Protein-as-Word Pre-Training Le Zhuo Zewen Chi Minghao Xu Heyan Huang Heqi Zheng Conghui He Xian-Ling Mao Wentao Zhang 184 13 0 28 Feb 2024
Pragmatic Instruction Following and Goal Assistance via Cooperative Language-Guided Inverse Planning Zhi-Xuan Tan Lance Ying Vikash K. Mansinghka Joshua B. Tenenbaum 115 23 0 27 Feb 2024
Multi-Agent, Human-Agent and Beyond: A Survey on Cooperation in Social Dilemmas Hao Guo Chunjiang Mu Yang Chen Chen Shen Shuyue Hu Zhen Wang 94 9 0 27 Feb 2024
Enhancing Robotic Manipulation with AI Feedback from Multimodal Large Language Models Jinyi Liu Yifu Yuan Jianye Hao Fei Ni Lingzhi Fu Yibin Chen Yan Zheng LM&Ro 410 6 0 22 Feb 2024
Learning to Learn Faster from Human Feedback with Language Model Predictive Control Jacky Liang Fei Xia Wenhao Yu Andy Zeng Montse Gonzalez Arenas ... N. Heess Kanishka Rao Nik Stewart Jie Tan Carolina Parada LM&Ro 127 35 0 18 Feb 2024
BBSEA: An Exploration of Brain-Body Synchronization for Embodied Agents Sizhe Yang Qian Luo Anumpam Pani Yanchao Yang 73 2 0 13 Feb 2024
PIVOT: Iterative Visual Prompting Elicits Actionable Knowledge for VLMs Soroush Nasiriany Fei Xia Wenhao Yu Ted Xiao Jacky Liang ... Karol Hausman N. Heess Chelsea Finn Sergey Levine Brian Ichter LM&Ro LRM 96 114 0 12 Feb 2024
Diffusion-ES: Gradient-free Planning with Diffusion for Autonomous Driving and Zero-Shot Instruction Following Brian Yang Huangyuan Su N. Gkanatsios Tsung-Wei Ke Ayush Jain Jeff Schneider Katerina Fragkiadaki DiffM 106 25 0 09 Feb 2024
An Interactive Agent Foundation Model Zane Durante Bidipta Sarkar Ran Gong Rohan Taori Yusuke Noda ... Katsushi Ikeuchi Fei-Fei Li Jianfeng Gao Naoki Wake Qiuyuan Huang LM&Ro AI4CE LLMAG 146 19 0 08 Feb 2024
Real-World Robot Applications of Foundation Models: A Review Kento Kawaharazuka T. Matsushima Andrew Gambardella Jiaxian Guo Chris Paxton Andy Zeng OffRL VLM LM&Ro 116 54 0 08 Feb 2024
Code as Reward: Empowering Reinforcement Learning with VLMs David Venuto Sami Nur Islam Martin Klissarov Doina Precup Sherry Yang Ankit Anand VLM 77 11 0 07 Feb 2024
"Task Success" is not Enough: Investigating the Use of Video-Language Models as Behavior Critics for Catching Undesirable Agent Behaviors L. Guan Yifan Zhou Denis Liu Yantian Zha H. B. Amor Subbarao Kambhampati LM&Ro 89 17 0 06 Feb 2024
Similarity-based Neighbor Selection for Graph LLMs Rui Li Jiwei Li Jiawei Han Guoyin Wang 70 5 0 06 Feb 2024
RL-VLM-F: Reinforcement Learning from Vision Language Foundation Model Feedback Yufei Wang Zhanyi Sun Jesse Zhang Zhou Xian Erdem Biyik David Held Zackory M. Erickson VLM 124 59 0 06 Feb 2024
A Survey on Robotics with Foundation Models: toward Embodied AI Zhiyuan Xu Kun Wu Junjie Wen Jinming Li Ning Liu Zhengping Che Jian Tang AI4CE LRM LM&Ro 94 29 0 04 Feb 2024
Generative Expressive Robot Behaviors using Large Language Models Karthik Mahadevan Jonathan M. Chien Noah Brown Zhuo Xu Carolina Parada Fei Xia Andy Zeng Leila Takayama Dorsa Sadigh LM&Ro 97 41 0 26 Jan 2024
Multi-granularity Knowledge Transfer for Continual Reinforcement Learning Chaofan Pan Lingfei Ren Hao Wang Linbo Xiong Wei Wei Yonghao Li Xin Yang 146 3 0 25 Jan 2024
DeLF: Designing Learning Environments with Foundation Models Aida Afshar Wenchao Li OffRL 40 2 0 17 Jan 2024
Large Language Models for Robotics: Opportunities, Challenges, and Perspectives Jiaqi Wang Zihao Wu Yiwei Li Hanqi Jiang Peng Shu ... Lin Zhao Bao Ge Xiang Li Tianming Liu Shu Zhang LM&Ro 97 75 0 09 Jan 2024
RePLan: Robotic Replanning with Perception and Language Models Marta Skreta Zihan Zhou Jia Lin Yuan Kourosh Darvish Alán Aspuru-Guzik Animesh Garg LM&Ro LRM 125 26 0 08 Jan 2024
ExTraCT -- Explainable Trajectory Corrections from language inputs using Textual description of features J-Anne Yow N. P. Garg Manoj Ramanathan Wei Tech Ang 76 5 0 08 Jan 2024
A Survey on Robotic Manipulation of Deformable Objects: Recent Advances, Open Challenges and New Frontiers Feida Gu Yanmin Zhou Zhipeng Wang Shuo Jiang Bin He AI4CE 82 8 0 16 Dec 2023
Auto MC-Reward: Automated Dense Reward Design with Large Language Models for Minecraft Hao Li Xue Yang Zhaokai Wang Xizhou Zhu Jie Zhou Yu Qiao Xiaogang Wang Hongsheng Li Lewei Lu Jifeng Dai 103 36 0 14 Dec 2023
Vision-Language Models as a Source of Rewards Kate Baumli Satinder Baveja Feryal M. P. Behbahani Harris Chan Gheorghe Comanici ... Yannick Schroecker Stephen Spencer Richie Steigerwald Luyu Wang Lei Zhang VLM LRM 94 36 0 14 Dec 2023
Toward General-Purpose Robots via Foundation Models: A Survey and Meta-Analysis Yafei Hu Quanting Xie Vidhi Jain Jonathan M Francis Jay Patrikar ... Xiaolong Wang Sebastian A. Scherer Z. Kira Fei Xia Yonatan Bisk LM&Ro AI4CE 138 75 0 14 Dec 2023
Interactive Planning Using Large Language Models for Partially Observable Robotics Tasks Lingfeng Sun Devesh K. Jha Chiori Hori Siddarth Jain Radu Corcodel Xinghao Zhu Masayoshi Tomizuka Diego Romeres LM&Ro LLMAG 94 24 0 11 Dec 2023
From Text to Motion: Grounding GPT-4 in a Humanoid Robot "Alter3" Takahide Yoshida A. Masumori Takashi Ikegami 72 18 0 11 Dec 2023
Toward Open-ended Embodied Tasks Solving William Wei Wang Dongqi Han Xufang Luo Yifei Shen Charles Ling Boyu Wang Dongsheng Li AI4CE 72 5 0 10 Dec 2023
Efficient Sparse-Reward Goal-Conditioned Reinforcement Learning with a High Replay Ratio and Regularization Takuya Hiraoka OffRL 84 1 0 10 Dec 2023
Language Models, Agent Models, and World Models: The LAW for Machine Reasoning and Planning Zhiting Hu Tianmin Shu LLMAG LM&Ro LRM 163 37 0 08 Dec 2023
Dream2Real: Zero-Shot 3D Object Rearrangement with Vision-Language Models Ivan Kapelyukh Yifei Ren Ignacio Alzugaray Edward Johns VLM LM&Ro 116 22 0 07 Dec 2023
FoMo Rewards: Can we cast foundation models as reward functions? Ekdeep Singh Lubana Johann Brehmer P. D. Haan Taco S. Cohen OffRL LRM 99 3 0 06 Dec 2023
Recursive Visual Programming Jiaxin Ge Sanjay Subramanian Baifeng Shi Roei Herzig Trevor Darrell 50 7 0 04 Dec 2023
Robot Learning in the Era of Foundation Models: A Survey Xuan Xiao Jiahang Liu Zhipeng Wang Yanmin Zhou Yong Qi Qian Cheng Bin He Shuo Jiang AI4CE LM&Ro 158 29 0 24 Nov 2023
Large Language Model as a Policy Teacher for Training Reinforcement Learning Agents Zihao Zhou Bin-Bin Hu Chenyang Zhao Pu Zhang Bin Liu LLMAG 120 16 0 22 Nov 2023
LLMs as Visual Explainers: Advancing Image Classification with Evolving Visual Descriptions Songhao Han Le Zhuo Yue Liao Si Liu VLM 95 15 0 20 Nov 2023
Deploying and Evaluating LLMs to Program Service Mobile Robots Zichao Hu Francesca Lucchetti Claire Schlesinger Yash Saxena Anders Freeman Sadanand Modak Arjun Guha Joydeep Biswas 102 41 0 18 Nov 2023
Distilling and Retrieving Generalizable Knowledge for Robot Manipulation via Language Corrections Lihan Zha Yuchen Cui Li-Heng Lin Minae Kwon Montse Gonzalez Arenas Andy Zeng Fei Xia Dorsa Sadigh 113 37 0 17 Nov 2023
The Privacy Pillar -- A Conceptual Framework for Foundation Model-based Systems Tingting Bi Guangsheng Yu Qinghua Lu Xiwei Xu Nick van Beest 32 1 0 13 Nov 2023
Learning Agile Bipedal Motions on a Quadrupedal Robot Yunfei Li Jinhan Li Wei Fu Yi Wu 108 10 0 10 Nov 2023
Kinematic-aware Prompting for Generalizable Articulated Object Manipulation with LLMs Wenke Xia Dong Wang Xincheng Pang Zhigang Wang Bin Zhao Di Hu Xuelong Li LM&Ro 121 21 0 06 Nov 2023
Accelerating Reinforcement Learning of Robotic Manipulations via Feedback from Large Language Models Kun-Mo Chu Xufeng Zhao C. Weber Mengdi Li Stefan Wermter LLMAG LM&Ro 87 15 0 04 Nov 2023
RoboGen: Towards Unleashing Infinite Data for Automated Robot Learning via Generative Simulation Yufei Wang Zhou Xian Feng Chen Tsun-Hsuan Wang Yian Wang Katerina Fragkiadaki Zackory M. Erickson David Held Chuang Gan LM&Ro 135 110 0 02 Nov 2023
Towards A Natural Language Interface for Flexible Multi-Agent Task Assignment Jake Brawer Kayleigh Bishop Bradley Hayes Alessandro Roncone 31 4 0 31 Oct 2023
Gen2Sim: Scaling up Robot Learning in Simulation with Generative Models Pushkal Katara Zhou Xian Katerina Fragkiadaki LM&Ro 131 44 0 27 Oct 2023
Interactive Robot Learning from Verbal Correction Huihan Liu Alice Chen Yuke Zhu Adith Swaminathan Andrey Kolobov Ching-An Cheng KELM LM&Ro 102 15 0 26 Oct 2023
Robot Fine-Tuning Made Easy: Pre-Training Rewards and Policies for Autonomous Real-World Reinforcement Learning Jingyun Yang Max Sobol Mark Brandon Vu Archit Sharma Jeannette Bohg Chelsea Finn OffRL OnRL 95 26 0 23 Oct 2023