LanguageMPC: Large Language Models as Decision Makers for Autonomous Driving

4 October 2023

Li Chen

Ping Luo

Shengbo Eben Li

Masayoshi Tomizuka

Wei Zhan

Mingyu Ding

ArXiv PDF HTML

Papers citing "LanguageMPC: Large Language Models as Decision Makers for Autonomous Driving"

50 / 127 papers shown

Title
FIRST: Teach A Reliable Large Language Model Through Efficient Trustworthy Distillation Kashun Shum Minrui Xu Jianshu Zhang Zixin Chen Shizhe Diao Hanze Dong Jipeng Zhang Muhammad Omer Raza 36 3 0 22 Aug 2024
CoVLA: Comprehensive Vision-Language-Action Dataset for Autonomous Driving Hidehisa Arai Keita Miwa Kento Sasaki Yu Yamaguchi Kohei Watanabe Shunsuke Aoki Issei Yamamoto 54 9 0 19 Aug 2024
Multi-Agent Reinforcement Learning for Autonomous Driving: A Survey Ruiqi Zhang Jing Hou Florian Walter Shangding Gu Jiayi Guan Florian Röhrbein Yali Du Panpan Cai G. Chen Alois Knoll 49 12 0 19 Aug 2024
VLM-MPC: Vision Language Foundation Model (VLM)-Guided Model Predictive Controller (MPC) for Autonomous Driving Keke Long Haotian Shi Jiaxi Liu Xiaopeng Li 53 9 0 09 Aug 2024
Large Language Models for Human-like Autonomous Driving: A Survey Yun Li Kai Katsumata Ehsan Javanmardi Manabu Tsukada LM&MA 52 6 0 27 Jul 2024
Testing Large Language Models on Driving Theory Knowledge and Skills for Connected Autonomous Vehicles Zuoyin Tang Jianhua He Dashuai Pei Kezhong Liu Tao Gao ELM 38 2 0 24 Jul 2024
VLMPC: Vision-Language Model Predictive Control for Robotic Manipulation Wentao Zhao Jiaming Chen Ziyu Meng Donghui Mao Ran Song Wei Zhang 43 8 0 13 Jul 2024
GenFollower: Enhancing Car-Following Prediction with Large Language Models Xianda Chen Mingxing Peng PakHin Tiu Yuanfei Wu Junjie Chen Meixin Zhu Xinhu Zheng 51 6 0 08 Jul 2024
Commonsense Reasoning for Legged Robot Adaptation with Vision-Language Models Annie S. Chen Alec M. Lessing Andy Tang Govind Chada Laura Smith Sergey Levine Chelsea Finn LM&Ro LRM 39 9 0 02 Jul 2024
Asynchronous Large Language Model Enhanced Planner for Autonomous Driving Yuan-Hsin Chen Zi-han Ding Ziqin Wang Yan Wang Lijun Zhang Si Liu 71 12 0 20 Jun 2024
Generating and Evolving Reward Functions for Highway Driving with Large Language Models Xu Han Qiannan Yang Xianda Chen Xiaowen Chu Meixin Zhu 58 4 0 15 Jun 2024
CarLLaVA: Vision language models for camera-only closed-loop driving Katrin Renz Long Chen Ana-Maria Marcu Jan Hünermann Benoît Hanotte Alice Karnsund Jamie Shotton Elahe Arani Oleg Sinavski VLM 46 19 0 14 Jun 2024
DAG-Plan: Generating Directed Acyclic Dependency Graphs for Dual-Arm Cooperative Planning Zeyu Gao Yao Mu Jinye Qu Mengkang Hu Lingyue Guo Ping Luo Yanfeng Lu Ping Luo Shanghang Zhang Yanfeng Lu 54 10 0 14 Jun 2024
Instruct Large Language Models to Drive like Humans Ruijun Zhang Xianda Guo Wenzhao Zheng Chenming Zhang Kurt Keutzer Long Chen 34 3 0 11 Jun 2024
A Superalignment Framework in Autonomous Driving with Large Language Models Xiangrui Kong Thomas Braunl Marco Fahmi Yue Wang 38 9 0 09 Jun 2024
MoralBench: Moral Evaluation of LLMs Jianchao Ji Yutong Chen Mingyu Jin Wujiang Xu Wenyue Hua Yongfeng Zhang ELM 46 6 0 06 Jun 2024
AD-H: Autonomous Driving with Hierarchical Agents Zaibin Zhang Shiyu Tang Yuanhang Zhang Talas Fu Yifan Wang Yang Liu Dong Wang Jing Shao Lijun Wang H. Lu 52 3 0 05 Jun 2024
DriVLMe: Enhancing LLM-based Autonomous Driving Agents with Embodied and Social Experiences Yidong Huang Jacob Sansom Ziqiao Ma Felix Gervits Joyce Chai 44 17 0 05 Jun 2024
PlanAgent: A Multi-modal Large Language Agent for Closed-loop Vehicle Motion Planning Yupeng Zheng Zebin Xing Qichao Zhang Bu Jin Pengfei Li ... Zhongpu Xia Kun Zhan Xianpeng Lang Yaran Chen Dongbin Zhao LM&Ro LRM LLMAG 62 14 0 03 Jun 2024
Attaining Human`s Desirable Outcomes in Human-AI Interaction via Structural Causal Games Anjie Liu Jianhong Wang Haoxuan Li Xu Chen Jun Wang Samuel Kaski Mengyue Yang 44 0 0 26 May 2024
Large Language Models are Biased Reinforcement Learners William M. Hayes Nicolas Yax Stefano Palminteri OffRL 42 1 0 19 May 2024
When LLMs step into the 3D World: A Survey and Meta-Analysis of 3D Tasks via Multi-modal Large Language Models Xianzheng Ma Yash Bhalgat Brandon Smart Shuai Chen Xinghui Li ... Matthias Nießner Ian D Reid Angel X. Chang Iro Laina V. Prisacariu LRM 33 13 0 16 May 2024
Probing Multimodal LLMs as World Models for Driving Shiva Sreeram Tsun-Hsuan Wang Alaa Maalouf Guy Rosman S. Karaman Daniela Rus 30 7 0 09 May 2024
Position: Leverage Foundational Models for Black-Box Optimization Xingyou Song Yingtao Tian Robert Tjarko Lange Chansoo Lee Yujin Tang Yutian Chen 42 5 0 06 May 2024
Integration of Mixture of Experts and Multimodal Generative AI in Internet of Vehicles: A Survey Minrui Xu Dusit Niyato Jiawen Kang Zehui Xiong Abbas Jamalipour Yuguang Fang Dong In Kim Xuemin X. Shen 28 5 0 25 Apr 2024
Physical Backdoor Attack can Jeopardize Driving with Vision-Large-Language Models Zhenyang Ni Rui Ye Yuxian Wei Zhen Xiang Yanfeng Wang Siheng Chen AAML 36 10 0 19 Apr 2024
Can Vehicle Motion Planning Generalize to Realistic Long-tail Scenarios? Marcel Hallgarten Julian Zapata Martin Stoll Katrin Renz Andreas Zell 43 10 0 11 Apr 2024
AgentsCoDriver: Large Language Model Empowered Collaborative Driving with Lifelong Learning Senkang Hu Zhengru Fang Zihan Fang Yiqin Deng Xianhao Chen Yuguang Fang 60 33 0 09 Apr 2024
Heterogeneous Multi-Agent Reinforcement Learning for Zero-Shot Scalable Collaboration Xudong Guo Daming Shi Junjie Yu Wenhui Fan 38 4 0 05 Apr 2024
VLM-Social-Nav: Socially Aware Robot Navigation through Scoring using Vision-Language Models Daeun Song Jing Liang Amirreza Payandeh Xuesu Xiao Dinesh Manocha 37 13 0 30 Mar 2024
LeGo-Drive: Language-enhanced Goal-oriented Closed-Loop End-to-End Autonomous Driving Pranjal Paul Anant Garg Tushar Choudhary Arun Kumar Singh K. M. Krishna 52 3 0 29 Mar 2024
ChatTracer: Large Language Model Powered Real-time Bluetooth Device Tracking System Qijun Wang Shichen Zhang Kunzhe Song Huacheng Zeng 27 1 0 28 Mar 2024
DriveCoT: Integrating Chain-of-Thought Reasoning with End-to-End Driving Tianqi Wang Enze Xie Ruihang Chu Zhenguo Li Ping Luo LRM 34 15 0 25 Mar 2024
Safety Implications of Explainable Artificial Intelligence in End-to-End Autonomous Driving Shahin Atakishiyev Mohammad Salameh Randy Goebel 69 6 0 18 Mar 2024
DrPlanner: Diagnosis and Repair of Motion Planners Using Large Language Models Yuanfei Lin Chenran Li Mingyu Ding Masayoshi Tomizuka Wei Zhan Matthias Althoff 41 5 0 12 Mar 2024
Embodied Understanding of Driving Scenarios Yunsong Zhou Linyan Huang Qingwen Bu Jia Zeng Tianyu Li Hang Qiu Hongzi Zhu Minyi Guo Yu Qiao Hongyang Li LM&Ro 62 31 0 07 Mar 2024
VADv2: End-to-End Vectorized Autonomous Driving via Probabilistic Planning Shaoyu Chen Bo Jiang Hao Gao Bencheng Liao Qing Xu Qian Zhang Chang Huang Wenyu Liu Xinggang Wang BDL 48 43 0 20 Feb 2024
RAG-Driver: Generalisable Driving Explanations with Retrieval-Augmented In-Context Learning in Multi-Modal Large Language Model Jianhao Yuan Shuyang Sun Daniel Omeiza Bo-Lu Zhao Paul Newman Lars Kunze Matthew Gadd LRM 36 48 0 16 Feb 2024
Diffusion-ES: Gradient-free Planning with Diffusion for Autonomous Driving and Zero-Shot Instruction Following Brian Yang Huangyuan Su N. Gkanatsios Tsung-Wei Ke Ayush Jain Jeff Schneider Katerina Fragkiadaki DiffM 37 20 0 09 Feb 2024
Delving into Multi-modal Multi-task Foundation Models for Road Scene Understanding: From Learning Paradigm Perspectives Sheng Luo Wei Chen Wanxin Tian Rui Liu Luanxuan Hou ... Ling Shao Yi Yang Bojun Gao Qun Li Guobin Wu 51 13 0 05 Feb 2024
LimSim++: A Closed-Loop Platform for Deploying Multimodal LLMs in Autonomous Driving Daocheng Fu Wenjie Lei Licheng Wen Pinlong Cai Song Mao Min Dou Botian Shi Yu Qiao 48 27 0 02 Feb 2024
A Survey for Foundation Models in Autonomous Driving Haoxiang Gao Yaqian Li Kaiwen Long Ming Yang Yiqing Shen VLM LRM 53 24 0 02 Feb 2024
Efficient Non-Parametric Uncertainty Quantification for Black-Box Large Language Models and Decision Planning Yao-Hung Tsai Walter Talbott Jian Zhang LLMAG 16 4 0 01 Feb 2024
Towards Urban General Intelligence: A Review and Outlook of Urban Foundation Models Weijiao Zhang Jindong Han Zhao Xu Hang Ni Hao Liu Hui Xiong Hui Xiong AI4CE 77 15 0 30 Jan 2024
Knowledge Distillation from Language-Oriented to Emergent Communication for Multi-Agent Remote Control Yongjun Kim Sejin Seo Jihong Park M. Bennis Seong-Lyun Kim Junil Choi 33 1 0 23 Jan 2024
Forging Vision Foundation Models for Autonomous Driving: Challenges, Methodologies, and Opportunities Xu Yan Haiming Zhang Yingjie Cai Jingming Guo Weichao Qiu ... Lihui Jiang Wei Zhang Hongbo Zhang Dengxin Dai Bingbing Liu 56 17 0 16 Jan 2024
Exploring the Frontiers of LLMs in Psychological Applications: A Comprehensive Review Luoma Ke Song Tong Peng Cheng Kaiping Peng OffRL LM&MA 59 20 0 03 Jan 2024
If LLM Is the Wizard, Then Code Is the Wand: A Survey on How Code Empowers Large Language Models to Serve as Intelligent Agents Ke Yang Jiateng Liu John Wu Chaoqi Yang Yi Ren Fung ... Xu Cao Xingyao Wang Yiquan Wang Heng Ji Chengxiang Zhai LLMAG ELM 26 75 0 01 Jan 2024
LLMLight: Large Language Models as Traffic Signal Control Agents Siqi Lai Zhao Xu Weijiao Zhang Hao Liu Hui Xiong LLMAG 26 7 0 26 Dec 2023
DriveMLM: Aligning Multi-Modal Large Language Models with Behavioral Planning States for Autonomous Driving Wenhai Wang Jiangwei Xie ChuanYang Hu Haoming Zou Jianan Fan ... Lewei Lu Xizhou Zhu Xiaogang Wang Yu Qiao Jifeng Dai 36 124 0 14 Dec 2023