LanguageMPC: Large Language Models as Decision Makers for Autonomous Driving

4 October 2023

Li Chen

Ping Luo

Shengbo Eben Li

Masayoshi Tomizuka

Wei Zhan

Mingyu Ding

ArXiv PDF HTML

Papers citing "LanguageMPC: Large Language Models as Decision Makers for Autonomous Driving"

50 / 127 papers shown

Title
Towards Human-Centric Autonomous Driving: A Fast-Slow Architecture Integrating Large Language Model Guidance with Reinforcement Learning Chengkai Xu Jiaqi Liu Yicheng Guo Y. Zhang Peng Hang Jian-jun Sun 31 0 0 11 May 2025
LVLM-MPC Collaboration for Autonomous Driving: A Safety-Aware and Task-Scalable Control Architecture Kazuki Atsuta Kohei Honda H. Okuda Tatsuya Suzuki 141 0 0 08 May 2025
PADriver: Towards Personalized Autonomous Driving Genghua Kou Fan Jia Weixin Mao Y. Liu Yucheng Zhao Ziheng Zhang Osamu Yoshie Tiancai Wang Y. Li X. Zhang 49 0 0 08 May 2025
Opportunistic Collaborative Planning with Large Vision Model Guided Control and Joint Query-Service Optimization Jiayi Chen Shuai Wang Guoliang Li Wei Xu Guangxu Zhu Derrick Wing Kwan Ng Chengzhong Xu 55 0 0 25 Apr 2025
A closer look at how large language models trust humans: patterns and biases Valeria Lerman Yaniv Dover LLMAG 39 0 0 22 Apr 2025
A Knowledge-Informed Deep Learning Paradigm for Generalizable and Stability-Optimized Car-Following Models C. Wang Dongyao Jia Wei Wang Dong Ngoduy Bei Peng Jianping Wang 19 0 0 19 Apr 2025
RoboTwin: Dual-Arm Robot Benchmark with Generative Digital Twins Yao Mu Tianxing Chen Z. Chen Shijia Peng Zhiqian Lan ... Mingkun Xu Lunkai Lin Zhiqiang Xie Mingyu Ding Ping Luo 28 1 0 17 Apr 2025
Vision-Language Model Predictive Control for Manipulation Planning and Trajectory Generation Jiaming Chen Wentao Zhao Ziyu Meng Donghui Mao Ran Song Wei Pan Wei Zhang 33 0 0 07 Apr 2025
Urban Computing in the Era of Large Language Models Zhonghang Li Lianghao Xia Xubin Ren J. Tang Tianyi Chen Yong-mei Xu C. Huang 78 0 0 02 Apr 2025
SACA: A Scenario-Aware Collision Avoidance Framework for Autonomous Vehicles Integrating LLMs-Driven Reasoning Shiyue Zhao Junzhi Zhang Neda Masoud Heye Huang Xingpeng Xia Chengkun He LRM 44 0 0 31 Mar 2025
Exploring the Roles of Large Language Models in Reshaping Transportation Systems: A Survey, Framework, and Roadmap Tong Nie Jian-jun Sun Wei Ma 66 1 0 27 Mar 2025
Safety Aware Task Planning via Large Language Models in Robotics A. Khan Michael Andrev Muhammad Ali Murtaza Sergio Aguilera Rui Zhang Jie Ding Seth Hutchinson Ali Anwar LLMAG 51 3 0 19 Mar 2025
A Framework for a Capability-driven Evaluation of Scenario Understanding for Multimodal Large Language Models in Autonomous Driving Tin Stribor Sohn Philipp Reis Maximilian Dillitzer Johannes Bach Jason J. Corso Eric Sax ELM LRM 49 0 0 14 Mar 2025
ManeuverGPT Agentic Control for Safe Autonomous Stunt Maneuvers Shawn Azdam Pranav Doma Aliasghar Arab LLMSV 45 0 0 12 Mar 2025
SimLingo: Vision-Only Closed-Loop Autonomous Driving with Language-Action Alignment Katrin Renz Long Chen Elahe Arani Oleg Sinavski MLLM 65 0 0 12 Mar 2025
CoLMDriver: LLM-based Negotiation Benefits Cooperative Autonomous Driving Changxing Liu Genjia Liu Z. Wang Jinchang Yang Siheng Chen 62 0 0 11 Mar 2025
Combating Partial Perception Deficit in Autonomous Driving with Multimodal LLM Commonsense Yuting Hu Chenhui Xu Ruiyang Qin Dancheng Liu Amir Nassereldine Yiyu Shi Jinjun Xiong 37 0 0 10 Mar 2025
CorrA: Leveraging Large Language Models for Dynamic Obstacle Avoidance of Autonomous Vehicles Shanting Wang Panagiotis Typaldos Andreas A. Malikopoulos 49 0 0 03 Mar 2025
HazardNet: A Small-Scale Vision Language Model for Real-Time Traffic Safety Detection at Edge Devices M. Tami Mohammed Elhenawy Huthaifa I. Ashqar 36 0 0 27 Feb 2025
Multi-Agent Autonomous Driving Systems with Large Language Models: A Survey of Recent Advances Yaozu Wu Dongyuan Li Yankai Chen Renhe Jiang Henry Peng Zou Liancheng Fang Zhen Wang Philip S. Yu LLMAG 70 2 0 24 Feb 2025
VaViM and VaVAM: Autonomous Driving through Video Generative Modeling Florent Bartoccioni Elias Ramzi Victor Besnier Shashanka Venkataramanan Tuan-Hung Vu ... Mickael Chen Éloi Zablocki Andrei Bursuc Eduardo Valle Matthieu Cord VGen 78 1 0 24 Feb 2025
TeLL-Drive: Enhancing Autonomous Driving with Teacher LLM-Guided Deep Reinforcement Learning Chengkai Xu Jiaqi Liu Shiyu Fang Jian-jun Sun Dong Chen Peng Hang Jian Sun 88 1 0 21 Feb 2025
Large Language Models for Autonomous Driving (LLM4AD): Concept, Benchmark, Experiments, and Challenges Can Cui Yunsheng Ma Zichong Yang Yupeng Zhou Peiran Liu ... Jitesh Panchal Amr Abdelraouf Rohit Gupta Kyungtae Han Ziran Wang 44 1 0 21 Feb 2025
Knowledge Integration Strategies in Autonomous Vehicle Prediction and Planning: A Comprehensive Survey Kumar Manas Adrian Paschke 45 0 0 13 Feb 2025
Vision-Integrated LLMs for Autonomous Driving Assistance : Human Performance Comparison and Trust Evaluation Namhee Kim Woojin Park 46 0 0 06 Feb 2025
Embodied Scene Understanding for Vision Language Models via MetaVQA Weizhen Wang Chenda Duan Zhenghao Peng Yuxin Liu Bolei Zhou LM&Ro 44 0 0 17 Jan 2025
Visual Large Language Models for Generalized and Specialized Applications Yifan Li Zhixin Lai Wentao Bao Zhen Tan Anh Dao Kewei Sui Jiayi Shen Dong Liu Huan Liu Yu Kong VLM 88 11 0 06 Jan 2025
Leveraging Large Language Models for Enhancing Autonomous Vehicle Perception Athanasios Karagounis 31 0 0 31 Dec 2024
Vision-and-Language Navigation Today and Tomorrow: A Survey in the Era of Foundation Models Yue Zhang Ziqiao Ma Jialu Li Yanyuan Qiao Zun Wang J. Chai Qi Wu Mohit Bansal Parisa Kordjamshidi LRM 57 18 0 31 Dec 2024
Large Language Model guided Deep Reinforcement Learning for Decision Making in Autonomous Driving Hao Pang Zhenpo Wang Guoqiang Li 43 1 0 24 Dec 2024
From Generation to Judgment: Opportunities and Challenges of LLM-as-a-judge Dawei Li Bohan Jiang Liangjie Huang Alimohammad Beigi Chengshuai Zhao ... Canyu Chen Tianhao Wu Kai Shu Lu Cheng Huan Liu ELM AILaw 118 65 0 25 Nov 2024
Large Language Model-based Decision-making for COLREGs and the Control of Autonomous Surface Vehicles Klinsmann Agyei Pouria Sarhadi W. Naeem 74 0 0 25 Nov 2024
LaVida Drive: Vision-Text Interaction VLM for Autonomous Driving with Token Selection, Recovery and Enhancement Siwen Jiao Yangyi Fang Baoyun Peng Wangqun Chen Bharadwaj Veeravalli 85 4 0 20 Nov 2024
Large Language Models (LLMs) as Traffic Control Systems at Urban Intersections: A New Paradigm Sari Masri Huthaifa I. Ashqar Mohammed Elhenawy LRM 44 6 0 16 Nov 2024
EMOS: Embodiment-aware Heterogeneous Multi-robot Operating System with LLM Agents Junting Chen Checheng Yu Xunzhe Zhou Tianqi Xu Yao Mu Mengkang Hu Wenqi Shao Y. Wang G. Li Lin Shao 66 4 0 30 Oct 2024
Senna: Bridging Large Vision-Language Models and End-to-End Autonomous Driving Bo Jiang Shaoyu Chen Bencheng Liao Xingyu Zhang Wei Yin Qian Zhang Chang Huang W. Liu X. Wang VLM MLLM LRM 35 13 0 29 Oct 2024
VLMimic: Vision Language Models are Visual Imitation Learner for Fine-grained Actions Guanyan Chen M. Wang Te Cui Yao Mu Haoyang Lu ... Mengxiao Hu Haizhou Li Y. Li Yi Yang Yufeng Yue VLM 26 3 0 28 Oct 2024
Foundation Models for Rapid Autonomy Validation Alec Farid Peter Schleede Aaron Huang Christoffer Heckman 32 0 0 22 Oct 2024
How to Build a Pre-trained Multimodal model for Simultaneously Chatting and Decision-making? Zuojin Tang Bin-Bin Hu Chenyang Zhao De Ma Gang Pan Bin Liu 20 0 0 21 Oct 2024
Bench4Merge: A Comprehensive Benchmark for Merging in Realistic Dense Traffic with Micro-Interactive Vehicles Zhengming Wang Junli Wang Pengfei Li Zhaohan Li Peng Li Yilun Chen Peng Li Yilun Chen 90 0 0 21 Oct 2024
Dual-AEB: Synergizing Rule-Based and Multimodal Large Language Models for Effective Emergency Braking Wei Zhang Pengfei Li Junli Wang B. S. Qihao Jin ... Shibo Rui Yang Yu Wenchao Ding Peng Li Yilun Chen 31 0 0 11 Oct 2024
ES-Gaussian: Gaussian Splatting Mapping via Error Space-Based Gaussian Completion Lu Chen Yingfu Zeng Haoang Li Zhitao Deng Jiafu Yan Zhenjun Zhao 3DGS 3DV 32 0 0 09 Oct 2024
LASMP: Language Aided Subset Sampling Based Motion Planner Saswati Bhattacharjee Anirban Sinha Chinwe Ekenna LM&Ro 24 0 0 01 Oct 2024
Advancing Object Detection in Transportation with Multimodal Large Language Models (MLLMs): A Comprehensive Review and Empirical Testing Huthaifa I. Ashqar Ahmed Jaber Taqwa I. Alhadidi Mohammed Elhenawy 32 7 0 26 Sep 2024
Enhancing LLM-based Autonomous Driving Agents to Mitigate Perception Attacks Ruoyu Song Muslum Ozgur Ozmen Hyungsub Kim Antonio Bianchi Z. Berkay Celik AAML 28 5 0 22 Sep 2024
Hey Robot! Personalizing Robot Navigation through Model Predictive Control with a Large Language Model Diego Martínez Baselga O. de Groot Luzia Knoedler Javier Alonso-Mora L. Riazuelo Luis Montano LM&Ro 39 0 0 20 Sep 2024
Towards Interactive and Learnable Cooperative Driving Automation: a Large Language Model-Driven Decision-Making Framework Shiyu Fang Jiaqi Liu Mingyu Ding Yiming Cui Chen Lv Peng Hang Jian-jun Sun 27 7 0 19 Sep 2024
Multimodal Large Language Model Driven Scenario Testing for Autonomous Vehicles Qiujing Lu Xuanhan Wang Yiwei Jiang Guangming Zhao Mingyue Ma Shuo Feng 48 7 0 10 Sep 2024
ChatSUMO: Large Language Model for Automating Traffic Scenario Generation in Simulation of Urban MObility Shuyang Li Talha Azfar Ruimin Ke LLMAG 24 7 0 29 Aug 2024
Making Large Language Models Better Planners with Reasoning-Decision Alignment Zhijian Huang Tao Tang Shaoxiang Chen Sihao Lin Zequn Jie Lin Ma Guangrun Wang Xiaodan Liang 54 9 0 25 Aug 2024