v1v2 (latest)

Driving with LLMs: Fusing Object-Level Vector Modality for Explainable Autonomous Driving

3 October 2023

Andrew James Willmott

Jamie Shotton

Papers citing "Driving with LLMs: Fusing Object-Level Vector Modality for Explainable Autonomous Driving"

50 / 154 papers shown

Title
A Survey of Language-Based Communication in Robotics William Hunt Sarvapali D. Ramchurn Mohammad D. Soorati LM&Ro 248 13 0 06 Jun 2024
AD-H: Autonomous Driving with Hierarchical Agents Zaibin Zhang Shiyu Tang Yuanhang Zhang Talas Fu Yifan Wang Yang Liu Dong Wang Jing Shao Lijun Wang H. Lu 89 4 0 05 Jun 2024
DriVLMe: Enhancing LLM-based Autonomous Driving Agents with Embodied and Social Experiences Yidong Huang Jacob Sansom Ziqiao Ma Felix Gervits Joyce Chai 116 18 0 05 Jun 2024
A Comprehensive Overview of Large Language Models (LLMs) for Cyber Defences: Opportunities and Directions Mohammed Hassanin Nour Moustafa 80 32 0 23 May 2024
MeteoRA: Multiple-tasks Embedded LoRA for Large Language Models Jingwei Xu Junyu Lai Yunpeng Huang MoE MoMe 89 11 0 19 May 2024
When LLMs step into the 3D World: A Survey and Meta-Analysis of 3D Tasks via Multi-modal Large Language Models Xianzheng Ma Yash Bhalgat Brandon Smart Shuai Chen Xinghui Li ... Matthias Nießner Ian D Reid Angel X. Chang Iro Laina V. Prisacariu LRM 130 21 0 16 May 2024
Probing Multimodal LLMs as World Models for Driving Shiva Sreeram Tsun-Hsuan Wang Alaa Maalouf Guy Rosman S. Karaman Daniela Rus 91 10 0 09 May 2024
Traj-LLM: A New Exploration for Empowering Trajectory Prediction with Pre-trained Large Language Models Zhengxing Lan Hongbo Li Lingshan Liu Bo Fan Yisheng Lv Yilong Ren Zhiyong Cui 93 22 0 08 May 2024
OmniDrive: A Holistic Vision-Language Dataset for Autonomous Driving with Counterfactual Reasoning Shihao Wang Zhiding Yu Xiaohui Jiang Shiyi Lan Min Shi Nadine Chang Jan Kautz Ying Li Jose M. Alvarez LRM 97 48 0 02 May 2024
Can Vehicle Motion Planning Generalize to Realistic Long-tail Scenarios? Marcel Hallgarten Julian Zapata Martin Stoll Katrin Renz Andreas Zell 104 13 0 11 Apr 2024
AgentsCoDriver: Large Language Model Empowered Collaborative Driving with Lifelong Learning Senkang Hu Zhengru Fang Zihan Fang Yiqin Deng Xianhao Chen Yuguang Fang 123 35 0 09 Apr 2024
LeGo-Drive: Language-enhanced Goal-oriented Closed-Loop End-to-End Autonomous Driving Pranjal Paul Anant Garg Tushar Choudhary Arun Kumar Singh K. M. Krishna 108 3 0 29 Mar 2024
Multi-Frame, Lightweight & Efficient Vision-Language Models for Question Answering in Autonomous Driving Akshay Gopalkrishnan Ross Greer Mohan M. Trivedi VLM 89 25 0 28 Mar 2024
LC-LLM: Explainable Lane-Change Intention and Trajectory Predictions with Large Language Models Mingxing Peng Xusen Guo Xianda Chen Meixin Zhu Kehua Chen Hao Hao Yang Xuesong Wang Yinhai Wang LRM 107 21 0 27 Mar 2024
Hallucination Detection in Foundation Models for Decision-Making: A Flexible Definition and Review of the State of the Art Neeloy Chakraborty Melkior Ornik Katherine Driggs-Campbell LRM 241 12 0 25 Mar 2024
Safety Implications of Explainable Artificial Intelligence in End-to-End Autonomous Driving Shahin Atakishiyev Mohammad Salameh Randy Goebel 262 6 0 18 Mar 2024
Driving Style Alignment for LLM-powered Driver Agent Ruoxuan Yang Xinyue Zhang Anais Fernandez-Laaksonen Xin Ding Jiangtao Gong 65 11 0 17 Mar 2024
DrPlanner: Diagnosis and Repair of Motion Planners Using Large Language Models Yuanfei Lin Chenran Li Mingyu Ding Masayoshi Tomizuka Wei Zhan Matthias Althoff 75 6 0 12 Mar 2024
Embodied Understanding of Driving Scenarios Yunsong Zhou Linyan Huang Qingwen Bu Jia Zeng Tianyu Li Hang Qiu Hongzi Zhu Minyi Guo Yu Qiao Hongyang Li LM&Ro 103 33 0 07 Mar 2024
VADv2: End-to-End Vectorized Autonomous Driving via Probabilistic Planning Shaoyu Chen Bo Jiang Hao Gao Bencheng Liao Qing Xu Qian Zhang Chang Huang Wenyu Liu Xinggang Wang BDL 110 69 0 20 Feb 2024
RAG-Driver: Generalisable Driving Explanations with Retrieval-Augmented In-Context Learning in Multi-Modal Large Language Model Jianhao Yuan Shuyang Sun Daniel Omeiza Bo Zhao Paul Newman Lars Kunze Matthew Gadd LRM 111 58 0 16 Feb 2024
Towards Explainable, Safe Autonomous Driving with Language Embeddings for Novelty Identification and Active Learning: Framework and Experimental Analysis with Real-World Data Sets Ross Greer Mohan M. Trivedi 100 21 0 11 Feb 2024
Delving into Multi-modal Multi-task Foundation Models for Road Scene Understanding: From Learning Paradigm Perspectives Sheng Luo Wei Chen Wanxin Tian Rui Liu Luanxuan Hou ... Ling Shao Yi Yang Bojun Gao Qun Li Guobin Wu 131 17 0 05 Feb 2024
LimSim++: A Closed-Loop Platform for Deploying Multimodal LLMs in Autonomous Driving Daocheng Fu Wenjie Lei Licheng Wen Pinlong Cai Song Mao Min Dou Botian Shi Yu Qiao 120 31 0 02 Feb 2024
A Survey for Foundation Models in Autonomous Driving Haoxiang Gao Yaqian Li Kaiwen Long Ming Yang Yiqing Shen VLM LRM 109 32 0 02 Feb 2024
GRATH: Gradual Self-Truthifying for Large Language Models Weixin Chen Basel Alomair Yue Liu HILM SyDa 47 6 0 22 Jan 2024
DDM-Lag : A Diffusion-based Decision-making Model for Autonomous Vehicles with Lagrangian Safety Enhancement Jiaqi Liu Peng Hang Xiaocong Zhao Jianqiang Wang Jian Sun 100 11 0 08 Jan 2024
A Survey on Autonomous Driving Datasets: Statistics, Annotation Quality, and a Future Outlook Mingyu Liu Ekim Yurtsever Jonathan Fossaert Xingcheng Zhou Walter Zimmer Yuning Cui B. L. Žagar Alois Knoll 149 40 0 02 Jan 2024
LingoQA: Video Question Answering for Autonomous Driving Ana-Maria Marcu Long Chen Jan Hünermann Alice Karnsund Benoît Hanotte ... Vijay Badrinarayanan Alex Kendall Jamie Shotton Elahe Arani Oleg Sinavski 62 45 0 21 Dec 2023
Personalized Autonomous Driving with Large Language Models: Field Experiments Can Cui Zichong Yang Yupeng Zhou Yunsheng Ma Juanwu Lu Lingxi Li Yaobin Chen Jitesh Panchal Ziran Wang 130 19 0 14 Dec 2023
DriveMLM: Aligning Multi-Modal Large Language Models with Behavioral Planning States for Autonomous Driving Wenhai Wang Jiangwei Xie ChuanYang Hu Haoming Zou Jianan Fan ... Lewei Lu Xizhou Zhu Xiaogang Wang Yu Qiao Jifeng Dai 90 146 0 14 Dec 2023
LMDrive: Closed-Loop End-to-End Driving with Large Language Models Hao Shao Yuxuan Hu Letian Wang Steven L. Waslander Yu Liu Hongsheng Li ELM 115 138 0 12 Dec 2023
NuScenes-MQA: Integrated Evaluation of Captions and QA for Autonomous Driving Datasets using Markup Annotations Yuichi Inoue Yuki Yada Kotaro Tanahashi Yu Yamaguchi 66 23 0 11 Dec 2023
Evaluation of Large Language Models for Decision Making in Autonomous Driving Kotaro Tanahashi Yuichi Inoue Yu Yamaguchi Hidetatsu Yaginuma Daiki Shiotsuka ... Koki Igari Tsukasa Horinouchi Kento Tokuhiro Yugo Tokuchi Shunsuke Aoki 57 11 0 11 Dec 2023
Prospective Role of Foundation Models in Advancing Autonomous Vehicles Jianhua Wu B. Gao Jincheng Gao Jianhao Yu Hongqing Chu ... Xun Gong Yi Chang H. E. Tseng Hong Chen Jie Chen 94 5 0 08 Dec 2023
LaMPilot: An Open Benchmark Dataset for Autonomous Driving with Language Model Programs Yunsheng Ma Can Cui Xu Cao Wenqian Ye Peiran Liu ... Rohit Gupta Kyungtae Han Aniket Bera James M. Rehg Ziran Wang 66 45 0 07 Dec 2023
Towards Knowledge-driven Autonomous Driving Xin Li Yeqi Bai Pinlong Cai Licheng Wen Daocheng Fu ... Yikang Li Botian Shi Yong-Jin Liu Liang He Yu Qiao 115 28 0 07 Dec 2023
Natural-language-driven Simulation Benchmark and Copilot for Efficient Production of Object Interactions in Virtual Road Scenes Kairui Yang Zihao Guo Gengjie Lin Haotian Dong Die Zuo ... Zhao Huang Zhecheng Xu Fupeng Li Ziyun Bai Di Lin 58 2 0 07 Dec 2023
LL3DA: Visual Interactive Instruction Tuning for Omni-3D Understanding, Reasoning, and Planning Sijin Chen Xin Chen C. Zhang Mingsheng Li Gang Yu Hao Fei Erik Cambria Jiayuan Fan Tao Chen MLLM 81 102 0 30 Nov 2023
Categorical Traffic Transformer: Interpretable and Diverse Behavior Prediction with Tokenized Latent Yuxiao Chen Sander Tonkens Marco Pavone 77 9 0 30 Nov 2023
Mitigating Object Hallucinations in Large Vision-Language Models through Visual Contrastive Decoding Sicong Leng Hang Zhang Guanzheng Chen Xin Li Shijian Lu Chunyan Miao Li Bing VLM MLLM 153 239 0 28 Nov 2023
A Survey on Multimodal Large Language Models for Autonomous Driving Can Cui Yunsheng Ma Xu Cao Wenqian Ye Yang Zhou ... Xinrui Yan Shuqi Mei Jianguo Cao Ziran Wang Chao Zheng 169 290 0 21 Nov 2023
Applications of Large Scale Foundation Models for Autonomous Driving Yu Huang Yue Chen Zhu Li ELM AI4CE LRM ALM LM&Ro 139 16 0 20 Nov 2023
On the Road with GPT-4V(ision): Early Explorations of Visual-Language Model on Autonomous Driving Licheng Wen Xuemeng Yang Daocheng Fu Xiaofeng Wang Pinlong Cai ... Xinyu Cai Min Dou Shuanglu Hu Botian Shi Yu Qiao VLM 94 85 0 09 Nov 2023
LLM4Drive: A Survey of Large Language Models for Autonomous Driving Zhenjie Yang Xiaosong Jia Hongyang Li Junchi Yan ELM 142 121 0 02 Nov 2023
Vision Language Models in Autonomous Driving: A Survey and Outlook Xingcheng Zhou Mingyu Liu Ekim Yurtsever B. L. Žagar Walter Zimmer Hu Cao Alois C. Knoll VLM 109 60 0 22 Oct 2023
LanguageMPC: Large Language Models as Decision Makers for Autonomous Driving Hao Sha Yao Mu Yuxuan Jiang Li Chen Chenfeng Xu Ping Luo Shengbo Eben Li Masayoshi Tomizuka Wei Zhan Mingyu Ding 263 179 0 04 Oct 2023
Talk2BEV: Language-enhanced Bird's-eye View Maps for Autonomous Driving Tushar Choudhary Vikrant Dewangan Shivam Chandhok Shubham Priyadarshan Anushka Jain A. K. Singh Siddharth Srivastava Krishna Murthy Jatavallabhula K. M. Krishna 102 66 0 03 Oct 2023
SurrealDriver: Designing Generative Driver Agent Simulation Framework in Urban Contexts based on Large Language Model Ye Jin Xiaoxi Shen Huiling Peng Xiaoan Liu Jingli Qin Jiayang Li Jintao Xie Peizhong Gao Guyue Zhou Jiangtao Gong LLMAG 100 13 0 22 Sep 2023
Car-Following Models: A Multidisciplinary Review T. Zhang Ph.D. Peter J. Jin Ph.D. Sean T. McQuade Ph.D. Alexandre M. Bayen Ph.D. B. Piccoli 144 4 0 14 Apr 2023