v1v2 (latest)

Driving with LLMs: Fusing Object-Level Vector Modality for Explainable Autonomous Driving

3 October 2023

Andrew James Willmott

Jamie Shotton

Papers citing "Driving with LLMs: Fusing Object-Level Vector Modality for Explainable Autonomous Driving"

50 / 154 papers shown

Title
Foundation Models in Autonomous Driving: A Survey on Scenario Generation and Scenario Analysis Yuan Gao Mattia Piccinini Yuchen Zhang Dingrui Wang Korbinian Moller ... Steven Peters Andrea Stocco Bassam Alrifaee Marco Pavone Johannes Betz 19 0 0 13 Jun 2025
Leveraging LLMs for Mission Planning in Precision Agriculture Marcos Abel Zuzuárregui Stefano Carpin 50 1 0 11 Jun 2025
One For All: LLM-based Heterogeneous Mission Planning in Precision Agriculture Marcos Abel Zuzuárregui Mustafa Melih Toslak Stefano Carpin 55 0 0 11 Jun 2025
DriveAction: A Benchmark for Exploring Human-like Driving Decisions in VLA Models Yuhan Hao Zhengning Li Lei Sun Weilong Wang Naixin Yi ... Caihong Qin Mofan Zhou Yifei Zhan Peng Jia Xianpeng Lang VLM 37 0 0 06 Jun 2025
Hierarchical Question-Answering for Driving Scene Understanding Using Vision-Language Models Safaa Abdullahi Moallim Mohamud Minjin Baek Dong Seog Han 42 0 0 03 Jun 2025
Trajectory Prediction Meets Large Language Models: A Survey Yi Xu Ruining Yang Yitian Zhang Yizhou Wang Jianglin Lu M. Zhang Lili Su Y. Fu LM&Ro LRM 18 0 0 03 Jun 2025
DriveMind: A Dual-VLM based Reinforcement Learning Framework for Autonomous Driving Dawood Wasif T. Moore Chandan K Reddy Jin-Hee Cho VLM 42 0 0 01 Jun 2025
S4-Driver: Scalable Self-Supervised Driving Multimodal Large Language Modelwith Spatio-Temporal Visual Representation Yichen Xie Runsheng Xu Tong He Jyh-Jing Hwang Katie Luo ... Letian Chen Yiren Lu Zhaoqi Leng Dragomir Anguelov Mingxing Tan VLM LRM 35 0 0 30 May 2025
Impromptu VLA: Open Weights and Open Data for Driving Vision-Language-Action Models Haohan Chi Huan-ang Gao Ziming Liu Jianing Liu Chenyu Liu ... Leichen Wang Xingtao Hu Hao Sun Hang Zhao Hao Zhao VLM 94 0 0 29 May 2025
IKIWISI: An Interactive Visual Pattern Generator for Evaluating the Reliability of Vision-Language Models Without Ground Truth Md Touhidul Islam Imran Kabir Md. Alimoor Reza Syed Masum Billah 39 0 0 28 May 2025
Chain-of-Thought for Autonomous Driving: A Comprehensive Survey and Future Prospects Yixin Cui Haotian Lin Shuo Yang Yixiao Wang Yanjun Huang Hong Chen LM&Ro LRM ELM 118 0 0 26 May 2025
Human-like Semantic Navigation for Autonomous Driving using Knowledge Representation and Large Language Models Augusto Luis Ballardini Miguel Ángel Sotelo 12 0 0 22 May 2025
SOLVE: Synergy of Language-Vision and End-to-End Networks for Autonomous Driving Xuesong Chen Linjiang Huang Tao Ma Rongyao Fang Shaoshuai Shi Hongsheng Li 70 0 0 22 May 2025
TinyDrive: Multiscale Visual Question Answering with Selective Token Routing for Autonomous Driving Hossein Hassani Soodeh Nikan Abdallah Shami MLLM 143 0 0 21 May 2025
HCRMP: A LLM-Hinted Contextual Reinforcement Learning Framework for Autonomous Driving Zhiwen Chen Bo Leng Zhuoren Li Hanming Deng Guizhe Jin Ran Yu Huanxi Wen 231 0 0 21 May 2025
VERDI: VLM-Embedded Reasoning for Autonomous Driving Bowen Feng Zhiting Mei Baiang Li Julian Ost Roger Girgis Anirudha Majumdar Felix Heide VLM LRM 244 0 0 21 May 2025
AgentThink: A Unified Framework for Tool-Augmented Chain-of-Thought Reasoning in Vision-Language Models for Autonomous Driving Kangan Qian Sicong Jiang Yang Zhong Ziang Luo Zilin Huang ... Yifei Hu Guang Li Guang Chen Hao Ye Lijun Sun LRM 90 1 0 21 May 2025
TS-VLM: Text-Guided SoftSort Pooling for Vision-Language Models in Multi-View Driving Reasoning Lihong Chen Hossein Hassani Soodeh Nikan VLM 104 0 0 19 May 2025
SafePath: Conformal Prediction for Safe LLM-Based Autonomous Navigation Achref Doula M. Mühlhäuser Alejandro Sánchez Guinea 116 0 0 14 May 2025
Bridging Human Oversight and Black-box Driver Assistance: Vision-Language Models for Predictive Alerting in Lane Keeping Assist Systems Yuhang Wang Hao Zhou VLM 65 1 0 14 May 2025
DriveSOTIF: Advancing Perception SOTIF Through Multimodal Large Language Models Shucheng Huang Freda Shi Chen Sun Jiaming Zhong Minghao Ning Yufeng Yang Yukun Lu Hong Wang A. Khajepour 91 0 0 11 May 2025
Adaptive Stress Testing Black-Box LLM Planners Neeloy Chakraborty John Pohovey Melkior Ornik Katherine Driggs-Campbell 76 0 0 08 May 2025
PADriver: Towards Personalized Autonomous Driving Genghua Kou Fan Jia Weixin Mao Yang Liu Yucheng Zhao Ziheng Zhang Osamu Yoshie Tiancai Wang You Li Xinming Zhang 98 0 0 08 May 2025
Multimodal Large Language Models for Enhanced Traffic Safety: A Comprehensive Review and Future Trends M. Tami Mohammed Elhenawy Huthaifa I. Ashqar 83 0 0 21 Apr 2025
The Mirage of Performance Gains: Why Contrastive Decoding Fails to Address Multimodal Hallucination Hao Yin Gunagzong Si Zilei Wang 494 0 0 14 Apr 2025
RAG-VR: Leveraging Retrieval-Augmented Generation for 3D Question Answering in VR Environments Shiyi Ding Ying Chen RALM 80 0 0 11 Apr 2025
Planning Safety Trajectories with Dual-Phase, Physics-Informed, and Transportation Knowledge-Driven Large Language Models Rui Gan Pei Li Keke Long Bocheng An Junwei You Keshu Wu Bin Ran 74 0 0 06 Apr 2025
Automated Factual Benchmarking for In-Car Conversational Systems using Large Language Models Rafael Giebisch Ken E. Friedl Lev Sorokin Andrea Stocco HILM 157 0 0 01 Apr 2025
Exploring the Roles of Large Language Models in Reshaping Transportation Systems: A Survey, Framework, and Roadmap Tong Nie Jian Sun Wei Ma 218 4 0 27 Mar 2025
Predicting the Road Ahead: A Knowledge Graph based Foundation Model for Scene Understanding in Autonomous Driving Hongkuan Zhou Stefan Schmid Yicong Li Lavdim Halilaj Xiangtong Yao Wei Cao 86 0 0 24 Mar 2025
AutoDrive-QA- Automated Generation of Multiple-Choice Questions for Autonomous Driving Datasets Using Large Vision-Language Models Boshra Khalili Andrew W.Smyth ELM 131 1 0 20 Mar 2025
RAD: Retrieval-Augmented Decision-Making of Meta-Actions with Vision-Language Models in Autonomous Driving Yujin Wang Quanfeng Liu Zhengxin Jiang Tianyi Wang Junfeng Jiao Hongqing Chu B. Gao Hong Chen 124 5 0 18 Mar 2025
Tracking Meets Large Multimodal Models for Driving Scenario Understanding Ayesha Ishaq Jean Lahoud Fahad Shahbaz Khan Salman Khan Hisham Cholakkal Rao Muhammad Anwer 110 2 0 18 Mar 2025
ClearSight: Visual Signal Enhancement for Object Hallucination Mitigation in Multimodal Large language Models Hao Yin Guangzong Si Zilei Wang 418 1 0 17 Mar 2025
Logic-RAG: Augmenting Large Multimodal Models with Visual-Spatial Knowledge for Road Scene Understanding Imran Kabir Md. Alimoor Reza Syed Masum Billah ReLM VLM LRM 113 1 0 16 Mar 2025
Road Rage Reasoning with Vision-language Models (VLMs): Task Definition and Evaluation Dataset Yibing Weng Yu Gu Fuji Ren 112 0 0 14 Mar 2025
Attention Reallocation: Towards Zero-cost and Controllable Hallucination Mitigation of MLLMs Chongjun Tu Peng Ye Dongzhan Zhou Lei Bai Gang Yu Tao Chen Wanli Ouyang 128 0 0 13 Mar 2025
DriveLMM-o1: A Step-by-Step Reasoning Dataset and Large Multimodal Model for Driving Scenario Understanding Ayesha Ishaq Jean Lahoud Ketan More Omkar Thawakar Ritesh Thawkar ... Fahad Shahbaz Khan Hisham Cholakkal Ivan Laptev Rao Muhammad Anwer Salman Khan LRM 123 4 0 13 Mar 2025
SimLingo: Vision-Only Closed-Loop Autonomous Driving with Language-Action Alignment Katrin Renz Long Chen Elahe Arani Oleg Sinavski MLLM 213 6 0 12 Mar 2025
A Cascading Cooperative Multi-agent Framework for On-ramp Merging Control Integrating Large Language Models Miao Zhang Zhenlong Fang Tianyi Wang Qin Zhang Shuai Lu Junfeng Jiao Tianyu Shi AI4CE 120 5 0 11 Mar 2025
AlphaDrive: Unleashing the Power of VLMs in Autonomous Driving via Reinforcement Learning and Reasoning Bo Jiang Shaoyu Chen Qian Zhang Wenyu Liu Xinggang Wang OffRL LRM VLM 159 12 0 10 Mar 2025
Combating Partial Perception Deficit in Autonomous Driving with Multimodal LLM Commonsense Yuting Hu Chenhui Xu Ruiyang Qin Dancheng Liu Amir Nassereldine Yiyu Shi Jinjun Xiong 112 0 0 10 Mar 2025
CoT-Drive: Efficient Motion Forecasting for Autonomous Driving with LLMs and Chain-of-Thought Prompting Haicheng Liao Hanlin Kong Bonan Wang Chengyue Wang Wang Ye Zhengbing He Chengzhong Xu Zehan Li 113 8 0 10 Mar 2025
Towards Effective and Efficient Context-aware Nucleus Detection in Histopathology Whole Slide Images Zhongyi Shui Ruizhe Guo Honglin Li Yuxuan Sun Yunlong Zhang Chenglu Zhu Jiatong Cai Pingyi Chen Yanzhou Su Lin Yang 98 0 0 04 Mar 2025
CorrA: Leveraging Large Language Models for Dynamic Obstacle Avoidance of Autonomous Vehicles Shanting Wang Panagiotis Typaldos Andreas A. Malikopoulos 113 0 0 03 Mar 2025
Visual Reasoning at Urban Intersections: FineTuning GPT-4o for Traffic Conflict Detection Sari Masri Huthaifa I. Ashqar Mohammed Elhenawy 137 0 0 27 Feb 2025
HazardNet: A Small-Scale Vision Language Model for Real-Time Traffic Safety Detection at Edge Devices M. Tami Mohammed Elhenawy Huthaifa I. Ashqar 146 0 0 27 Feb 2025
VLM-E2E: Enhancing End-to-End Autonomous Driving with Multimodal Driver Attention Fusion Pei Liu Haipeng Liu Haichao Liu Xin Liu Jinxin Ni Jun Ma 116 3 0 25 Feb 2025
VaViM and VaVAM: Autonomous Driving through Video Generative Modeling Florent Bartoccioni Elias Ramzi Victor Besnier Shashanka Venkataramanan Tuan-Hung Vu ... Mickael Chen Éloi Zablocki Andrei Bursuc Eduardo Valle Matthieu Cord VGen 176 2 0 24 Feb 2025
Large Language Models for Autonomous Driving (LLM4AD): Concept, Benchmark, Experiments, and Challenges Can Cui Yunsheng Ma Zichong Yang Yupeng Zhou Peiran Liu ... Jitesh Panchal Amr Abdelraouf Rohit Gupta Kyungtae Han Ziran Wang 108 2 0 21 Feb 2025