AutoVLA: A Vision-Language-Action Model for End-to-End Autonomous Driving with Adaptive Reasoning and Reinforcement Fine-Tuning

16 June 2025

Papers citing "AutoVLA: A Vision-Language-Action Model for End-to-End Autonomous Driving with Adaptive Reasoning and Reinforcement Fine-Tuning"

38 / 38 papers shown

Title
LightEMMA: Lightweight End-to-End Multimodal Model for Autonomous Driving Zhijie Qiao Haowei Li Zhong Cao Henry X. Liu VLM 151 16 0 01 May 2025
NORA: A Small Open-Sourced Generalist Vision Language Action Model for Embodied Tasks Chia-Yu Hung Qi Sun Pengfei Hong Amir Zadeh Chuan Li U-Xuan Tan Navonil Majumder Soujanya Poria LM&Ro 118 4 0 28 Apr 2025
Reasoning Models Can Be Effective Without Thinking Wenjie Ma Jingxuan He Charlie Snell Tyler Griggs Sewon Min Matei A. Zaharia ReLM LRM 117 53 1 14 Apr 2025
NuScenes-SpatialQA: A Spatial Understanding and Reasoning Benchmark for Vision-Language Models in Autonomous Driving Kexin Tian Jingrui Mao Yu Zhang Jiwan Jiang Yang Zhou Zhengzhong Tu CoGe 136 5 0 04 Apr 2025
OpenDriveVLA: Towards End-to-end Autonomous Driving with Large Vision Language Action Model Xingcheng Zhou Xuyuan Han Feng Yang Yunpu Ma Alois C. Knoll VLM 131 9 0 30 Mar 2025
CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Models Qingqing Zhao Yao Lu Moo Jin Kim Zipeng Fu Zhuoyang Zhang ... Ankur Handa Xuan Li Donglai Xiang Gordon Wetzstein Nayeon Lee LM&Ro LRM 78 32 0 27 Mar 2025
ORION: A Holistic End-to-End Autonomous Driving Framework by Vision-Language Instructed Action Generation Haoyu Fu Diankun Zhang Zongchuang Zhao Jianfeng Cui Dingkang Liang Chong Zhang Dingyuan Zhang Hongwei Xie Bing Wang Xiang Bai 91 6 0 25 Mar 2025
NuPlanQA: A Large-Scale Dataset and Benchmark for Multi-View Driving Scene Understanding in Multi-Modal Large Language Models Sung-Yeon Park Can Cui Yunsheng Ma Ahmadreza Moradipari Rohit Gupta Kyungtae Han Ziran Wang 68 2 0 17 Mar 2025
Centaur: Robust End-to-End Autonomous Driving with Test-Time Training Chonghao Sima Kashyap Chitta Zhiding Yu Shiyi Lan Ping Luo Andreas Geiger Haoyang Li Jose M. Alvarez 118 7 0 14 Mar 2025
Finetuning Generative Trajectory Model with Reinforcement Learning from Human Feedback Derun Li Jianwei Ren Y. Wang Xin Wen Pengxiang Li ... Zhongpu Xia Peng Jia Xianpeng Lang Ningyi Xu Hang Zhao 92 7 0 13 Mar 2025
SimLingo: Vision-Only Closed-Loop Autonomous Driving with Language-Action Alignment Katrin Renz Long Chen Elahe Arani Oleg Sinavski MLLM 197 6 0 12 Mar 2025
CoT-Drive: Efficient Motion Forecasting for Autonomous Driving with LLMs and Chain-of-Thought Prompting Haicheng Liao Hanlin Kong Bonan Wang Chengyue Wang Wang Ye Zhengbing He Chengzhong Xu Zehan Li 102 8 0 10 Mar 2025
AlphaDrive: Unleashing the Power of VLMs in Autonomous Driving via Reinforcement Learning and Reasoning Bo Jiang Shaoyu Chen Qian Zhang Wenyu Liu Xinggang Wang OffRL LRM VLM 134 12 0 10 Mar 2025
BEVDriver: Leveraging BEV Maps in LLMs for Robust Closed-Loop Driving Katharina Winter Mark Azer Fabian B. Flohr 89 2 0 05 Mar 2025
VLM-E2E: Enhancing End-to-End Autonomous Driving with Multimodal Driver Attention Fusion Pei Liu Haipeng Liu Haichao Liu Xin Liu Jinxin Ni Jun Ma 109 3 0 25 Feb 2025
Qwen2.5-VL Technical Report S. Bai Keqin Chen Xuejing Liu Jialin Wang Wenbin Ge ... Zesen Cheng Hang Zhang Zhibo Yang Haiyang Xu Junyang Lin VLM 327 685 0 20 Feb 2025
RAD: Training an End-to-End Driving Policy via Large-Scale 3DGS-based Reinforcement Learning Hao Gao Shaoyu Chen Bo Jiang Bencheng Liao Yiang Shi ... Xinbang Zhang Y. Zhang Wenyu Liu Qian Zhang Xinggang Wang 170 10 0 18 Feb 2025
DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning DeepSeek-AI Daya Guo Dejian Yang Haowei Zhang Junxiao Song ... Shiyu Wang S. Yu Shunfeng Zhou Shuting Pan S.S. Li ReLM VLM OffRL AI4TS LRM 377 1,967 0 22 Jan 2025
DriveLM: Driving with Graph Visual Question Answering Chonghao Sima Katrin Renz Kashyap Chitta Lawrence Yunliang Chen Hanxue Zhang Chengen Xie Jens Beißwenger Ping Luo Andreas Geiger Hongyang Li 214 206 0 17 Jan 2025
FAST: Efficient Action Tokenization for Vision-Language-Action Models Karl Pertsch Kyle Stachowicz Brian Ichter Danny Driess Suraj Nair Q. Vuong Oier Mees Chelsea Finn Sergey Levine 132 70 0 17 Jan 2025
Distilling Multi-modal Large Language Models for Autonomous Driving Deepti Hegde R. Yasarla H. Cai Shizhong Han Apratim Bhattacharyya Shweta Mahajan Litian Liu Risheek Garrepalli Vishal M. Patel Fatih Porikli 63 7 0 17 Jan 2025
DiffusionDrive: Truncated Diffusion Model for End-to-End Autonomous Driving Bencheng Liao Shaoyu Chen Haoran Yin Bo Jiang Cheng Wang ... Xinbang Zhang Xiangyu Li Y. Zhang Qian Zhang Xinggang Wang 182 44 0 22 Nov 2024
Driving with Regulation: Interpretable Decision-Making for Autonomous Vehicles with Retrieval-Augmented Reasoning via LLM Tianhui Cai Yifan Liu Zewei Zhou Haoxuan Ma Seth Z. Zhao Zhiwen Wu Jiaqi Ma 100 11 0 07 Oct 2024
Bench2Drive: Towards Multi-Ability Benchmarking of Closed-Loop End-To-End Autonomous Driving Xiaosong Jia Zhenjie Yang Qifeng Li Zhiyuan Zhang Junchi Yan ELM 93 56 0 06 Jun 2024
SparseDrive: End-to-End Autonomous Driving via Sparse Scene Representation Wenchao Sun Xuewu Lin Yining Shi Chuang Zhang Haoran Wu Sifa Zheng 108 40 0 30 May 2024
GenAD: Generative End-to-End Autonomous Driving Wenzhao Zheng Ruiqi Song Xianda Guo Chenming Zhang Long Chen 111 68 0 18 Feb 2024
DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models Zhihong Shao Peiyi Wang Qihao Zhu Runxin Xu Jun-Mei Song ... Haowei Zhang Mingchuan Zhang Yiming Li Yu-Huan Wu Daya Guo ReLM LRM 146 1,274 0 05 Feb 2024
Hybrid-Prediction Integrated Planning for Autonomous Driving Haochen Liu Zhiyu Huang Wenhui Huang Haohan Yang Xiaoyu Mo Chen Lv 101 10 0 04 Feb 2024
LMDrive: Closed-Loop End-to-End Driving with Large Language Models Hao Shao Yuxuan Hu Letian Wang Steven L. Waslander Yu Liu Hongsheng Li ELM 94 137 0 12 Dec 2023
Pre-training on Synthetic Driving Data for Trajectory Prediction Yiheng Li Seth Z. Zhao Chenfeng Xu Chen Tang Chenran Li Mingyu Ding Masayoshi Tomizuka Wei Zhan 71 13 0 18 Sep 2023
Language Prompt for Autonomous Driving Dongming Wu Wencheng Han Tiancai Wang Yingfei Liu Cheng-zhong Xu Jianbing Shen Jianbing Shen VLM 107 86 0 08 Sep 2023
DriveAdapter: Breaking the Coupling Barrier of Perception and Planning in End-to-End Autonomous Driving Xiaosong Jia Yulu Gao Li Chen Junchi Yan Patrick Langechuan Liu Hongyang Li 69 80 0 01 Aug 2023
Direct Preference Optimization: Your Language Model is Secretly a Reward Model Rafael Rafailov Archit Sharma E. Mitchell Stefano Ermon Christopher D. Manning Chelsea Finn ALM 387 4,139 0 29 May 2023
GameFormer: Game-theoretic Modeling and Learning of Transformer-based Interactive Prediction and Planning for Autonomous Driving Zhiyu Huang Haochen Liu Chen Lv OffRL 99 106 0 10 Mar 2023
ADAPT: Action-aware Driving Caption Transformer Bu Jin Xinyi Liu Yupeng Zheng Pengfei Li Hao Zhao Tong Zhang Yuhang Zheng Guyue Zhou Jingjing Liu 124 73 0 01 Feb 2023
ST-P3: End-to-end Vision-based Autonomous Driving via Spatial-Temporal Feature Learning Shengchao Hu Li Chen Peng Wu Hongyang Li Junchi Yan Dacheng Tao 90 251 0 15 Jul 2022
Training language models to follow instructions with human feedback Long Ouyang Jeff Wu Xu Jiang Diogo Almeida Carroll L. Wainwright ... Amanda Askell Peter Welinder Paul Christiano Jan Leike Ryan J. Lowe OSLM ALM 883 13,176 0 04 Mar 2022
nuScenes: A multimodal dataset for autonomous driving Holger Caesar Varun Bankiti Alex H. Lang Sourabh Vora Venice Erin Liong Qiang Xu Anush Krishnan Yuxin Pan G. Baldan Oscar Beijbom 3DPC 301 5,779 0 26 Mar 2019