Prompting Multi-Modal Tokens to Enhance End-to-End Autonomous Driving Imitation Learning with LLMs

7 April 2024

Qiang Zhang

Renjing Xu

Papers citing "Prompting Multi-Modal Tokens to Enhance End-to-End Autonomous Driving Imitation Learning with LLMs"

32 / 32 papers shown

Title
ADAPT: Action-aware Driving Caption Transformer Bu Jin Xinyi Liu Yupeng Zheng Pengfei Li Hao Zhao Tong Zhang Yuhang Zheng Guyue Zhou Jingjing Liu 118 72 0 01 Feb 2023
Safety-Enhanced Autonomous Driving Using Interpretable Sensor Fusion Transformer Hao Shao Letian Wang Ruobing Chen Hongsheng Li Y. Liu 86 204 0 28 Jul 2022
ST-P3: End-to-end Vision-based Autonomous Driving via Spatial-Temporal Feature Learning Shengchao Hu Li Chen Peng Wu Hongyang Li Junchi Yan Dacheng Tao 88 242 0 15 Jul 2022
MMFN: Multi-Modal-Fusion-Net for End-to-End Driving Qingwen Zhang Mingkai Tang R. Geng Feiyi Chen Ren Xin Lujia Wang 70 36 0 01 Jul 2022
BEVDepth: Acquisition of Reliable Depth for Multi-view 3D Object Detection Yinhao Li Zheng Ge Guanyi Yu Jinrong Yang Zengran Wang Yukang Shi Jian‐Yuan Sun Zeming Li MDE 78 613 0 21 Jun 2022
Trajectory-guided Control Prediction for End-to-end Autonomous Driving: A Simple yet Strong Baseline Peng Wu Xiaosong Jia Li Chen Junchi Yan Hongyang Li Yu Qiao 76 195 0 16 Jun 2022
BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representation Zhijian Liu Haotian Tang Alexander Amini Xinyu Yang Huizi Mao Daniela Rus Song Han 150 907 0 26 May 2022
PaLM: Scaling Language Modeling with Pathways Aakanksha Chowdhery Sharan Narang Jacob Devlin Maarten Bosma Gaurav Mishra ... Kathy Meier-Hellstern Douglas Eck J. Dean Slav Petrov Noah Fiedel PILM LRM 471 6,231 0 05 Apr 2022
Training language models to follow instructions with human feedback Long Ouyang Jeff Wu Xu Jiang Diogo Almeida Carroll L. Wainwright ... Amanda Askell Peter Welinder Paul Christiano Jan Leike Ryan J. Lowe OSLM ALM 874 12,916 0 04 Mar 2022
BEVDet: High-performance Multi-camera 3D Object Detection in Bird-Eye-View Junjie Huang Guan Huang Zheng Zhu Yun Ye Dalong Du 3DPC 98 698 0 22 Dec 2021
GRI: General Reinforced Imitation and its Application to Vision-Based Autonomous Driving Raphael Chekroun Marin Toromanoff Sascha Hornauer Fabien Moutarde 70 61 0 16 Nov 2021
NEAT: Neural Attention Fields for End-to-End Autonomous Driving Kashyap Chitta Aditya Prakash Andreas Geiger 3DPC 83 213 0 09 Sep 2021
TransformerFusion: Monocular RGB Scene Reconstruction using Transformers Aljavz Bovzivc Pablo Rodríguez Palafox Justus Thies Angela Dai Matthias Nießner ViT 84 136 0 05 Jul 2021
RoadMap: A Light-Weight Semantic Map for Visual Localization towards Autonomous Driving Tong Qin Yucai Zheng Tongqing Chen Yilun Chen Qing Su 42 106 0 04 Jun 2021
FIERY: Future Instance Prediction in Bird's-Eye View from Surround Monocular Cameras Anthony Hu Zak Murez Nikhil C. Mohan Sofía Dudas Jeffrey Hawke Vijay Badrinarayanan R. Cipolla Alex Kendall 200 260 0 21 Apr 2021
Multi-Modal Fusion Transformer for End-to-End Autonomous Driving Aditya Prakash Kashyap Chitta Andreas Geiger ViT 106 525 0 19 Apr 2021
Ground-aware Monocular 3D Object Detection for Autonomous Driving Yuxuan Liu Yuan Yixuan Ming-Yuan Liu 3DPC 76 139 0 01 Feb 2021
VectorNet: Encoding HD Maps and Agent Dynamics from Vectorized Representation Jiyang Gao Chen Sun Hang Zhao Yi Shen Dragomir Anguelov Congcong Li Cordelia Schmid 121 813 0 08 May 2020
Lidar for Autonomous Driving: The principles, challenges, and trends for automotive lidar and perception systems You Li J. Ibañez-Guzmán 56 555 0 17 Apr 2020
PiP: Planning-informed Trajectory Prediction for Autonomous Driving Haoran Song Wenchao Ding Yuxuan Chen Shaojie Shen M. Y. Wang Qifeng Chen 72 138 0 25 Mar 2020
Monocular Depth Estimation Based On Deep Learning: An Overview Chaoqiang Zhao Qiyu Sun Chongzhen Zhang Yang Tang Feng Qian MDE 199 254 0 14 Mar 2020
A Survey of End-to-End Driving: Architectures and Training Methods Ardi Tampuu Maksym Semikin Naveed Muhammad D. Fishman Tambet Matiisen 3DV 57 235 0 13 Mar 2020
Learning by Cheating Dian Chen Brady Zhou V. Koltun Philipp Krahenbuhl SSL 91 515 0 27 Dec 2019
End-to-End Model-Free Reinforcement Learning for Urban Driving using Implicit Affordances Marin Toromanoff É. Wirbel Fabien Moutarde OffRL 118 207 0 25 Nov 2019
End-to-End Multi-View Fusion for 3D Object Detection in LiDAR Point Clouds Yin Zhou Pei Sun Yu Zhang Dragomir Anguelov J. Gao Tom Y. Ouyang James Guo Jiquan Ngiam Vijay Vasudevan 3DPC 69 350 0 15 Oct 2019
Learning to Drive in a Day Alex Kendall Jeffrey Hawke David Janz Przemyslaw Mazur Daniele Reda John M. Allen Vinh-Dieu Lam Alex Bewley Amar Shah 95 655 0 01 Jul 2018
YOLOv3: An Incremental Improvement Joseph Redmon Ali Farhadi ObjD 117 21,442 0 08 Apr 2018
CARLA: An Open Urban Driving Simulator Alexey Dosovitskiy G. Ros Felipe Codevilla Antonio M. López V. Koltun VLM 135 5,166 0 10 Nov 2017
End-to-end Driving via Conditional Imitation Learning Felipe Codevilla Matthias Muller Antonio M. López V. Koltun Alexey Dosovitskiy 125 1,066 0 06 Oct 2017
Proximal Policy Optimization Algorithms John Schulman Filip Wolski Prafulla Dhariwal Alec Radford Oleg Klimov OffRL 496 19,019 0 20 Jul 2017
Multi-View 3D Object Detection Network for Autonomous Driving Xiaozhi Chen Huimin Ma Ji Wan Bo Li Tian Xia 3DPC 176 2,772 0 23 Nov 2016
End to End Learning for Self-Driving Cars Mariusz Bojarski D. Testa Daniel Dworakowski Bernhard Firner B. Flepp ... Urs Muller Jiakai Zhang Xin Zhang Jake Zhao Karol Zieba SSL 100 4,167 0 25 Apr 2016