FUTR3D: A Unified Sensor Fusion Framework for 3D Detection

20 March 2022

Xuanyao Chen

Tianyuan Zhang

Yue Wang

Yilun Wang

Hang Zhao

3DPC

ArXiv PDF HTML

Papers citing "FUTR3D: A Unified Sensor Fusion Framework for 3D Detection"

50 / 53 papers shown

Title
DepthFusion: Depth-Aware Hybrid Feature Fusion for LiDAR-Camera 3D Object Detection Mingqian Ji Jian Yang Shanshan Zhang 3DPC MDE 40 0 0 12 May 2025
Resilient Sensor Fusion under Adverse Sensor Failures via Multi-Modal Expert Fusion Konyul Park Yecheol Kim Daehun Kim Jun-Won Choi 39 0 0 25 Mar 2025
DeepInteraction++: Multi-Modality Interaction for Autonomous Driving Zeyu Yang Nan Song Wei Li Xiatian Zhu L. Zhang Philip H. S. Torr 79 4 0 24 Feb 2025
LXLv2: Enhanced LiDAR Excluded Lean 3D Object Detection with Fusion of 4D Radar and Camera Weiyi Xiong Zean Zou Qiuchi Zhao Fengchun He Bing Zhu 72 1 0 21 Feb 2025
AI-Powered Urban Transportation Digital Twin: Methods and Applications Xuan Di Yongjie Fu Mehmet K.Turkcan Mahshid Ghasemi Zhaobin Mo Chengbo Zang Abhishek Adhikari Z. Kostić Gil Zussman AI4CE 36 0 0 30 Dec 2024
EVT: Efficient View Transformation for Multi-Modal 3D Object Detection Yongjin Lee Hyeon-Mun Jeong Yurim Jeon Sanghyun Kim 45 0 0 16 Nov 2024
Progressive Multi-Modal Fusion for Robust 3D Object Detection Rohit Mohan Daniele Cattaneo Florian Drews Abhinav Valada 3DPC 43 3 0 09 Oct 2024
UniBEVFusion: Unified Radar-Vision BEVFusion for 3D Object Detection Haocheng Zhao Runwei Guan Taoyu Wu Ka Lok Man Limin Yu Yutao Yue MDE 31 2 0 23 Sep 2024
OccSora: 4D Occupancy Generation Models as World Simulators for Autonomous Driving Lening Wang Wenzhao Zheng Yilong Ren Han Jiang Zhiyong Cui Haiyang Yu Jiwen Lu VGen 40 28 0 30 May 2024
Benchmarking and Improving Bird's Eye View Perception Robustness in Autonomous Driving Shaoyuan Xie Lingdong Kong Wenwei Zhang Jiawei Ren Liang Pan Kai-xiang Chen Ziwei Liu AAML 55 9 0 27 May 2024
CRKD: Enhanced Camera-Radar Object Detection with Cross-modality Knowledge Distillation Lingjun Zhao Jingyu Song Katherine A. Skinner 44 11 0 28 Mar 2024
GraphBEV: Towards Robust BEV Feature Alignment for Multi-Modal 3D Object Detection Ziying Song Lei Yang Shaoqing Xu Lin Liu Dongyang Xu Caiyan Jia Feiyang Jia Li-e Wang 3DPC 62 14 0 18 Mar 2024
A Survey of Vision Transformers in Autonomous Driving: Current Trends and Future Directions Quoc-Vinh Lai-Dang ViT 33 2 0 12 Mar 2024
Unleashing HyDRa: Hybrid Fusion, Depth Consistency and Radar for Unified 3D Perception Philipp Wolters Johannes Gilg Torben Teepe Fabian Herzog Anouar Laouichi Martin Hofmann Gerhard Rigoll MDE 68 13 0 12 Mar 2024
MultiCorrupt: A Multi-Modal Robustness Dataset and Benchmark of LiDAR-Camera Fusion for 3D Object Detection Till Beemelmanns Quan Zhang Christian Geller Lutz Eckstein 3DPC 31 3 0 18 Feb 2024
Lift-Attend-Splat: Bird's-eye-view camera-lidar fusion using transformers James Gunn Zygmunt Lenyk Anuj Sharma Andrea Donati Alexandru Buburuzan John Redford Romain Mueller MDE 38 8 0 22 Dec 2023
DrivingGaussian: Composite Gaussian Splatting for Surrounding Dynamic Autonomous Driving Scenes Xiaoyu Zhou Zhiwei Lin Xiaojun Shan Yongtao Wang Deqing Sun Ming-Hsuan Yang 3DGS 42 177 0 13 Dec 2023
mmFUSION: Multimodal Fusion for 3D Objects Detection Javed Ahmad Alessio Del Bue 3DPC 18 9 0 07 Nov 2023
4D-Former: Multimodal 4D Panoptic Segmentation Ali Athar Enxu Li Sergio Casas R. Urtasun 3DPC 35 10 0 02 Nov 2023
Multimodal Object Query Initialization for 3D Object Detection Mathijs R. van Geerenstein Felicia Ruppel Klaus C. J. Dietmayer D. Gavrila 3DPC 30 2 0 16 Oct 2023
PonderV2: Pave the Way for 3D Foundation Model with A Universal Pre-training Paradigm Haoyi Zhu Honghui Yang Xiaoyang Wu Di Huang Sha Zhang ... Hengshuang Zhao Chunhua Shen Yu Qiao Tong He Wanli Ouyang SSL 71 43 0 12 Oct 2023
CoBEVFusion: Cooperative Perception with LiDAR-Camera Bird's-Eye View Fusion Donghao Qiao F. Zulkernine 26 5 0 09 Oct 2023
UniBEV: Multi-modal 3D Object Detection with Uniform BEV Encoders for Robustness against Missing Sensor Modalities Shiming Wang Holger Caesar Liangliang Nan Julian F. P. Kooij 64 11 0 25 Sep 2023
UniTR: A Unified and Efficient Multi-Modal Transformer for Bird's-Eye-View Representation Haiyang Wang Hao Tang Shaoshuai Shi Aoxue Li Zhenguo Li Bernt Schiele Liwei Wang ViT 40 56 0 15 Aug 2023
Transformer-based models and hardware acceleration analysis in autonomous driving: A survey J. Zhong Zheng Liu Xiangshan Chen ViT 44 17 0 21 Apr 2023
Radar-Camera Fusion for Object Detection and Semantic Segmentation in Autonomous Driving: A Comprehensive Review Shanliang Yao Runwei Guan Xiaoyu Huang Zhuoxiao Li Xiangyu Sha ... Eng Gee Lim H. Seo Ka Lok Man Xiaohui Zhu Yutao Yue 41 91 0 20 Apr 2023
Sparse Dense Fusion for 3D Object Detection Yulu Gao Chonghao Sima Shaoshuai Shi Shangzhe Di Sihan Liu Hongyang Li 26 15 0 09 Apr 2023
Understanding the Robustness of 3D Object Detection with Bird's-Eye-View Representations in Autonomous Driving Zijian Zhu Yichi Zhang Hai Chen Yinpeng Dong Shu Zhao Wenbo Ding Jiachen Zhong Shibao Zheng AAML 3DPC 23 38 0 30 Mar 2023
BEVFusion4D: Learning LiDAR-Camera Fusion Under Bird's-Eye-View via Cross-Modality Guidance and Temporal Aggregation Hongxiang Cai Zeyuan Zhang Zhenyu Zhou Ziyin Li Wenbo Ding Jiu-Yang Zhao 3DPC 26 30 0 30 Mar 2023
Virtual Sparse Convolution for Multimodal 3D Object Detection Hai Wu Chenglu Wen Shaoshuai Shi Xin Li Cheng-i Wang 3DPC 16 103 0 04 Mar 2023
X $^3$ KD: Knowledge Distillation Across Modalities, Tasks and Stages for Multi-Camera 3D Object Detection Marvin Klingner Shubhankar Borse V. Kumar B. Rezaei V. Narayanan S. Yogamani Fatih Porikli 42 21 0 03 Mar 2023
Grid-Centric Traffic Scenario Perception for Autonomous Driving: A Comprehensive Review Yining Shi Kun Jiang Jiusi Li Zelin Qian Jun Wen Mengmeng Yang Ke Wang Diange Yang 88 25 0 02 Mar 2023
Transformer-Based Sensor Fusion for Autonomous Driving: A Survey Apoorv Singh ViT 3DPC 34 23 0 22 Feb 2023
Priors are Powerful: Improving a Transformer for Multi-camera 3D Detection with 2D Priors Di Feng Francesco Ferroni ViT 24 1 0 31 Jan 2023
Cross Modal Transformer: Towards Fast and Robust 3D Object Detection Junjie Yan Yingfei Liu Jian‐Yuan Sun Fan Jia Shuailin Li Tiancai Wang Xiangyu Zhang ViT 3DPC 28 55 0 03 Jan 2023
SuperFusion: Multilevel LiDAR-Camera Fusion for Long-Range HD Map Generation Hao Dong Xianjing Zhang Jintao Xu Rui Ai Weihao Gu Huimin Lu Arno Solin Xieyuanli Chen 31 31 0 28 Nov 2022
3DPPE: 3D Point Positional Encoding for Multi-Camera 3D Object Detection Transformers Changyong Shu Jiajun Deng F. I. F. Richard Yu Yifan Liu 3DPC 23 10 0 27 Nov 2022
3D Dual-Fusion: Dual-Domain Dual-Query Camera-LiDAR Fusion for 3D Object Detection Yecheol Kim Konyul Park Minwook Kim Dongsuk Kum J. Choi 3DPC 29 21 0 24 Nov 2022
Center Feature Fusion: Selective Multi-Sensor Fusion of Center-based Objects P. Jacobson Yiyang Zhou Wei Zhan M. Tomizuka Ming Wu 3DPC 26 8 0 26 Sep 2022
DeepInteraction: 3D Object Detection via Modality Interaction Zeyu Yang Jia-Qing Chen Zhenwei Miao Wei Li Xiatian Zhu Li Zhang 49 132 0 23 Aug 2022
Vision-Centric BEV Perception: A Survey Yuexin Ma Tai Wang Xuyang Bai Huitong Yang Yuenan Hou Yaming Wang Yu Qiao Ruigang Yang Tianyi Zhou Xinge Zhu 50 129 0 04 Aug 2022
VectorMapNet: End-to-end Vectorized HD Map Learning Yicheng Liu Tianyuan Yuan Yue Wang Yilun Wang Hang Zhao 21 188 0 17 Jun 2022
TransFuser: Imitation with Transformer-Based Sensor Fusion for Autonomous Driving Kashyap Chitta Aditya Prakash Bernhard Jaeger Zehao Yu Katrin Renz Andreas Geiger ViT 104 295 0 31 May 2022
Benchmarking the Robustness of LiDAR-Camera Fusion for 3D Object Detection Kaicheng Yu Tao Tang Hongwei Xie Zhiwei Lin Zhongwei Wu ... Jiong Deng Dayang Hao Yongtao Wang Xi Liang Bing Wang 3DPC 29 53 0 30 May 2022
BEVFusion: A Simple and Robust LiDAR-Camera Fusion Framework Tingting Liang Hongwei Xie Kaicheng Yu Zhongyu Xia Zhiwei Lin Yongtao Wang T. Tang Bing Wang Zhi Tang 3DPC 24 398 0 27 May 2022
BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representation Zhijian Liu Haotian Tang Alexander Amini Xinyu Yang Huizi Mao Daniela Rus Song Han 61 872 0 26 May 2022
DeepFusion: Lidar-Camera Deep Fusion for Multi-Modal 3D Object Detection Yingwei Li Adams Wei Yu Tianjian Meng Benjamin Caine Jiquan Ngiam ... Yifeng Lu Denny Zhou Quoc V. Le Alan Yuille Mingxing Tan 3DPC 37 329 0 15 Mar 2022
Multimodal Virtual Point 3D Detection Tianwei Yin Xingyi Zhou Philipp Krahenbuhl 3DPC 160 245 0 12 Nov 2021
A Survey of Visual Transformers Yang Liu Yao Zhang Yixin Wang Feng Hou Jin Yuan Jiang Tian Yang Zhang Zhongchao Shi Jianping Fan Zhiqiang He 3DGS ViT 77 330 0 11 Nov 2021
Object DGCNN: 3D Object Detection using Dynamic Graphs Yue Wang Justin Solomon 3DPC 157 104 0 13 Oct 2021