A Deep Learning-based Radar and Camera Sensor Fusion Architecture for Object Detection

15 May 2020

Felix Nobis

Maximilian Geisslinger

Markus Weber

Johannes Betz

Markus Lienkamp

ArXiv PDF HTML

Papers citing "A Deep Learning-based Radar and Camera Sensor Fusion Architecture for Object Detection"

50 / 70 papers shown

Title
Enhanced Cooperative Perception Through Asynchronous Vehicle to Infrastructure Framework with Delay Mitigation for Connected and Automated Vehicles Nithish Kumar Saravanan V. Jammula Yezhou Yang J. Wishart Junfeng Zhao 36 0 0 10 Apr 2025
SpaRC: Sparse Radar-Camera Fusion for 3D Object Detection Philipp Wolters Johannes Gilg Torben Teepe Fabian Herzog Felix Fent Gerhard Rigoll 83 0 0 29 Nov 2024
A Resource Efficient Fusion Network for Object Detection in Bird's-Eye View using Camera and Raw Radar Data Kavin Chandrasekaran Sorin Grigorescu Gijs Dubbelman P. Jancura 86 0 0 20 Nov 2024
Semantic-Aware Representation of Multi-Modal Data for Data Ingress: A Literature Review Pierre Lamart Yinan Yu Christian Berger 41 0 0 17 Jul 2024
CaFNet: A Confidence-Driven Framework for Radar Camera Depth Estimation Huawei Sun Hao Feng Julius Ott Lorenzo Servadei Robert Wille 27 5 0 30 Jun 2024
A Survey of Deep Learning Based Radar and Vision Fusion for 3D Object Detection in Autonomous Driving Di Wu Feng Yang Benlian Xu Pan Liao Bo Liu 51 0 0 02 Jun 2024
Cross-Domain Spatial Matching for Camera and Radar Sensor Data Fusion in Autonomous Vehicle Perception System Daniel Dworak M. Komorkiewicz P. Skruch Jerzy Baranowski 33 1 0 25 Apr 2024
Enhanced Radar Perception via Multi-Task Learning: Towards Refined Data for Sensor Fusion Applications Huawei Sun Hao Feng Gianfranco Mauro Julius Ott Georg Stettinger Lorenzo Servadei Robert Wille MDE 23 4 0 09 Apr 2024
DPFT: Dual Perspective Fusion Transformer for Camera-Radar-based Object Detection F. Fent Andras Palffy Holger Caesar 49 13 0 03 Apr 2024
Depth Estimation fusing Image and Radar Measurements with Uncertain Directions Masaya Kotani Takeru Oba Norimichi Ukita MDE 16 0 0 23 Mar 2024
CR3DT: Camera-RADAR Fusion for 3D Detection and Tracking Nicolas Baumann Michael Baumgartner Edoardo Ghignone Jonas Kühne Tobias Fischer Yung-Hsu Yang Marc Pollefeys Michele Magno 26 9 0 22 Mar 2024
Achelous++: Power-Oriented Water-Surface Panoptic Perception Framework on Edge Devices based on Vision-Radar Fusion and Pruning of Heterogeneous Modalities Runwei Guan Haocheng Zhao Shanliang Yao Ka Lok Man Xiaohui Zhu ... Yong Yue Jeremy S. Smith Eng Gee Lim Weiping Ding Yutao Yue 23 4 0 14 Dec 2023
Exploring Radar Data Representations in Autonomous Driving: A Comprehensive Review Shanliang Yao Runwei Guan Zitian Peng Chenhang Xu Yilu Shi ... Hyungjoon Seo Ka Lok Man Jieming Ma Xiaohui Zhu Yutao Yue 52 5 0 08 Dec 2023
Multi-Modal Sensor Fusion and Object Tracking for Autonomous Racing Phillip Karle F. Fent Sebastian Huch Florian Sauerbeck Markus Lienkamp 27 31 0 12 Oct 2023
Assessing the Robustness of LiDAR, Radar and Depth Cameras Against Ill-Reflecting Surfaces in Autonomous Vehicles: An Experimental Study Michael Loetscher Nicolas Baumann Edoardo Ghignone Andrea Ronco Michele Magno 26 2 0 19 Sep 2023
ClusterFusion: Leveraging Radar Spatial Features for Radar-Camera 3D Object Detection in Autonomous Vehicles Irfan Tito Kurniawan B. Trilaksono 35 6 0 07 Sep 2023
ASY-VRNet: Waterway Panoptic Driving Perception Model based on Asymmetric Fair Fusion of Vision and 4D mmWave Radar Runwei Guan Shanliang Yao Xiaohui Zhu Ka Lok Man Yong Yue Jeremy S. Smith Eng Gee Lim Yutao Yue 35 9 0 20 Aug 2023
Echoes Beyond Points: Unleashing the Power of Raw Radar Data in Multi-modality Fusion Yang Liu Feng Wang Nai-long Wang Zhaoxiang Zhang 33 14 0 31 Jul 2023
Multi-Task Cross-Modality Attention-Fusion for 2D Object Detection Huawei Sun Hao Feng Georg Stettinger Lorenzo Servadei Robert Wille 17 7 0 17 Jul 2023
Real-time Human Detection in Fire Scenarios using Infrared and Thermal Imaging Fusion Truong-Dong Do Nghe-Nhan Truong M. Le 17 2 0 09 Jul 2023
Robust Human Detection under Visual Degradation via Thermal and mmWave Radar Fusion Kaiwen Cai Qiyue Xia Peize Li John A. Stankovic Chris Xiaoxuan Lu 8 2 0 07 Jul 2023
Milestones in Autonomous Driving and Intelligent Vehicles Part II: Perception and Planning Long Chen Siyu Teng Bai Li X. Na Yuchen Li Zixuan Li Jinjun Wang Dongpu Cao N. Zheng Fei-Yue Wang 36 42 0 03 Jun 2023
Radar Enlighten the Dark: Enhancing Low-Visibility Perception for Automated Vehicles with Camera-Radar Fusion Can Cui Yunsheng Ma Juanwu Lu Ziran Wang 22 8 0 27 May 2023
RC-BEVFusion: A Plug-In Module for Radar-Camera Bird's Eye View Feature Fusion Lukas Stäcker Shashank Mishra Philipp Heidenreich J. Rambach D. Stricker 30 4 0 25 May 2023
DeepSTEP -- Deep Learning-Based Spatio-Temporal End-To-End Perception for Autonomous Vehicles Sebastian Huch Florian Sauerbeck Johannes Betz 35 3 0 11 May 2023
A New Wave in Robotics: Survey on Recent mmWave Radar Applications in Robotics Kyle Harlow Hyesu Jang T. Barfoot Ayoung Kim Christoffer Heckman 56 39 0 02 May 2023
Radar-Camera Fusion for Object Detection and Semantic Segmentation in Autonomous Driving: A Comprehensive Review Shanliang Yao Runwei Guan Xiaoyu Huang Zhuoxiao Li Xiangyu Sha ... Eng Gee Lim H. Seo Ka Lok Man Xiaohui Zhu Yutao Yue 41 91 0 20 Apr 2023
Camera-Radar Perception for Autonomous Vehicles and ADAS: Concepts, Datasets and Metrics F. M. Barbosa Fernando Santos Osório 16 6 0 08 Mar 2023
MVFusion: Multi-View 3D Object Detection with Semantic-aligned Radar and Camera Fusion Zizhang Wu Gui Chen Yuanzhu Gan Lei Wang Jian Pu 46 32 0 21 Feb 2023
Automotive RADAR sub-sampling via object detection networks: Leveraging prior signal information M. Sakthi Ahmed H. Tewfik Marius Arvinte H. Vikalo 11 4 0 21 Feb 2023
Vision-RADAR fusion for Robotics BEV Detections: A Survey Apoorv Singh 26 21 0 13 Feb 2023
Bridging the View Disparity Between Radar and Camera Features for Multi-modal Fusion 3D Object Detection Taohua Zhou Yining Shi Junjie Chen Kun Jiang Mengmeng Yang Diange Yang 18 77 0 25 Aug 2022
A Survey and Framework of Cooperative Perception: From Heterogeneous Singleton to Hierarchical Cooperation Zhengwei Bai Guoyuan Wu Matthew J. Barth Yongkang Liu E. A. Sisbot K. Oguchi Zhitong Huang 26 22 0 22 Aug 2022
RadSegNet: A Reliable Approach to Radar Camera Fusion Kshitiz Bansal Keshav Rungta Dinesh Bharadia 16 19 0 08 Aug 2022
Boosting Single-Frame 3D Object Detection by Simulating Multi-Frame Point Clouds Wu Zheng Li Jiang Fanbin Lu Yangyang Ye Chi-Wing Fu 3DPC ObjD 32 9 0 03 Jul 2022
HRFuser: A Multi-resolution Sensor Fusion Architecture for 2D Object Detection Tim Broedermann Christos Sakaridis Dengxin Dai Luc Van Gool 52 31 0 30 Jun 2022
Boosting 3D Object Detection by Simulating Multimodality on Point Clouds Wu Zheng Ming-Hong Hong Li Jiang Chi-Wing Fu 3DPC 34 31 0 30 Jun 2022
BEVFusion: A Simple and Robust LiDAR-Camera Fusion Framework Tingting Liang Hongwei Xie Kaicheng Yu Zhongyu Xia Zhiwei Lin Yongtao Wang T. Tang Bing Wang Zhi Tang 3DPC 24 398 0 27 May 2022
Robust Perception Architecture Design for Automotive Cyber-Physical Systems Joydeep Dey S. Pasricha 3DV 41 7 0 17 May 2022
FUTR3D: A Unified Sensor Fusion Framework for 3D Detection Xuanyao Chen Tianyuan Zhang Yue Wang Yilun Wang Hang Zhao 3DPC 33 233 0 20 Mar 2022
End-to-end system for object detection from sub-sampled radar data M. Sakthi Ahmed H. Tewfik Marius Arvinte H. Vikalo 26 1 0 08 Mar 2022
Object Detection in Autonomous Vehicles: Status and Open Challenges Abhishek Balasubramaniam S. Pasricha 47 54 0 19 Jan 2022
HydraFusion: Context-Aware Selective Sensor Fusion for Robust and Efficient Autonomous Vehicle Perception Arnav V. Malawade Trier Mortlock Mohammad Abdullah Al Faruque 27 32 0 17 Jan 2022
MilliTRACE-IR: Contact Tracing and Temperature Screening via mm-Wave and Infrared Sensing Marco Canil Jacopo Pegoraro Michele Rossi 11 12 0 08 Oct 2021
Fail-Safe Human Detection for Drones Using a Multi-Modal Curriculum Learning Approach A. Safa Tim Verbelen I. Ocket A. Bourdoux F. Catthoor Georges G. E. Gielen 24 14 0 28 Sep 2021
RVMDE: Radar Validated Monocular Depth Estimation for Robotics Muhamamd Ishfaq Hussain M. Rafique M. Jeon MDE 31 11 0 11 Sep 2021
RiWNet: A moving object instance segmentation Network being Robust in adverse Weather conditions Chenjie Wang Chengyuan Li B. Luo Wei Wang Jun Liu 22 5 0 04 Sep 2021
Full-Velocity Radar Returns by Radar-Camera Fusion Yunfei Long Daniel Morris Xiaoming Liu Marcos Castro Punarjay Chakravarty P. Narayanan 19 23 0 24 Aug 2021
R4Dyn: Exploring Radar for Self-Supervised Monocular Depth Estimation of Dynamic Scenes Stefano Gasperini P. Koch Vinzenz Dallabetta Nassir Navab Benjamin Busam Federico Tombari MDE 21 38 0 10 Aug 2021
MmWave Radar and Vision Fusion for Object Detection in Autonomous Driving: A Review Zhiqing Wei Fengkai Zhang Shuo Chang Yangyang Liu Huici Wu Z. Feng 33 137 0 06 Aug 2021