Deep Multi-modal Object Detection and Semantic Segmentation for Autonomous Driving: Datasets, Methods, and Challenges

21 February 2019

Di Feng

Christian Haase-Schuetz

Klaus C. J. Dietmayer

3DPC

ArXiv PDF HTML

Papers citing "Deep Multi-modal Object Detection and Semantic Segmentation for Autonomous Driving: Datasets, Methods, and Challenges"

50 / 97 papers shown

Title
A multi-scale vision transformer-based multimodal GeoAI model for mapping Arctic permafrost thaw Wenwen Li Chia-Yu Hsu Sizhe Wang Zhining Gu Yili Yang Brendan M. Rogers A. Liljedahl 61 0 0 23 Apr 2025
MS-Occ: Multi-Stage LiDAR-Camera Fusion for 3D Semantic Occupancy Prediction Zhiqiang Wei Lianqing Zheng J. Liu Tao Huang Qing-Long Han Wenwen Zhang Fengdeng Zhang 27 0 0 22 Apr 2025
Benchmarking Multi-modal Semantic Segmentation under Sensor Failures: Missing and Noisy Modality Robustness Chenfei Liao Kaiyu Lei Xu Zheng Junha Moon Zhixiong Wang Y. Wang Danda Pani Paudel Luc Van Gool Xuming Hu VLM 68 2 0 24 Mar 2025
AnywhereDoor: Multi-Target Backdoor Attacks on Object Detection Jialin Lu Junjie Shan Ziqi Zhao Ka-Ho Chow AAML 53 0 0 09 Mar 2025
Optimizing Estimators of Squared Calibration Errors in Classification Sebastian G. Gruber Francis Bach 71 1 0 24 Feb 2025
A Multimodal PDE Foundation Model for Prediction and Scientific Text Descriptions Elisa Negrini Yuxuan Liu Liu Yang Stanley Osher Hayden Schaeffer AI4CE 86 0 0 09 Feb 2025
Point2RBox-v2: Rethinking Point-supervised Oriented Object Detection with Spatial Layout Among Instances Yi Yu Botao Ren Peiyuan Zhang Mingxin Liu Junwei Luo Shaofeng Zhang Feipeng Da Junchi Yan Xue Yang 3DPC 125 1 0 06 Feb 2025
Static Segmentation by Tracking: A Frustratingly Label-Efficient Approach to Fine-Grained Segmentation Zhenyang Feng Zihe Wang Saul Ibaven Bueno Tomasz Frelek Advikaa Ramesh ... Hilmar Lapp Charles V. Stewart T. Berger-Wolf Yu-Chuan Su Wei-Lun Chao 48 0 0 12 Jan 2025
Multi-Scale Grouped Prototypes for Interpretable Semantic Segmentation Hugo Porta Emanuele Dalsasso Diego Marcos D. Tuia 93 0 0 14 Sep 2024
A Generative Adversarial Network-based Method for LiDAR-Assisted Radar Image Enhancement Thakshila Thilakanayake Oscar De Silva Thumeera R. Wanasinghe George K. Mann Awantha Jayasiri GAN 35 1 0 30 Aug 2024
Learning Autonomous Race Driving with Action Mapping Reinforcement Learning Yuanda Wang Xin Yuan Changyin Sun 34 1 0 21 Jun 2024
Explainable AI (XAI) in Image Segmentation in Medicine, Industry, and Beyond: A Survey Rokas Gipiškis Chun-Wei Tsai Olga Kurasova 56 5 0 02 May 2024
BoostRad: Enhancing Object Detection by Boosting Radar Reflections Yuval Haitman Oded Bialer 19 3 0 27 Apr 2024
CLIP-GS: CLIP-Informed Gaussian Splatting for Real-time and View-consistent 3D Semantic Understanding Guibiao Liao Jiankun Li Zhenyu Bao Xiaoqing Ye Jingdong Wang Qing Li Kanglin Liu 3DGS 40 14 0 22 Apr 2024
Image-Text Co-Decomposition for Text-Supervised Semantic Segmentation Ji-Jia Wu Andy Chia-Hao Chang Chieh-Yu Chuang Chun-Pei Chen Yu-Lun Liu Min-Hung Chen Hou-Ning Hu Yung-Yu Chuang Yen-Yu Lin VLM 40 9 0 05 Apr 2024
Exploring Radar Data Representations in Autonomous Driving: A Comprehensive Review Shanliang Yao Runwei Guan Zitian Peng Chenhang Xu Yilu Shi ... Hyungjoon Seo Ka Lok Man Jieming Ma Xiaohui Zhu Yutao Yue 46 5 0 08 Dec 2023
GP-NeRF: Generalized Perception NeRF for Context-Aware 3D Scene Understanding Hao Li Dingwen Zhang Yalun Dai Nian Liu Lechao Cheng Jingfeng Li Jingdong Wang Junwei Han 23 13 0 20 Nov 2023
LeTFuser: Light-weight End-to-end Transformer-Based Sensor Fusion for Autonomous Driving with Multi-Task Learning Pedram Agand Mohammad Mahdavian Manolis Savva Mo Chen ViT 21 4 0 19 Oct 2023
Robust Navigation with Cross-Modal Fusion and Knowledge Transfer Wenzhe Cai Guangran Cheng Lingyue Kong Lu Dong Changyin Sun 26 1 0 23 Sep 2023
OccluTrack: Rethinking Awareness of Occlusion for Enhancing Multiple Pedestrian Tracking Jianjun Gao Yi Wang Kim-Hui Yap Kratika Garg Bo Han 84 1 0 19 Sep 2023
Interpretation on Multi-modal Visual Fusion Hao Chen Hao Zhou Yongjian Deng 28 0 0 19 Aug 2023
Q-YOLO: Efficient Inference for Real-time Object Detection Mingze Wang H. Sun Jun Shi Xuhui Liu Baochang Zhang Xianbin Cao ObjD 28 8 0 01 Jul 2023
MILD: Modeling the Instance Learning Dynamics for Learning with Noisy Labels Chuanyan Hu Shipeng Yan Zhitong Gao Xuming He NoLa 19 4 0 20 Jun 2023
Radar-Camera Fusion for Object Detection and Semantic Segmentation in Autonomous Driving: A Comprehensive Review Shanliang Yao Runwei Guan Xiaoyu Huang Zhuoxiao Li Xiangyu Sha ... Eng Gee Lim H. Seo Ka Lok Man Xiaohui Zhu Yutao Yue 41 91 0 20 Apr 2023
DiGA: Distil to Generalize and then Adapt for Domain Adaptive Semantic Segmentation Fengyi Shen A. Gurram Ziyuan Liu He Wang Alois Knoll 24 26 0 05 Apr 2023
Milestones in Autonomous Driving and Intelligent Vehicles: Survey of Surveys Long Chen Yuchen Li Chao Huang Bai Li Yang Xing ... Chen Lv Jinjun Wang Dongpu Cao N. Zheng Feiyue Wang 43 297 0 30 Mar 2023
Semantic Ray: Learning a Generalizable Semantic Field with Cross-Reprojection Attention F. Liu Chubing Zhang Yu Zheng Yueqi Duan 26 27 0 23 Mar 2023
CAFS: Class Adaptive Framework for Semi-Supervised Semantic Segmentation Jingi Ju Hyeoncheol Noh Yooseung Wang Min-seok Seo Dong-Geol Choi 26 4 0 21 Mar 2023
MECPformer: Multi-estimations Complementary Patch with CNN-Transformers for Weakly Supervised Semantic Segmentation Chunmeng Liu Guang-pu Li Yao Shen Ruiqi Wang ViT 27 7 0 19 Mar 2023
MASS: Mobility-Aware Sensor Scheduling of Cooperative Perception for Connected Automated Driving Yukuan Jia Ruiqing Mao Yuxuan Sun Sheng Zhou Z. Niu 16 15 0 25 Feb 2023
DRL-VO: Learning to Navigate Through Crowded Dynamic Scenes Using Velocity Obstacles Zhanteng Xie P. Dames 38 61 0 16 Jan 2023
Collaborative Perception in Autonomous Driving: Methods, Datasets and Challenges Yushan Han Hui Zhang Huifang Li Yi Jin Congyan Lang Yidong Li 34 100 0 16 Jan 2023
X-MAS: Extremely Large-Scale Multi-Modal Sensor Dataset for Outdoor Surveillance in Real Environments Dong-Ki Noh Chan-Yong Sung Teayoung Uhm Wooju Lee Hyungtae Lim ... Ho-Yong Shin MinJung Kim Hyoung-Rock Kim Seung-Ming Baek Hyun Myung 25 5 0 30 Dec 2022
DExT: Detector Explanation Toolkit Deepan Padmanabhan Paul G. Plöger Octavio Arriaga Matias Valdenegro-Toro 28 2 0 21 Dec 2022
Learning Robotic Navigation from Experience: Principles, Methods, and Recent Results Sergey Levine Dhruv Shah SSL 24 21 0 13 Dec 2022
Object-fabrication Targeted Attack for Object Detection Xuchong Zhang Changfeng Sun Haoliang Han Hang Wang Hongbin Sun Nanning Zheng AAML 14 0 0 13 Dec 2022
Vision Transformer Computation and Resilience for Dynamic Inference Kavya Sreedhar Jason Clemons Rangharajan Venkatesan S. Keckler M. Horowitz 24 2 0 06 Dec 2022
Handling Image and Label Resolution Mismatch in Remote Sensing Scott Workman Armin Hadzic M. U. Rafique 30 5 0 28 Nov 2022
Harmonizing output imbalance for defect segmentation on extremely-imbalanced photovoltaic module cells images Jianye Yi Xiaopin Zhong Weixiang Liu Zongze Wu Yuanlong Deng Zhengguang Wu 27 0 0 10 Nov 2022
MMRNet: Improving Reliability for Multimodal Object Detection and Segmentation for Bin Picking via Multimodal Redundancy Yuhao Chen Hayden Gunraj E. Z. Zeng Robbie Meyer Maximilian Gilles Alexander Wong 31 1 0 19 Oct 2022
Emerging Threats in Deep Learning-Based Autonomous Driving: A Comprehensive Survey Huiyun Cao Wenlong Zou Yinkun Wang Ting Song Mengjun Liu AAML 44 4 0 19 Oct 2022
Dual-Curriculum Teacher for Domain-Inconsistent Object Detection in Autonomous Driving L. Yu Yifan Zhang Lanqing Hong Fei Chen Zhenguo Li 35 3 0 17 Oct 2022
Learning Across Domains and Devices: Style-Driven Source-Free Domain Adaptation in Clustered Federated Learning Donald Shenaj Eros Fani Marco Toldo Debora Caldarola A. Tavera Umberto Michieli Marco Ciccone Pietro Zanuttigh Barbara Caputo FedML 26 39 0 05 Oct 2022
MLink: Linking Black-Box Models from Multiple Domains for Collaborative Inference Mu Yuan Lan Zhang Zimu Zheng Yi-Nan Zhang Xiang-Yang Li 17 2 0 28 Sep 2022
Uncertainty-aware Perception Models for Off-road Autonomous Unmanned Ground Vehicles Zhaoyuan Yang Y. Tan Shiraj Sen Johan Reimann John N. Karigiannis Mohammed A. Yousefhussien Nurali Virani 22 4 0 22 Sep 2022
Accurate Cooperative Sensor Fusion by Parameterized Covariance Generation for Sensing and Localization Pipelines in CAVs Edward Andert Aviral Shrivastava 11 7 0 07 Sep 2022
Dispersed Pixel Perturbation-based Imperceptible Backdoor Trigger for Image Classifier Models Yulong Wang Minghui Zhao Shenghong Li Xinnan Yuan W. Ni 18 15 0 19 Aug 2022
CENet: Toward Concise and Efficient LiDAR Semantic Segmentation for Autonomous Driving Huimin Cheng Xian-Feng Han Guoqiang Xiao 3DPC 3DV 30 63 0 26 Jul 2022
DeepIPC: Deeply Integrated Perception and Control for an Autonomous Vehicle in Real Environments Oskar Natan J. Miura 26 1 0 20 Jul 2022
YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors Chien-Yao Wang Alexey Bochkovskiy H. Liao ObjD 27 6,234 0 06 Jul 2022