Choosing Smartly: Adaptive Multimodal Fusion for Object Detection in Changing Environments

18 July 2017

Wolfram Burgard

Papers citing "Choosing Smartly: Adaptive Multimodal Fusion for Object Detection in Changing Environments"

43 / 43 papers shown

Title
TACOcc:Target-Adaptive Cross-Modal Fusion with Volume Rendering for 3D Semantic Occupancy Luyao Lei Shuo Xu Yifan Bai Xing Wei 19 0 0 19 May 2025
Evaluation Framework for Sensor Configuration Impact on Deep Learning-Based Perception A Gamage V Donzella 44 0 0 07 Mar 2025
Efficient Diffusion Transformer Policies with Mixture of Expert Denoisers for Multitask Learning Moritz Reuss Jyothish Pari Pulkit Agrawal Rudolf Lioutikov DiffM MoE 84 6 0 17 Dec 2024
Cocoon: Robust Multi-Modal Perception with Uncertainty-Aware Sensor Fusion Minkyoung Cho Yulong Cao Jiachen Sun Qingzhao Zhang Marco Pavone Jeong Joon Park Heng Yang Z. Morley Mao 44 0 0 16 Oct 2024
The Ingredients for Robotic Diffusion Transformers Sudeep Dasari Oier Mees Sebastian Zhao Mohan Kumar Srirama Sergey Levine 59 20 0 14 Oct 2024
When Pedestrian Detection Meets Multi-Modal Learning: Generalist Model and Benchmark Dataset Yi Zhang Wang Zeng Sheng Jin Chao Qian Ping Luo Wentao Liu 34 4 0 14 Jul 2024
LDTrack: Dynamic People Tracking by Service Robots using Diffusion Models Angus Fung B. Benhabib G. Nejat 34 4 0 13 Feb 2024
Exploring Model Learning Heterogeneity for Boosting Ensemble Robustness Yanzhao Wu Ka-Ho Chow Wenqi Wei Ling Liu FedML AAML UQCV 34 8 0 03 Oct 2023
Uncertainty-Encoded Multi-Modal Fusion for Robust Object Detection in Autonomous Driving Yang Lou Qun Song Qian Xu Rui Tan Jianping Wang 27 1 0 30 Jul 2023
Informative Data Selection with Uncertainty for Multi-modal Object Detection Jiahui Geng Zhiwei Li Zhenhong Zou Xinchen Gao Yijin Xiong Dafeng Jin Jun Li Huaping Liu 35 5 0 23 Apr 2023
Camera-Radar Perception for Autonomous Vehicles and ADAS: Concepts, Datasets and Metrics F. M. Barbosa Fernando Santos Osório 24 6 0 08 Mar 2023
Detecting Humans in RGB-D Data with CNNs Kaiyang Zhou A. Paiement Majid Mirmehdi 3DH 14 22 0 17 Jul 2022
Defending Multimodal Fusion Models against Single-Source Adversaries Karren D. Yang Wan-Yi Lin M. Barman Filipe Condessa Zico Kolter AAML 21 30 0 25 Jun 2022
TransFuser: Imitation with Transformer-Based Sensor Fusion for Autonomous Driving Kashyap Chitta Aditya Prakash Bernhard Jaeger Zehao Yu Katrin Renz Andreas Geiger ViT 104 298 0 31 May 2022
Pay "Attention" to Adverse Weather: Weather-aware Attention-based Object Detection Saket S. Chaturvedi Lan Zhang Xiaoyong Yuan 19 17 0 22 Apr 2022
DBF: Dynamic Belief Fusion for Combining Multiple Object Detectors Hyungtae Lee H. Kwon FedML 27 18 0 06 Apr 2022
Training-Free Robust Multimodal Learning via Sample-Wise Jacobian Regularization Zhengqi Gao Sucheng Ren Zihui Xue Siting Li Hang Zhao 24 3 0 05 Apr 2022
An Unsupervised Domain Adaptive Approach for Multimodal 2D Object Detection in Adverse Weather Conditions George Eskandar Robert A. Marsden Pavithran Pandiyan Mario Döbler Karim Guirguis B. Yang 28 7 0 07 Mar 2022
Robots Autonomously Detecting People: A Multimodal Deep Contrastive Learning Method Robust to Intraclass Variations Angus Fung B. Benhabib G. Nejat 19 12 0 01 Mar 2022
TinyM $^2$ Net: A Flexible System Algorithm Co-designed Multimodal Learning Framework for Tiny Devices Hasib-Al Rashid Pretom Roy Ovi Carl E. Busart A. Gangopadhyay T. Mohsenin 24 11 0 09 Feb 2022
CALVIN: A Benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Tasks Oier Mees Lukás Hermann Erick Rosete-Beas Wolfram Burgard LM&Ro 36 243 0 06 Dec 2021
Predicting the Future from First Person (Egocentric) Vision: A Survey Ivan Rodin Antonino Furnari Dimitrios Mavroeidis G. Farinella EgoV 29 42 0 28 Jul 2021
Improving Multi-Modal Learning with Uni-Modal Teachers Chenzhuang Du Tingle Li Yichen Liu Zixin Wen Tianyu Hua Yue Wang Hang Zhao 31 45 0 21 Jun 2021
AI perspectives in Smart Cities and Communities to enable road vehicle automation and smart traffic control Cristofer Englund E. Aksoy F. Alonso-Fernandez Martin Cooney Sepideh Pashami B. Åstrand 22 40 0 07 Apr 2021
Autonomous Navigation with Mobile Robots using Deep Learning and the Robot Operating System A. Nguyen Quang-Dieu Tran 22 9 0 04 Dec 2020
Modality-Buffet for Real-Time Object Detection Nicolai Dorka Johannes Meyer Wolfram Burgard ObjD OffRL 27 3 0 17 Nov 2020
An Improved Attention for Visual Question Answering Tanzila Rahman Shih-Han Chou Leonid Sigal Giuseppe Carenini 13 42 0 04 Nov 2020
Multi-modal Experts Network for Autonomous Driving Shihong Fang A. Choromańska MoE 28 5 0 18 Sep 2020
Autonomous Navigation in Complex Environments with Deep Multimodal Fusion Network A. Nguyen Ngoc Son Nguyen K. Tran Erman Tjiputra Quang-Dieu Tran 20 39 0 31 Jul 2020
Rolling-Unrolling LSTMs for Action Anticipation from First-Person Video Antonino Furnari G. Farinella EgoV 24 139 0 04 May 2020
VMLoc: Variational Fusion For Learning-Based Multimodal Camera Localization Kaichen Zhou Changhao Chen Bing Wang Muhamad Risqi U. Saputra Niki Trigoni Andrew Markham 13 20 0 12 Mar 2020
Input Dropout for Spatially Aligned Modalities Sébastien de Blois Mathieu Garon Christian Gagné Jean-François Lalonde 15 7 0 07 Feb 2020
UNO: Uncertainty-aware Noisy-Or Multimodal Fusion for Unanticipated Input Degradation Junjiao Tian W. Cheung Nathan Glaser Yen-Cheng Liu Z. Kira 19 26 0 06 Nov 2019
On Single Source Robustness in Deep Fusion Models Taewan Kim Joydeep Ghosh AAML 19 22 0 11 Jun 2019
What Would You Expect? Anticipating Egocentric Actions with Rolling-Unrolling LSTMs and Modality Attention Antonino Furnari G. Farinella EgoV 27 171 0 22 May 2019
Learning the Depths of Moving People by Watching Frozen People Zhengqi Li Tali Dekel Forrester Cole Richard Tucker Noah Snavely Ce Liu William T. Freeman MDE 3DH 34 242 0 25 Apr 2019
Seeing Through Fog Without Seeing Fog: Deep Multimodal Sensor Fusion in Unseen Adverse Weather Mario Bijelic Tobias Gruber Fahim Mannan Florian Kraus W. Ritter Klaus C. J. Dietmayer Felix Heide 19 37 0 24 Feb 2019
Deep Multi-modal Object Detection and Semantic Segmentation for Autonomous Driving: Datasets, Methods, and Challenges Di Feng Christian Haase-Schuetz Lars Rosenbaum Heinz Hertlein Claudius Gläser Fabian Duffhauss W. Wiesbeck Klaus C. J. Dietmayer 3DPC 41 989 0 21 Feb 2019
Robust Deep Multi-Modal Sensor Fusion using Fusion Weight Regularization and Target Learning Myung Seok Shim Chenye Zhao Yong Li Xuchong Zhang Wenrui Zhang Peng Li OOD AAML 22 0 0 29 Jan 2019
Modular Sensor Fusion for Semantic Segmentation Hermann Blum Abel Gawel Roland Siegwart Cesar Cadena 28 14 0 30 Jul 2018
Optimal Sensor Data Fusion Architecture for Object Detection in Adverse Weather Conditions Andreas Pfeuffer Klaus C. J. Dietmayer 20 46 0 06 Jul 2018
3D Human Pose Estimation in RGBD Images for Robotic Task Learning Christiane Zimmermann Tim Welschehold C. Dornhege Wolfram Burgard Thomas Brox 3DH 17 151 0 07 Mar 2018
Deep Detection of People and their Mobility Aids for a Hospital Robot Andres Vasquez Marina Kollmitz Andreas Eitel Wolfram Burgard 19 35 0 02 Aug 2017