Delivering Arbitrary-Modal Semantic Segmentation

2 March 2023

Kailun Yang

Kaiwei Wang

Papers citing "Delivering Arbitrary-Modal Semantic Segmentation"

50 / 59 papers shown

Title
Reducing Unimodal Bias in Multi-Modal Semantic Segmentation with Multi-Scale Functional Entropy Regularization Xu Zheng Yuanhuiyi Lyu Lutao Jiang Danda Pani Paudel Luc Van Gool Xuming Hu 29 0 0 10 May 2025
Segment Any RGB-Thermal Model with Language-aided Distillation Dong Xing Xianxun Zhu Wei Zhou Qika Lin Hang Yang Yuqing Wang VLM 61 0 0 04 May 2025
Rethinking RGB-Event Semantic Segmentation with a Novel Bidirectional Motion-enhanced Event Representation Zhen Yao Xiaowen Ying Mooi Choo Choo Chuah 35 0 0 02 May 2025
HDBFormer: Efficient RGB-D Semantic Segmentation with A Heterogeneous Dual-Branch Framework Shuobin Wei Zhuang Zhou Zhengan Lu Zizhao Yuan Binghua Su MDE 44 0 0 18 Apr 2025
DFormerv2: Geometry Self-Attention for RGBD Semantic Segmentation Bo Yin Jiao-Long Cao Ming-Ming Cheng Qibin Hou 3DPC MDE 48 0 0 07 Apr 2025
Hyperdimensional Uncertainty Quantification for Multimodal Uncertainty Fusion in Autonomous Vehicles Perception Luke Chen Junyao Wang Trier Mortlock Pramod P. Khargonekar M. A. Al Faruque UQCV 65 0 0 25 Mar 2025
Benchmarking Multi-modal Semantic Segmentation under Sensor Failures: Missing and Noisy Modality Robustness Chenfei Liao Kaiyu Lei Xu Zheng Junha Moon Zhixiong Wang Y. Wang Danda Pani Paudel Luc Van Gool Xuming Hu VLM 68 3 0 24 Mar 2025
BFANet: Revisiting 3D Semantic Segmentation with Boundary Feature Analysis Weiguang Zhao Rui Zhang Qiufeng Wang Guangliang Cheng K. Huang 56 1 0 16 Mar 2025
MemorySAM: Memorize Modalities and Semantics with Segment Anything Model 2 for Multi-modal Semantic Segmentation Chenfei Liao Xu Zheng Yuanhuiyi Lyu Haiwei Xue Yihong Cao Jiawen Wang Kailun Yang Xuming Hu VLM 63 4 0 09 Mar 2025
MASTER: Multimodal Segmentation with Text Prompts Fuyang Liu Shun Lu Jilin Mei Yu Hu 56 0 0 06 Mar 2025
Unveiling the Potential of Segment Anything Model 2 for RGB-Thermal Semantic Segmentation with Language Guidance Jiayi Zhao Fei Teng Kai Luo Guoqiang Zhao Z. Li Xu Zheng Kailun Yang VLM 79 4 0 04 Mar 2025
Unifying Light Field Perception with Field of Parallax Fei Teng Buyin Deng Boyuan Zheng Kai Luo Kunyu Peng Jiaming Zhang Kailun Yang 34 0 0 02 Mar 2025
Uncertainty-Participation Context Consistency Learning for Semi-supervised Semantic Segmentation Jianjian Yin Yi Chen Zhichao Zheng Junsheng Zhou Yanhui Gu 41 3 0 23 Dec 2024
MAGIC++: Efficient and Resilient Modality-Agnostic Semantic Segmentation via Hierarchical Modality Selection Xu Zheng Yuanhuiyi Lyu Lutao Jiang Jiazhou Zhou Lin Wang Xuming Hu 74 4 0 22 Dec 2024
Customize Segment Anything Model for Multi-Modal Semantic Segmentation with Mixture of LoRA Experts Chenyang Zhu Bin Xiao Lin Shi Shoukun Xu Xu Zheng MoE 91 9 0 05 Dec 2024
Benchmarking the Robustness of Optical Flow Estimation to Corruptions Zhonghua Yi Hao-miao Shi Qi Jiang Yao Gao Ze Wang Y. Zhang Kailun Yang Kaiwei Wang AAML 70 1 0 22 Nov 2024
Unsupervised Modality Adaptation with Text-to-Image Diffusion Models for Semantic Segmentation Ruihao Xia Yu Liang Peng-Tao Jiang H. Zhang Bo-wen Li Yang Tang Pan Zhou DiffM VLM 33 1 0 29 Oct 2024
Part-Whole Relational Fusion Towards Multi-Modal Scene Understanding Yi Liu Chengxin Li Shoukun Xu J. Han ViT 42 2 0 19 Oct 2024
Sitcom-Crafter: A Plot-Driven Human Motion Generation System in 3D Scenes Jianqi Chen Panwen Hu Xiaojun Chang Z. Shi Michael C. Kampffmeyer Xiaodan Liang 48 4 0 14 Oct 2024
SpecSAR-Former: A Lightweight Transformer-based Network for Global LULC Mapping Using Integrated Sentinel-1 and Sentinel-2 Hao Yu Gen Li Haoyu Liu Songyan Zhu Wenquan Dong Changjian Li 20 0 0 04 Oct 2024
Particle-based Instance-aware Semantic Occupancy Mapping in Dynamic Environments Gang Chen Zhaoying Wang Wei Dong Javier Alonso-Mora 114 0 0 18 Sep 2024
IVGF: The Fusion-Guided Infrared and Visible General Framework Fangcen Liu Chenqiang Gao Fang Chen Pengcheng Li Junjie Guo Deyu Meng 31 0 0 02 Sep 2024
Depth-guided Texture Diffusion for Image Semantic Segmentation Wei Sun Yuan Li Qixiang Ye Jianbin Jiao Yanzhao Zhou DiffM MDE 33 0 0 17 Aug 2024
RoadFormer+: Delivering RGB-X Scene Parsing through Scale-Aware Information Decoupling and Advanced Heterogeneous Feature Fusion Jianxin Huang Jiahang Li Ning Jia Yuxiang Sun Chengju Liu Qijun Chen Rui Fan ViT 51 8 0 31 Jul 2024
Learning Modality-agnostic Representation for Semantic Segmentation from Any Modalities Xueye Zheng Yuanhuiyi Lyu Lin Wang VLM 49 11 0 16 Jul 2024
Centering the Value of Every Modality: Towards Efficient and Resilient Modality-agnostic Semantic Segmentation Xueye Zheng Yuanhuiyi Lyu Jiazhou Zhou Lin Wang 27 7 0 16 Jul 2024
When Pedestrian Detection Meets Multi-Modal Learning: Generalist Model and Benchmark Dataset Yi Zhang Wang Zeng Sheng Jin Chao Qian Ping Luo Wentao Liu 34 4 0 14 Jul 2024
CaRe-Ego: Contact-aware Relationship Modeling for Egocentric Interactive Hand-object Segmentation Yuejiao Su Yi Wang Lap-Pui Chau 62 1 0 08 Jul 2024
GeminiFusion: Efficient Pixel-wise Multimodal Fusion for Vision Transformer Ding Jia Jianyuan Guo Kai Han Han Wu Chao Zhang Chang Xu Xinghao Chen ViT 42 15 0 03 Jun 2024
U3M: Unbiased Multiscale Modal Fusion Model for Multimodal Semantic Segmentation Bingyu Li Da Zhang Zhiyuan Zhao Junyu Gao Xuelong Li 30 5 0 24 May 2024
SDSTrack: Self-Distillation Symmetric Adapter Learning for Multi-Modal Visual Object Tracking Xiaojun Hou Jiazheng Xing Yijie Qian Yaowei Guo Shuo Xin ... Kai Tang Mengmeng Wang Zhengkai Jiang Liang Liu Yong-Jin Liu 30 22 0 24 Mar 2024
WaterVG: Waterway Visual Grounding based on Text-Guided Vision and mmWave Radar Runwei Guan Liye Jia Fengyufan Yang Shanliang Yao Erick Purwanto ... Eng Gee Lim Jeremy S. Smith Ka Lok Man Xuming Hu Yutao Yue 34 9 0 19 Mar 2024
CART: Caltech Aerial RGB-Thermal Dataset in the Wild Connor T. Lee Matthew O. Anderson Nikhil Raganathan Xingxing Zuo Kevin Do Georgia Gkioxari Soon-Jo Chung 40 7 0 13 Mar 2024
LIX: Implicitly Infusing Spatial Geometric Prior Knowledge into Visual Semantic Segmentation for Autonomous Driving Sicen Guo Zhiyuan Wu Qijun Chen Ioannis Pitas Rui Fan Rui Fan 37 1 0 13 Mar 2024
Learning Conditional Invariances through Non-Commutativity Abhra Chaudhuri Serban Georgescu Anjan Dutta 52 0 0 18 Feb 2024
Fourier Prompt Tuning for Modality-Incomplete Scene Segmentation Ruiping Liu Jiaming Zhang Kunyu Peng Yufan Chen Ke Cao Junwei Zheng M. Sarfraz Kailun Yang Rainer Stiefelhagen VLM 34 7 0 30 Jan 2024
LF Tracy: A Unified Single-Pipeline Approach for Salient Object Detection in Light Field Cameras Fei Teng Jiaming Zhang Jiawei Liu Kunyu Peng Xina Cheng Zhiyong Li Kailun Yang 30 1 0 30 Jan 2024
ShareCMP: Polarization-Aware RGB-P Semantic Segmentation Zhuoyan Liu Bo Wang Lizhi Wang Chenyu Mao Ye Li 25 1 0 06 Dec 2023
Exploring Multi-Modal Fusion for Image Manipulation Detection and Localization Konstantinos Triaridis Vasileios Mezaris 27 4 0 04 Dec 2023
Efficient Multimodal Semantic Segmentation via Dual-Prompt Learning Shaohua Dong Yunhe Feng Qing Yang Yan Huang Dongfang Liu Heng Fan VLM 38 18 0 01 Dec 2023
Single-Model and Any-Modality for Video Object Tracking Zongwei Wu Jilai Zheng Xiangxuan Ren Florin-Alexandru Vasluianu Chao Ma D. Paudel Luc Van Gool Radu Timofte 53 33 0 27 Nov 2023
PolyMaX: General Dense Prediction with Mask Transformer Xuan S. Yang Liangzhe Yuan Kimberly Wilber Astuti Sharma Xiuye Gu ... Stephanie Debats Huisheng Wang Hartwig Adam Mikhail Sirotenko Liang-Chieh Chen 28 14 0 09 Nov 2023
Robust Multimodal Learning with Missing Modalities via Parameter-Efficient Adaptation Md Kaykobad Reza Ashley Prater-Bennette M. Salman Asif 25 5 0 06 Oct 2023
DFormer: Rethinking RGBD Representation Learning for Semantic Segmentation Bo Yin Xuying Zhang Zhongyu Li Li Liu Ming-Ming Cheng Qibin Hou 24 43 0 18 Sep 2023
AmodalSynthDrive: A Synthetic Amodal Perception Dataset for Autonomous Driving Ahmed Rida Sekkat Rohit Mohan Oliver Sawade Elmar Matthes Abhinav Valada 35 9 0 12 Sep 2023
MMSFormer: Multimodal Transformer for Material and Semantic Segmentation Md Kaykobad Reza Ashley Prater-Bennette M. Salman Asif 25 11 0 07 Sep 2023
Single Frame Semantic Segmentation Using Multi-Modal Spherical Images Suresh Guttikonda J. Rambach ViT MDE 37 11 0 18 Aug 2023
CMDA: Cross-Modality Domain Adaptation for Nighttime Semantic Segmentation Ruihao Xia Chaoqiang Zhao Meng Zheng Ziyan Wu Qiyu Sun Yang Tang 36 29 0 29 Jul 2023
OAFuser: Towards Omni-Aperture Fusion for Light Field Semantic Segmentation Fei Teng Jiaming Zhang Kunyu Peng Yaonan Wang Rainer Stiefelhagen Kailun Yang 27 4 0 28 Jul 2023
Test-Time Adaptation for Nighttime Color-Thermal Semantic Segmentation Yexin Liu Weiming Zhang Guoyang Zhao Jinjing Zhu Athanasios V. Vasilakos Lin Wang TTA 16 3 0 10 Jul 2023