Centering the Value of Every Modality: Towards Efficient and Resilient Modality-agnostic Semantic Segmentation

16 July 2024

Lin Wang

Papers citing "Centering the Value of Every Modality: Towards Efficient and Resilient Modality-agnostic Semantic Segmentation"

45 / 45 papers shown

Title
Benchmarking Multi-modal Semantic Segmentation under Sensor Failures: Missing and Noisy Modality Robustness Chenfei Liao Kaiyu Lei Xu Zheng Junha Moon Zhixiong Wang Yansen Wang Danda Pani Paudel Luc Van Gool Xuming Hu VLM 103 8 0 24 Mar 2025
MemorySAM: Memorize Modalities and Semantics with Segment Anything Model 2 for Multi-modal Semantic Segmentation Chenfei Liao Xu Zheng Yuanhuiyi Lyu Haiwei Xue Yihong Cao Jiawen Wang Kailun Yang Xuming Hu VLM 103 9 0 09 Mar 2025
Sitcom-Crafter: A Plot-Driven Human Motion Generation System in 3D Scenes Jianqi Chen Panwen Hu Xiaojun Chang Z. Shi Michael C. Kampffmeyer Xiaodan Liang 108 10 0 14 Oct 2024
Semantics, Distortion, and Style Matter: Towards Source-free UDA for Panoramic Segmentation Xueye Zheng Pengyuan Zhou Athanasios V. Vasilakos Lin Wang 75 24 0 19 Mar 2024
Chasing Day and Night: Towards Robust and Efficient All-Day Object Detection Guided by an Event Camera Jiahang Cao Xueye Zheng Yuanhuiyi Lyu Jiaxu Wang Renjing Xu Lin Wang 58 17 0 17 Sep 2023
A Good Student is Cooperative and Reliable: CNN-Transformer Collaborative Learning for Semantic Segmentation Jinjing Zhu Yuan Luo Xueye Zheng Hao Wang Lin Wang 41 34 0 24 Jul 2023
MSeg3D: Multi-modal 3D Semantic Segmentation for Autonomous Driving Jiale Li Hang Dai Hao Han Yong Ding 3DPC 72 71 0 15 Mar 2023
Delivering Arbitrary-Modal Semantic Segmentation Jiaming Zhang R. Liu Haowen Shi Kailun Yang Simon Reiß Kunyu Peng Haodong Fu Kaiwei Wang Rainer Stiefelhagen VLM 86 95 0 02 Mar 2023
SegViT: Semantic Segmentation with Plain Vision Transformers Bowen Zhang Zhi Tian Quan Tang Xiangxiang Chu Xiaolin K. Wei Chunhua Shen Yifan Liu ViT 46 140 0 12 Oct 2022
CIR-Net: Cross-modality Interaction and Refinement for RGB-D Salient Object Detection Runmin Cong Qin Lin Chen Zhang Chongyi Li Xiaochun Cao Qingming Huang Yao-Min Zhao ObjD 54 126 0 06 Oct 2022
SPSN: Superpixel Prototype Sampling Network for RGB-D Salient Object Detection Minhyeok Lee Chaewon Park Suhwan Cho Sangyoun Lee 3DH 75 62 0 16 Jul 2022
Multimodal Token Fusion for Vision Transformers Yikai Wang Xinghao Chen Lele Cao Wen-bing Huang Gang Hua Yunhe Wang ViT 72 173 0 19 Apr 2022
TopFormer: Token Pyramid Transformer for Mobile Semantic Segmentation Wenqiang Zhang Zilong Huang Guozhong Luo Tao Chen Xinggang Wang Wenyu Liu Gang Yu Chunhua Shen ViT 82 205 0 12 Apr 2022
DeepFusion: Lidar-Camera Deep Fusion for Multi-Modal 3D Object Detection Yingwei Li Adams Wei Yu Tianjian Meng Benjamin Caine Jiquan Ngiam ... Yifeng Lu Denny Zhou Quoc V. Le Alan Yuille Mingxing Tan 3DPC 82 332 0 15 Mar 2022
CMX: Cross-Modal Fusion for RGB-X Semantic Segmentation with Transformers Jiaming Zhang Huayao Liu Kailun Yang Xinxin Hu Ruiping Liu Rainer Stiefelhagen ViT 74 322 0 09 Mar 2022
Multi-class Token Transformer for Weakly Supervised Semantic Segmentation Lian Xu Wanli Ouyang Bennamoun F. Boussaïd Dan Xu ViT 70 212 0 06 Mar 2022
CAVER: Cross-Modal View-Mixed Transformer for Bi-Modal Salient Object Detection Youwei Pang Xiaoqi Zhao Lihe Zhang Huchuan Lu 67 95 0 04 Dec 2021
Swin Transformer V2: Scaling Up Capacity and Resolution Ze Liu Han Hu Yutong Lin Zhuliang Yao Zhenda Xie ... Yue Cao Zheng Zhang Li Dong Furu Wei B. Guo ViT 203 1,801 0 18 Nov 2021
ShapeConv: Shape-aware Convolutional Layer for Indoor RGB-D Semantic Segmentation Jinming Cao Hanchao Leng Dani Lischinski Danny Cohen-Or Changhe Tu Yangyan Li SSeg MDE 3DV 95 132 0 24 Aug 2021
Evaluating the Robustness of Semantic Segmentation for Autonomous Driving against Real-World Adversarial Patch Attacks F. Nesti Giulio Rossolini Saasha Nair Alessandro Biondi Giorgio Buttazzo AAML 54 76 0 13 Aug 2021
Learning Deep Multimodal Feature Representation with Asymmetric Multi-layer Fusion Yikai Wang F. Sun Ming Lu Anbang Yao 71 47 0 11 Aug 2021
A Unified Efficient Pyramid Transformer for Semantic Segmentation Fangrui Zhu Yi Zhu Li Zhang Chongruo Wu Yanwei Fu Mu Li ViT 55 30 0 29 Jul 2021
PVT v2: Improved Baselines with Pyramid Vision Transformer Wenhai Wang Enze Xie Xiang Li Deng-Ping Fan Kaitao Song Ding Liang Tong Lu Ping Luo Ling Shao ViT AI4TS 87 1,652 0 25 Jun 2021
SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformers Enze Xie Wenhai Wang Zhiding Yu Anima Anandkumar J. Álvarez Ping Luo ViT 231 4,990 0 31 May 2021
Segmenter: Transformer for Semantic Segmentation Robin Strudel Ricardo Garcia Pinel Ivan Laptev Cordelia Schmid ViT 170 1,460 0 12 May 2021
Multi-Modal Fusion Transformer for End-to-End Autonomous Driving Aditya Prakash Kashyap Chitta Andreas Geiger ViT 103 523 0 19 Apr 2021
InverseForm: A Loss Function for Structured Boundary-Aware Segmentation Shubhankar Borse Ying Wang Yizhe Zhang Fatih Porikli 50 114 0 06 Apr 2021
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows Ze Liu Yutong Lin Yue Cao Han Hu Yixuan Wei Zheng Zhang Stephen Lin B. Guo ViT 398 21,281 0 25 Mar 2021
Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutions Wenhai Wang Enze Xie Xiang Li Deng-Ping Fan Kaitao Song Ding Liang Tong Lu Ping Luo Ling Shao ViT 483 3,699 0 24 Feb 2021
Boundary-Aware Geometric Encoding for Semantic Segmentation of Point Clouds Jingyu Gong Jiachen Xu Xin Tan Jie Zhou Yanyun Qu Yuan Xie Lizhuang Ma 3DPC 76 46 0 07 Jan 2021
Rethinking Semantic Segmentation from a Sequence-to-Sequence Perspective with Transformers Sixiao Zheng Jiachen Lu Hengshuang Zhao Xiatian Zhu Zekun Luo ... Yanwei Fu Jianfeng Feng Tao Xiang Philip Torr Li Zhang ViT 170 2,893 0 31 Dec 2020
Polarization-driven Semantic Segmentation via Efficient Attention-bridged Fusion Kaite Xiang Kailun Yang Kaiwei Wang 63 64 0 26 Nov 2020
Survey on Deep Multi-modal Data Analytics: Collaboration, Rivalry and Fusion Yang Wang 83 198 0 15 Jun 2020
Context Prior for Scene Segmentation Changqian Yu Jingbo Wang Changxin Gao Gang Yu Chunhua Shen Nong Sang 103 269 0 03 Apr 2020
PolarNet: An Improved Grid Representation for Online LiDAR Point Clouds Semantic Segmentation Yang Zhang Zixiang Zhou P. David Xiangyu Yue Zerong Xi Boqing Gong H. Foroosh 3DPC 71 458 0 31 Mar 2020
Cars Can't Fly up in the Sky: Improving Urban-Scene Segmentation via Height-driven Attention Networks Sungha Choi J. Kim Jaegul Choo SSeg 135 156 0 11 Mar 2020
MMTM: Multimodal Transfer Module for CNN Fusion Hamid Reza Vaezi Joze Amirreza Shaban Michael L. Iuzzolino K. Koishida 75 277 0 20 Nov 2019
Boundary-Aware Feature Propagation for Scene Segmentation Henghui Ding Xudong Jiang A. Liu N. Magnenat-Thalmann G. Wang 263 258 0 31 Aug 2019
Gated-SCNN: Gated Shape CNNs for Semantic Segmentation Towaki Takikawa David Acuna Varun Jampani Sanja Fidler 75 609 0 12 Jul 2019
ACNet: Attention Based Network to Exploit Complementary Features for RGBD Semantic Segmentation Xinxin Hu Kailun Yang Lei Fei Kaiwei Wang 3DPC 102 353 0 24 May 2019
Deep Multi-modal Object Detection and Semantic Segmentation for Autonomous Driving: Datasets, Methods, and Challenges Di Feng Christian Haase-Schuetz Lars Rosenbaum Heinz Hertlein Claudius Gläser Fabian Duffhauss W. Wiesbeck Klaus C. J. Dietmayer 3DPC 85 1,004 0 21 Feb 2019
CCNet: Criss-Cross Attention for Semantic Segmentation Zilong Huang Xinggang Wang Yunchao Wei Lichao Huang Humphrey Shi Wenyu Liu Chang Huang VOS 180 2,540 0 28 Nov 2018
Context Encoding for Semantic Segmentation Hang Zhang Kristin J. Dana Jianping Shi Zhongyue Zhang Xiaogang Wang A. Tyagi Amit Agrawal SSeg 84 1,251 0 23 Mar 2018
Pyramid Scene Parsing Network Hengshuang Zhao Jianping Shi Xiaojuan Qi Xiaogang Wang Jiaya Jia VOS SSeg 528 11,984 0 04 Dec 2016
RefineNet: Multi-Path Refinement Networks for High-Resolution Semantic Segmentation Guosheng Lin Anton Milan Chunhua Shen Ian Reid AI4TS SSeg 253 2,847 0 20 Nov 2016