ResearchTrend.AI
CSWin Transformer: A General Vision Transformer Backbone with Cross-Shaped Windows
v1v2v3 (latest)

CSWin Transformer: A General Vision Transformer Backbone with Cross-Shaped Windows

Xiaoyi Dong
Jianmin Bao
Dongdong Chen
Weiming Zhang
Nenghai Yu
Lu Yuan
Dong Chen
B. Guo
    ViT
ArXiv (abs)PDFHTMLGithub (569★)

Papers citing "CSWin Transformer: A General Vision Transformer Backbone with Cross-Shaped Windows"

50 / 440 papers shown
Title
LMLT: Low-to-high Multi-Level Vision Transformer for Image Super-Resolution
LMLT: Low-to-high Multi-Level Vision Transformer for Image Super-Resolution
Jeongsoo Kim
Jongho Nang
Junsuk Choe
ViT
98
4
0
05 Sep 2024
Pluralistic Salient Object Detection
Pluralistic Salient Object Detection
Xuelu Feng
Yunsheng Li
Dongdong Chen
Chunming Qiao
Junsong Yuan
Lu Yuan
G. Hua
73
1
0
04 Sep 2024
ESP-PCT: Enhanced VR Semantic Performance through Efficient Compression of Temporal and Spatial Redundancies in Point Cloud Transformers
ESP-PCT: Enhanced VR Semantic Performance through Efficient Compression of Temporal and Spatial Redundancies in Point Cloud Transformers
Luoyu Mei
Shuai Wang
Yun Cheng
Ruofeng Liu
Zhimeng Yin
Wenchao Jiang
Shuai Wang
Wei Gong
86
5
0
02 Sep 2024
LoG-VMamba: Local-Global Vision Mamba for Medical Image Segmentation
LoG-VMamba: Local-Global Vision Mamba for Medical Image Segmentation
Trung Dang
Huy Hoang Nguyen
A. Tiulpin
Mamba
87
4
0
26 Aug 2024
Beyond Uniform Query Distribution: Key-Driven Grouped Query Attention
Beyond Uniform Query Distribution: Key-Driven Grouped Query Attention
Zohaib Khan
Muhammad Khaquan
Omer Tafveez
Burhanuddin Samiwala
Agha Ali Raza
93
3
0
15 Aug 2024
Efficient Visual Representation Learning with Heat Conduction Equation
Efficient Visual Representation Learning with Heat Conduction Equation
Zhemin Zhang
Xun Gong
DiffM3DV
91
0
0
12 Aug 2024
MacFormer: Semantic Segmentation with Fine Object Boundaries
MacFormer: Semantic Segmentation with Fine Object Boundaries
Guoan Xu
Wenfeng Huang
Tao Wu
Ligeng Chen
Wenjing Jia
Guangwei Gao
Xiatian Zhu
Stuart W. Perry
86
0
0
11 Aug 2024
Survey: Transformer-based Models in Data Modality Conversion
Survey: Transformer-based Models in Data Modality Conversion
Elyas Rashno
Amir Eskandari
Aman Anand
F. Zulkernine
MedIm
97
0
0
08 Aug 2024
CAS-ViT: Convolutional Additive Self-attention Vision Transformers for Efficient Mobile Applications
CAS-ViT: Convolutional Additive Self-attention Vision Transformers for Efficient Mobile Applications
Tianfang Zhang
Lei Li
Yang Zhou
Wentao Liu
Chen Qian
Xiangyang Ji
ViT
94
17
0
07 Aug 2024
SwinShadow: Shifted Window for Ambiguous Adjacent Shadow Detection
SwinShadow: Shifted Window for Ambiguous Adjacent Shadow Detection
Yonghui Wang
Shaokai Liu
Li Li
Wengang Zhou
Houqiang Li
ViT
88
1
0
07 Aug 2024
VSSD: Vision Mamba with Non-Causal State Space Duality
VSSD: Vision Mamba with Non-Causal State Space Duality
Yuheng Shi
Minjing Dong
Mingjia Li
Chang Xu
Mamba
103
3
0
26 Jul 2024
CSWin-UNet: Transformer UNet with Cross-Shaped Windows for Medical Image Segmentation
CSWin-UNet: Transformer UNet with Cross-Shaped Windows for Medical Image Segmentation
Xiao Liu
Peng Gao
Tao Yu
Fei Wang
Ruyue Yuan
MedImViT
82
22
0
25 Jul 2024
Embedding-Free Transformer with Inference Spatial Reduction for Efficient Semantic Segmentation
Embedding-Free Transformer with Inference Spatial Reduction for Efficient Semantic Segmentation
Hyunwoo Yu
Yubin Cho
Beoungwoo Kang
Seunghun Moon
Kyeongbo Kong
Suk-Ju Kang
84
3
0
24 Jul 2024
Exploring The Neural Burden In Pruned Models: An Insight Inspired By Neuroscience
Exploring The Neural Burden In Pruned Models: An Insight Inspired By Neuroscience
Zeyu Wang
Weichen Dai
Xiangyu Zhou
Ji Qi
Yi Zhou
116
0
0
23 Jul 2024
SwinSF: Image Reconstruction from Spatial-Temporal Spike Streams
SwinSF: Image Reconstruction from Spatial-Temporal Spike Streams
Liangyan Jiang
Chuang Zhu
Yanxu Chen
99
2
0
22 Jul 2024
DuoFormer: Leveraging Hierarchical Visual Representations by Local and Global Attention
DuoFormer: Leveraging Hierarchical Visual Representations by Local and Global Attention
Xiaoya Tang
Bodong Zhang
Beatrice Knudsen
Tolga Tasdizen
ViTMedIm
99
1
0
18 Jul 2024
AFIDAF: Alternating Fourier and Image Domain Adaptive Filters as an Efficient Alternative to Attention in ViTs
AFIDAF: Alternating Fourier and Image Domain Adaptive Filters as an Efficient Alternative to Attention in ViTs
Yunling Zheng
Zeyi Xu
Fanghui Xue
Biao Yang
Jiancheng Lyu
Shuai Zhang
Y. Qi
Jack Xin
97
0
0
16 Jul 2024
SliceMamba with Neural Architecture Search for Medical Image Segmentation
SliceMamba with Neural Architecture Search for Medical Image Segmentation
Chao Fan
Hongyuan Yu
Yan Huang
Liang Wang
Zhenghan Yang
Xibin Jia
Mamba
70
1
0
11 Jul 2024
ISWSST: Index-space-wave State Superposition Transformers for Multispectral Remotely Sensed Imagery Semantic Segmentation
ISWSST: Index-space-wave State Superposition Transformers for Multispectral Remotely Sensed Imagery Semantic Segmentation
Chang Li
Pengfei Zhang
Yu Wang
75
0
0
03 Jul 2024
Query-Efficient Hard-Label Black-Box Attack against Vision Transformers
Query-Efficient Hard-Label Black-Box Attack against Vision Transformers
Chao Zhou
Xiaowen Shi
Yuan-Gen Wang
ViTAAML
81
0
0
29 Jun 2024
Medical Image Segmentation Using Directional Window Attention
Medical Image Segmentation Using Directional Window Attention
Daniya Najiha Abdul Kareem
Mustansar Fiaz
Noa Novershtern
Hisham Cholakkal
ViTMedIm
186
3
0
25 Jun 2024
RepNeXt: A Fast Multi-Scale CNN using Structural Reparameterization
RepNeXt: A Fast Multi-Scale CNN using Structural Reparameterization
Mingshu Zhao
Yi Luo
Yong Ouyang
124
3
0
23 Jun 2024
Soft Masked Mamba Diffusion Model for CT to MRI Conversion
Soft Masked Mamba Diffusion Model for CT to MRI Conversion
Zhenbin Wang
Lei Zhang
Lituan Wang
Zhenwei Zhang
MambaMedIm
82
7
0
22 Jun 2024
Hybrid Spatial-spectral Neural Network for Hyperspectral Image Denoising
Hybrid Spatial-spectral Neural Network for Hyperspectral Image Denoising
Hao Liang
Chengjie
Kun Li
Xin Tian
74
1
0
13 Jun 2024
ProMotion: Prototypes As Motion Learners
ProMotion: Prototypes As Motion Learners
Yawen Lu
Dongfang Liu
Qifan Wang
Cheng Han
Yiming Cui
Zhiwen Cao
Xueling Zhang
Yingjie Victor Chen
Heng Fan
DiffM
122
3
0
07 Jun 2024
GrootVL: Tree Topology is All You Need in State Space Model
GrootVL: Tree Topology is All You Need in State Space Model
Yicheng Xiao
Lin Song
Shaoli Huang
Jiangshan Wang
Siyu Song
Yixiao Ge
Xiu Li
Ying Shan
Mamba
114
13
0
04 Jun 2024
Image Captioning via Dynamic Path Customization
Image Captioning via Dynamic Path Customization
Yiwei Ma
Jiayi Ji
Xiaoshuai Sun
Yiyi Zhou
Xiaopeng Hong
Yongjian Wu
Rongrong Ji
81
1
0
01 Jun 2024
FocSAM: Delving Deeply into Focused Objects in Segmenting Anything
FocSAM: Delving Deeply into Focused Objects in Segmenting Anything
You Huang
Zongyu Lan
Liujuan Cao
Xianming Lin
Shengchuan Zhang
Guannan Jiang
Rongrong Ji
VLM
56
2
0
29 May 2024
ViG: Linear-complexity Visual Sequence Learning with Gated Linear Attention
ViG: Linear-complexity Visual Sequence Learning with Gated Linear Attention
Bencheng Liao
Xinggang Wang
Lianghui Zhu
Qian Zhang
Chang Huang
121
4
0
28 May 2024
Demystify Mamba in Vision: A Linear Attention Perspective
Demystify Mamba in Vision: A Linear Attention Perspective
Dongchen Han
Ziyi Wang
Zhuofan Xia
Yizeng Han
Yifan Pu
Chunjiang Ge
Jun Song
Shiji Song
Bo Zheng
Gao Huang
Mamba
129
62
0
26 May 2024
Building Vision Models upon Heat Conduction
Building Vision Models upon Heat Conduction
Zhaozhi Wang
Yue Liu
Yunfan Liu
Hongtian Yu
Yaowei Wang
QiXiang Ye
ViTVLM
104
0
0
26 May 2024
Accelerating Transformers with Spectrum-Preserving Token Merging
Accelerating Transformers with Spectrum-Preserving Token Merging
Hoai-Chau Tran
D. M. Nguyen
Duy M. Nguyen
Trung Thanh Nguyen
Ngan Le
Pengtao Xie
Daniel Sonntag
James Y. Zou
Binh T. Nguyen
Mathias Niepert
106
13
0
25 May 2024
U3M: Unbiased Multiscale Modal Fusion Model for Multimodal Semantic Segmentation
U3M: Unbiased Multiscale Modal Fusion Model for Multimodal Semantic Segmentation
Bingyu Li
Da Zhang
Zhiyuan Zhao
Junyu Gao
Xuelong Li
92
5
0
24 May 2024
Multi-Scale VMamba: Hierarchy in Hierarchy Visual State Space Model
Multi-Scale VMamba: Hierarchy in Hierarchy Visual State Space Model
Yuheng Shi
Minjing Dong
Chang Xu
Mamba
114
36
0
23 May 2024
Vision Transformer with Sparse Scan Prior
Vision Transformer with Sparse Scan Prior
Qihang Fan
Huaibo Huang
Mingrui Chen
Ran He
ViT
88
6
0
22 May 2024
Semantic Equitable Clustering: A Simple and Effective Strategy for Clustering Vision Tokens
Semantic Equitable Clustering: A Simple and Effective Strategy for Clustering Vision Tokens
Qihang Fan
Huaibo Huang
Mingrui Chen
Ran He
92
3
0
22 May 2024
SLAB: Efficient Transformers with Simplified Linear Attention and Progressive Re-parameterized Batch Normalization
SLAB: Efficient Transformers with Simplified Linear Attention and Progressive Re-parameterized Batch Normalization
Jialong Guo
Xinghao Chen
Yehui Tang
Yunhe Wang
ViT
101
14
0
19 May 2024
GestFormer: Multiscale Wavelet Pooling Transformer Network for Dynamic Hand Gesture Recognition
GestFormer: Multiscale Wavelet Pooling Transformer Network for Dynamic Hand Gesture Recognition
Mallika Garg
Debashis Ghosh
P. M. Pradhan
SLRViT
85
5
0
18 May 2024
Filling Missing Values Matters for Range Image-Based Point Cloud Segmentation
Filling Missing Values Matters for Range Image-Based Point Cloud Segmentation
Bike Chen
Chen Gong
Juha Röning
3DPC
92
4
0
16 May 2024
EfficientTrain++: Generalized Curriculum Learning for Efficient Visual Backbone Training
EfficientTrain++: Generalized Curriculum Learning for Efficient Visual Backbone Training
Yulin Wang
Yang Yue
Rui Lu
Yizeng Han
Shiji Song
Gao Huang
VLM
114
12
0
14 May 2024
MambaOut: Do We Really Need Mamba for Vision?
MambaOut: Do We Really Need Mamba for Vision?
Weihao Yu
Xinchao Wang
Mamba
99
60
0
13 May 2024
Multimodal Sense-Informed Prediction of 3D Human Motions
Multimodal Sense-Informed Prediction of 3D Human Motions
Zhenyu Lou
Qiongjie Cui
Haofan Wang
Xu Tang
Hong Zhou
75
5
0
05 May 2024
Swin2-MoSE: A New Single Image Super-Resolution Model for Remote Sensing
Swin2-MoSE: A New Single Image Super-Resolution Model for Remote Sensing
Leonardo Rossi
Vittorio Bernuzzi
Tomaso Fontanini
Massimo Bertozzi
Andrea Prati
99
5
0
29 Apr 2024
SmartMem: Layout Transformation Elimination and Adaptation for Efficient DNN Execution on Mobile
SmartMem: Layout Transformation Elimination and Adaptation for Efficient DNN Execution on Mobile
Wei Niu
Md. Musfiqur Rahman Sanim
Zhihao Shu
Jiexiong Guan
Xipeng Shen
Miao Yin
Gagan Agrawal
Bin Ren
72
6
0
21 Apr 2024
An Experimental Study on Exploring Strong Lightweight Vision Transformers via Masked Image Modeling Pre-Training
An Experimental Study on Exploring Strong Lightweight Vision Transformers via Masked Image Modeling Pre-Training
Jin Gao
Shubo Lin
Shaoru Wang
Yutong Kou
Zeming Li
Liang Li
Congxuan Zhang
Xiaoqin Zhang
Yizheng Wang
Weiming Hu
115
1
0
18 Apr 2024
Training Transformer Models by Wavelet Losses Improves Quantitative and Visual Performance in Single Image Super-Resolution
Training Transformer Models by Wavelet Losses Improves Quantitative and Visual Performance in Single Image Super-Resolution
Cansu Korkmaz
A. Murat Tekalp
ViT
105
8
0
17 Apr 2024
Pixel-Wise Symbol Spotting via Progressive Points Location for Parsing CAD Images
Pixel-Wise Symbol Spotting via Progressive Points Location for Parsing CAD Images
Junbiao Pang
Zailin Dong
Jiaxin Deng
Mengyuan Zhu
Yunwei Zhang
3DPC
98
0
0
17 Apr 2024
Learning Correlation Structures for Vision Transformers
Learning Correlation Structures for Vision Transformers
Manjin Kim
Paul Hongsuck Seo
Cordelia Schmid
Minsu Cho
ViT
99
11
0
05 Apr 2024
Improving Visual Recognition with Hyperbolical Visual Hierarchy Mapping
Improving Visual Recognition with Hyperbolical Visual Hierarchy Mapping
Hyeongjun Kwon
Jinhyun Jang
Jin-Hwa Kim
Kwonyoung Kim
Kwanghoon Sohn
132
3
0
01 Apr 2024
Transformer based Pluralistic Image Completion with Reduced Information Loss
Transformer based Pluralistic Image Completion with Reduced Information Loss
Qiankun Liu
Yuqi Jiang
Zhentao Tan
DongDong Chen
Ying Fu
Qi Chu
Gang Hua
Nenghai Yu
ViT
114
12
0
31 Mar 2024

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.