v1v2 (latest)

Shunted Self-Attention via Multi-Scale Token Aggregation

30 November 2021

ArXiv (abs)PDF HTML Github (216★)

Papers citing "Shunted Self-Attention via Multi-Scale Token Aggregation"

35 / 85 papers shown

Title
InceptionNeXt: When Inception Meets ConvNeXt Weihao Yu Pan Zhou Shuicheng Yan Xinchao Wang 187 139 0 29 Mar 2023
WM-MoE: Weather-aware Multi-scale Mixture-of-Experts for Blind Adverse Weather Removal Yulin Luo Rui Zhao Xi Wei Jinwei Chen Yijie Lu Shenghao Xie Tianyu Wang Ruiqin Xiong Ming Lu Shanghang Zhang 96 4 0 24 Mar 2023
Star-Net: Improving Single Image Desnowing Model With More Efficient Connection and Diverse Feature Interaction Jia-ju Mao Yuan Chang Xuesong Yin Binling Nie 49 1 0 17 Mar 2023
BiFormer: Vision Transformer with Bi-Level Routing Attention Lei Zhu Xinjiang Wang Zhanghan Ke Wayne Zhang Rynson W. H. Lau 192 535 0 15 Mar 2023
A Convolutional Vision Transformer for Semantic Segmentation of Side-Scan Sonar Data Hayat Rajani N. Gracias Rafael García ViT 49 14 0 24 Feb 2023
DilateFormer: Multi-Scale Dilated Transformer for Visual Recognition Jiayu Jiao Yuyao Tang Kun-Li Channing Lin Yipeng Gao Jinhua Ma Yaowei Wang Wei-Shi Zheng MedIm ViT 98 155 0 03 Feb 2023
SAT: Size-Aware Transformer for 3D Point Cloud Semantic Segmentation Yueze Wang Yongping Xiong C. Chiu Fangyu Liu Xiangyang Gong 3DPC ViT 66 6 0 17 Jan 2023
Head-Free Lightweight Semantic Segmentation with Linear Transformer B. Dong Pichao Wang Fan Wang ViT 78 75 0 11 Jan 2023
Hierarchical Point Attention for Indoor 3D Object Detection Manli Shu Le Xue Ning Yu Roberto Martín-Martín Caiming Xiong Tom Goldstein Juan Carlos Niebles Ran Xu 3DPC 131 1 0 06 Jan 2023
TinyMIM: An Empirical Study of Distilling MIM Pre-trained Models Sucheng Ren Fangyun Wei Zheng Zhang Han Hu 139 42 0 03 Jan 2023
SMMix: Self-Motivated Image Mixing for Vision Transformers Mengzhao Chen Mingbao Lin Zhihang Lin Yuxin Zhang Chia-Wen Lin Rongrong Ji 120 11 0 26 Dec 2022
GPViT: A High Resolution Non-Hierarchical Vision Transformer with Group Propagation Chenhongyi Yang Jiarui Xu Shalini De Mello Elliot J. Crowley Xinyu Wang ViT 96 22 0 13 Dec 2022
Vision Transformer with Super Token Sampling Huaibo Huang Xiaoqiang Zhou Jie Cao Ran He Tieniu Tan ViT 86 59 0 21 Nov 2022
MSMG-Net: Multi-scale Multi-grained Supervised Metworks for Multi-task Image Manipulation Detection and Localization Fengsheng Wang Leyi Wei 54 2 0 06 Nov 2022
Dataset Distillation via Factorization Songhua Liu Kai Wang Xingyi Yang Jingwen Ye Xinchao Wang DD 217 146 0 30 Oct 2022
MetaFormer Baselines for Vision Weihao Yu Chenyang Si Pan Zhou Mi Luo Yichen Zhou Jiashi Feng Shuicheng Yan Xinchao Wang MoE 90 169 0 24 Oct 2022
Scaling & Shifting Your Features: A New Baseline for Efficient Model Tuning Dongze Lian Daquan Zhou Jiashi Feng Xinchao Wang 112 264 0 17 Oct 2022
Bridging the Gap Between Vision Transformers and Convolutional Neural Networks on Small Datasets Zhiying Lu Hongtao Xie Chuanbin Liu Yongdong Zhang ViT 107 61 0 12 Oct 2022
Attention Diversification for Domain Generalization Rang Meng Xianfeng Li Weijie Chen Shicai Yang Mingli Song Xinchao Wang Lei Zhang Mingli Song Di Xie Shiliang Pu 78 41 0 09 Oct 2022
LRT: An Efficient Low-Light Restoration Transformer for Dark Light Field Images Shansi Zhang Nan Meng E. Lam ViT 93 23 0 06 Sep 2022
ClusTR: Exploring Efficient Self-attention via Clustering for Vision Transformers Yutong Xie Jianpeng Zhang Yong-quan Xia Anton Van Den Hengel Qi Wu 61 6 0 28 Aug 2022
In the Eye of Transformer: Global-Local Correlation for Egocentric Gaze Estimation Bolin Lai Miao Liu Fiona Ryan James M. Rehg ViT 94 37 0 08 Aug 2022
Hierarchical Semi-Supervised Contrastive Learning for Contamination-Resistant Anomaly Detection Gaoang Wang Yibing Zhan Xinchao Wang Min-Gyoo Song Klara Nahrstedt 47 11 0 24 Jul 2022
Learning Graph Neural Networks for Image Style Transfer Yongcheng Jing Yining Mao Yiding Yang Yibing Zhan Xiuming Zhang Xinchao Wang Dacheng Tao 130 56 0 24 Jul 2022
Learning with Recoverable Forgetting Jingwen Ye Yifang Fu Mingli Song Xingyi Yang Songhua Liu Xin Jin Mingli Song Xinchao Wang CLL KELM 113 42 0 17 Jul 2022
DynaST: Dynamic Sparse Transformer for Exemplar-Guided Image Generation Songhua Liu Jingwen Ye Sucheng Ren Xinchao Wang 93 44 0 13 Jul 2022
MSP-Former: Multi-Scale Projection Transformer for Single Image Desnowing Sixiang Chen Tian-Chun Ye Yun-Peng Liu Taodong Liao Y. Ye Erkang Chen Peng Chen ViT 125 54 0 12 Jul 2022
Factorizing Knowledge in Neural Networks Xingyi Yang Jingwen Ye Xinchao Wang MoMe 133 126 0 04 Jul 2022
EATFormer: Improving Vision Transformer Inspired by Evolutionary Algorithm Jiangning Zhang Xiangtai Li Yabiao Wang Chengjie Wang Yibo Yang Yong Liu Dacheng Tao ViT 121 35 0 19 Jun 2022
Learning Domain Adaptive Object Detection with Probabilistic Teacher Meilin Chen Weijie Chen Shicai Yang Mingli Song Xinchao Wang ... Yunfeng Yan Donglian Qi Yueting Zhuang Di Xie Shiliang Pu 124 80 0 13 Jun 2022
Super Vision Transformer Mingbao Lin Mengzhao Chen Yuxin Zhang Yunhang Shen Rongrong Ji Liujuan Cao ViT 125 21 0 23 May 2022
A Unified and Biologically-Plausible Relational Graph Representation of Vision Transformers Yuzhong Chen Yu Du Zhe Xiao Lin Zhao Lu Zhang ... Dajiang Zhu Tuo Zhang Xintao Hu Tianming Liu Xi Jiang ViT 79 5 0 20 May 2022
Meta Clustering Learning for Large-scale Unsupervised Person Re-identification Xin Jin Tianyu He Xu Shen Tongliang Liu Xinchao Wang Jianqiang Huang Zhibo Chen Xiansheng Hua 64 12 0 19 Nov 2021
Unifying Global-Local Representations in Salient Object Detection with Transformer Sucheng Ren Qiang Wen Nanxuan Zhao Guoqiang Han Shengfeng He ViT 95 26 0 05 Aug 2021
Balancing Biases and Preserving Privacy on Balanced Faces in the Wild Joseph P. Robinson Can Qin Yann Henon Samson Timoner Y. Fu 103 25 0 16 Mar 2021