Transformer in Transformer

v1v2v3 (latest)

Transformer in Transformer

27 February 2021

ArXiv (abs)PDF HTML Github (4228★)

Papers citing "Transformer in Transformer"

8 / 558 papers shown

Title
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows Ze Liu Yutong Lin Yue Cao Han Hu Yixuan Wei Zheng Zhang Stephen Lin B. Guo ViT 534 21,842 0 25 Mar 2021
BossNAS: Exploring Hybrid CNN-transformers with Block-wisely Self-supervised Neural Architecture Search Changlin Li Tao Tang Guangrun Wang Jiefeng Peng Bing Wang Xiaodan Liang Xiaojun Chang ViT 158 107 0 23 Mar 2021
Prioritized Architecture Sampling with Monto-Carlo Tree Search Xiu Su Tao Huang Yanxi Li Shan You Fei Wang Chao Qian Changshui Zhang Chang Xu 65 50 0 22 Mar 2021
UPANets: Learning from the Universal Pixel Attention Networks Ching-Hsun Tseng Shin-Jye Lee Jianxing Feng Shengzhong Mao Yuping Wu Jia-Yu Shang Mou-Chung Tseng Xiao-Jun Zeng 52 15 0 15 Mar 2021
Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutions Wenhai Wang Enze Xie Xiang Li Deng-Ping Fan Kaitao Song Ding Liang Tong Lu Ping Luo Ling Shao ViT 590 3,761 0 24 Feb 2021
Transformers in Vision: A Survey Salman Khan Muzammal Naseer Munawar Hayat Syed Waqas Zamir Fahad Shahbaz Khan M. Shah ViT 406 2,570 0 04 Jan 2021
A Survey on Visual Transformer Kai Han Yunhe Wang Hanting Chen Xinghao Chen Jianyuan Guo ... Chunjing Xu Yixing Xu Zhaohui Yang Yiman Zhang Dacheng Tao ViT 237 2,293 0 23 Dec 2020
UP-DETR: Unsupervised Pre-training for Object Detection with Transformers Zhigang Dai Bolun Cai Yugeng Lin Junying Chen ViT 87 24 0 18 Nov 2020