Transformer in Transformer

27 February 2021

Papers citing "Transformer in Transformer"

50 / 553 papers shown

Title
Refined Temporal Pyramidal Compression-and-Amplification Transformer for 3D Human Pose Estimation Hanbing Li Wangmeng Xiang Ju He Zhi-Qi Cheng Bin Luo Yifeng Geng Xuansong Xie ViT 41 2 0 04 Sep 2023
Computation-efficient Deep Learning for Computer Vision: A Survey Yulin Wang Yizeng Han Chaofei Wang Shiji Song Qi Tian Gao Huang VLM 36 20 0 27 Aug 2023
Benchmarking Data Efficiency and Computational Efficiency of Temporal Action Localization Models Jan Warchocki Teodor Oprescu Yunhan Wang Alexandru Damacus Paul Misterka Robert-Jan Bruintjes A. Lengyel Ombretta Strafforello Jan van Gemert 21 2 0 24 Aug 2023
Learning Heavily-Degraded Prior for Underwater Object Detection C. Fu Xin-Yue Fan Jiewen Xiao Wanqi Yuan Risheng Liu Zhongxuan Luo 24 22 0 24 Aug 2023
SG-Former: Self-guided Transformer with Evolving Token Reallocation Sucheng Ren Xingyi Yang Songhua Liu Xinchao Wang ViT 27 41 0 23 Aug 2023
SPANet: Frequency-balancing Token Mixer using Spectral Pooling Aggregation Modulation Guhnoo Yun J. Yoo Kijung Kim Jeongho Lee Dong Hwan Kim MoE 33 8 0 22 Aug 2023
Vision Transformer Pruning Via Matrix Decomposition Tianyi Sun 30 0 0 21 Aug 2023
Patch Is Not All You Need Chang-bo Li Jie Zhang Yang Wei Zhilong Ji Jinfeng Bai Shiguang Shan ViT 49 1 0 21 Aug 2023
LDCSF: Local depth convolution-based Swim framework for classifying multi-label histopathology images Liangrui Pan Yutao Dou Zhichao Feng Liwen Xu Shaoliang Peng MedIm 6 3 0 21 Aug 2023
TransFace: Calibrating Transformer Training for Face Recognition from a Data-Centric Perspective Jun Dan Yang Liu Haoyu Xie Jiankang Deng H. Xie Xuansong Xie Baigui Sun ViT 28 21 0 20 Aug 2023
PoSynDA: Multi-Hypothesis Pose Synthesis Domain Adaptation for Robust 3D Human Pose Estimation Han-Wen Liu Ju He Zhi-Qi Cheng Wangmeng Xiang Q. Yang ... Gaoang Wang Xueting Bao Bin Luo Yifeng Geng Xuansong Xie DiffM 32 19 0 18 Aug 2023
Diverse Cotraining Makes Strong Semi-Supervised Segmentor Yijiang Li Xinjiang Wang Lihe Yang Xue Jiang Wayne Zhang Ying Gao 27 15 0 18 Aug 2023
Computer vision-enriched discrete choice models, with an application to residential location choice S. Cranenburgh Francisco Garrido-Valenzuela 24 2 0 16 Aug 2023
Low-Light Image Enhancement with Illumination-Aware Gamma Correction and Complete Image Modelling Network Yinglong Wang Ziqiang Liu Jianzhuang Liu Songcen Xu Shuaicheng Liu 3DV 40 27 0 16 Aug 2023
AttMOT: Improving Multiple-Object Tracking by Introducing Auxiliary Pedestrian Attributes Yunhao Li Zhen Xiao L. Yang Dan Meng Xin Zhou Hengrui Fan Libo Zhang 37 4 0 15 Aug 2023
ViLP: Knowledge Exploration using Vision, Language, and Pose Embeddings for Video Action Recognition S. Chaudhuri Saumik Bhattacharya 27 3 0 07 Aug 2023
DiT: Efficient Vision Transformers with Dynamic Token Routing Yuchen Ma Zhengcong Fei Junshi Huang ViT 26 2 0 07 Aug 2023
Novel Physics-Based Machine-Learning Models for Indoor Air Quality Approximations Ahmad Mohammadshirazi Aida Nadafian Amin Karimi Monsefi M. Rafiei R. Ramnath AI4CE 27 3 0 02 Aug 2023
ViT2EEG: Leveraging Hybrid Pretrained Vision Transformers for EEG Data Ruiqi Yang Eric Modesitt ViT 31 12 0 01 Aug 2023
Visual Prompt Flexible-Modal Face Anti-Spoofing Zitong Yu Rizhao Cai Yawen Cui Ajian Liu Changsheng Chen 38 6 0 26 Jul 2023
Sparse then Prune: Toward Efficient Vision Transformers Yogi Prasetyo N. Yudistira A. Widodo VLM ViT 21 1 0 22 Jul 2023
Efficient Beam Tree Recursion Jishnu Ray Chowdhury Cornelia Caragea 32 3 0 20 Jul 2023
What Can Simple Arithmetic Operations Do for Temporal Modeling? Wenhao Wu Yuxin Song Zhun Sun Jingdong Wang Chang Xu Wanli Ouyang 40 8 0 18 Jul 2023
Complementary Frequency-Varying Awareness Network for Open-Set Fine-Grained Image Recognition Jiaying Sun Hong Wang Qiulei Dong 25 0 0 14 Jul 2023
DEDUCE: Multi-head attention decoupled contrastive learning to discover cancer subtypes based on multi-omics data Liangrui Pan Da Liu Yutao Dou Lian-min Wang Zhichao Feng Pengfei Rong Liwen Xu Shaoliang Peng 11 4 0 09 Jul 2023
Random Position Adversarial Patch for Vision Transformers Mingzhen Shao ViT AAML 41 2 0 09 Jul 2023
Make A Long Image Short: Adaptive Token Length for Vision Transformers Yuqin Zhu Yichen Zhu ViT 72 17 0 05 Jul 2023
Review of Large Vision Models and Visual Prompt Engineering Jiaqi Wang Zheng Liu Lin Zhao Zihao Wu Chong Ma ... Bao Ge Yixuan Yuan Dinggang Shen Tianming Liu Shu Zhang VLM LRM 55 146 0 03 Jul 2023
ImDiffusion: Imputed Diffusion Models for Multivariate Time Series Anomaly Detection Yuhang Chen C. Zhang Minghua Ma Yudong Liu Ruomeng Ding Bo-wen Li Shilin He Saravan Rajmohan Qingwei Lin Dongmei Zhang DiffM 31 47 0 03 Jul 2023
X-MLP: A Patch Embedding-Free MLP Architecture for Vision Xinyue Wang Zhicheng Cai Chenglei Peng ViT 22 5 0 02 Jul 2023
STTracker: Spatio-Temporal Tracker for 3D Single Object Tracking Yubo Cui Zhiheng Li Zheng Fang 3DPC 21 12 0 30 Jun 2023
ParameterNet: Parameters Are All You Need Kai Han Yunhe Wang Jianyuan Guo Enhua Wu VLM AI4CE 35 25 0 26 Jun 2023
Unfolding Framework with Prior of Convolution-Transformer Mixture and Uncertainty Estimation for Video Snapshot Compressive Imaging Siming Zheng Xin Yuan ViT MedIm 10 5 0 20 Jun 2023
SegT: A Novel Separated Edge-guidance Transformer Network for Polyp Segmentation Feiyu Chen Haiping Ma Weijia Zhang ViT MedIm 33 7 0 19 Jun 2023
Seeing the Pose in the Pixels: Learning Pose-Aware Representations in Vision Transformers Dominick Reilly Aman Chadha Srijan Das ViT 33 4 0 15 Jun 2023
Revisiting Token Pruning for Object Detection and Instance Segmentation Yifei Liu Mathias Gehrig Nico Messikommer Marco Cannici Davide Scaramuzza ViT VLM 42 25 0 12 Jun 2023
A Comprehensive Survey on Applications of Transformers for Deep Learning Tasks Saidul Islam Hanae Elmekki Ahmed Elsebai Jamal Bentahar Najat Drawel Gaith Rjoub Witold Pedrycz ViT MedIm 24 172 0 11 Jun 2023
FasterViT: Fast Vision Transformers with Hierarchical Attention Ali Hatamizadeh Greg Heinrich Hongxu Yin Andrew Tao J. Álvarez Jan Kautz Pavlo Molchanov ViT 25 67 0 09 Jun 2023
InvPT++: Inverted Pyramid Multi-Task Transformer for Visual Scene Understanding Hanrong Ye Dan Xu ViT 32 10 0 08 Jun 2023
Human-imperceptible, Machine-recognizable Images Fusheng Hao Fengxiang He Yikai Wang Fuxiang Wu Jing Zhang Jun Cheng Dacheng Tao AAML 24 0 0 06 Jun 2023
Recent Advances of Local Mechanisms in Computer Vision: A Survey and Outlook of Recent Work Qiangchang Wang Yilong Yin 37 0 0 02 Jun 2023
Learning Local to Global Feature Aggregation for Speech Emotion Recognition Cheng Lu Hailun Lian Wenming Zheng Yuan Zong Yan Zhao Sunan Li ViT 21 7 0 02 Jun 2023
Lightweight Vision Transformer with Bidirectional Interaction Qihang Fan Huaibo Huang Xiaoqiang Zhou Ran He ViT 52 28 0 01 Jun 2023
Are Large Kernels Better Teachers than Transformers for ConvNets? Tianjin Huang Lu Yin Zhenyu (Allen) Zhang Lijuan Shen Meng Fang Mykola Pechenizkiy Zhangyang Wang Shiwei Liu 38 13 0 30 May 2023
Edge-MoE: Memory-Efficient Multi-Task Vision Transformer Architecture with Task-level Sparsity via Mixture-of-Experts Rishov Sarkar Hanxue Liang Zhiwen Fan Zhangyang Wang Cong Hao MoE 30 17 0 30 May 2023
ProcessGPT: Transforming Business Process Management with Generative Artificial Intelligence Amin Beheshti Jian Yang Quan.Z Sheng B. Benatallah Fabio Casati Schahram Dustdar H. M. Nezhad Xuyun Zhang Shan Xue AI4CE 27 38 0 29 May 2023
TranSFormer: Slow-Fast Transformer for Machine Translation Bei Li Yi Jing Xu Tan Zhen Xing Tong Xiao Jingbo Zhu 49 7 0 26 May 2023
FIT: Far-reaching Interleaved Transformers Ting-Li Chen Lala Li 32 12 0 22 May 2023
Transfer Learning for Fine-grained Classification Using Semi-supervised Learning and Visual Transformers Manuel Lagunas Brayan Impata Victor Martinez Virginia Fernandez Christos Georgakis Sofia Braun Felipe Bertrand ViT 38 8 0 17 May 2023
MaxViT-UNet: Multi-Axis Attention for Medical Image Segmentation Abdul Rehman Khan Asifullah Khan ViT MedIm 47 14 0 15 May 2023