Accumulated Trivial Attention Matters in Vision Transformers on Small Datasets

22 October 2022

Papers citing "Accumulated Trivial Attention Matters in Vision Transformers on Small Datasets"

6 / 6 papers shown

Title
Depth-Wise Convolutions in Vision Transformers for Efficient Training on Small Datasets Tianxiao Zhang Wenju Xu Bo Luo Guanghui Wang ViT MDE 40 7 0 28 Jul 2024
Gender, Smoking History and Age Prediction from Laryngeal Images Tianxiao Zhang A. Bur Shannon M. Kraft Hannah Kavookjian Bryan Renslo Xiangyu Chen Bo Luo Guanghui Wang 26 7 0 26 May 2023
Masked Autoencoders Are Scalable Vision Learners Kaiming He Xinlei Chen Saining Xie Yanghao Li Piotr Dollár Ross B. Girshick ViT TPM 305 7,443 0 11 Nov 2021
CMT: Convolutional Neural Networks Meet Vision Transformers Jianyuan Guo Kai Han Han Wu Yehui Tang Chunjing Xu Yunhe Wang Chang Xu ViT 351 633 0 13 Jul 2021
Emerging Properties in Self-Supervised Vision Transformers Mathilde Caron Hugo Touvron Ishan Misra Hervé Jégou Julien Mairal Piotr Bojanowski Armand Joulin 317 5,785 0 29 Apr 2021
Meta-Baseline: Exploring Simple Meta-Learning for Few-Shot Learning Yinbo Chen Zhuang Liu Huijuan Xu Trevor Darrell Xiaolong Wang 175 340 0 09 Mar 2020