Accelerating Vision Transformer Training via a Patch Sampling Schedule

19 August 2022

Papers citing "Accelerating Vision Transformer Training via a Patch Sampling Schedule"

11 / 11 papers shown

Title
DeiT III: Revenge of the ViT Hugo Touvron Matthieu Cord Hervé Jégou ViT 127 414 0 14 Apr 2022
AdaViT: Adaptive Tokens for Efficient Vision Transformer Hongxu Yin Arash Vahdat J. Álvarez Arun Mallya Jan Kautz Pavlo Molchanov ViT 113 341 0 14 Dec 2021
Scaling Vision with Sparse Mixture of Experts C. Riquelme J. Puigcerver Basil Mustafa Maxim Neumann Rodolphe Jenatton André Susano Pinto Daniel Keysers N. Houlsby MoE 112 609 0 10 Jun 2021
DynamicViT: Efficient Vision Transformers with Dynamic Token Sparsification Yongming Rao Wenliang Zhao Benlin Liu Jiwen Lu Jie Zhou Cho-Jui Hsieh ViT 92 707 0 03 Jun 2021
End-to-End Object Detection with Transformers Nicolas Carion Francisco Massa Gabriel Synnaeve Nicolas Usunier Alexander Kirillov Sergey Zagoruyko ViT 3DV PINN 432 13,094 0 26 May 2020
Once-for-All: Train One Network and Specialize it for Efficient Deployment Han Cai Chuang Gan Tianzhe Wang Zhekai Zhang Song Han OOD 111 1,283 0 26 Aug 2019
Self-Attention with Relative Position Representations Peter Shaw Jakob Uszkoreit Ashish Vaswani 177 2,296 0 06 Mar 2018
Image Transformer Niki Parmar Ashish Vaswani Jakob Uszkoreit Lukasz Kaiser Noam M. Shazeer Alexander Ku Dustin Tran ViT 141 1,684 0 15 Feb 2018
mixup: Beyond Empirical Risk Minimization Hongyi Zhang Moustapha Cissé Yann N. Dauphin David Lopez-Paz NoLa 282 9,803 0 25 Oct 2017
Adaptive Computation Time for Recurrent Neural Networks Alex Graves 117 549 0 29 Mar 2016
Cyclical Learning Rates for Training Neural Networks L. Smith ODL 215 2,533 0 03 Jun 2015