Pre-training of Lightweight Vision Transformers on Small Datasets with Minimally Scaled Images

6 February 2024

Papers citing "Pre-training of Lightweight Vision Transformers on Small Datasets with Minimally Scaled Images"

7 / 7 papers shown

Title
Escaping the Big Data Paradigm with Compact Transformers Ali Hassani Steven Walton Nikhil Shah Abulikemu Abuduweili Jiachen Li Humphrey Shi 98 462 0 12 Apr 2021
Training data-efficient image transformers & distillation through attention Hugo Touvron Matthieu Cord Matthijs Douze Francisco Massa Alexandre Sablayrolles Hervé Jégou ViT 273 6,657 0 23 Dec 2020
Exploring Simple Siamese Representation Learning Xinlei Chen Kaiming He SSL 178 3,992 0 20 Nov 2020
AutoAugment: Learning Augmentation Policies from Data E. D. Cubuk Barret Zoph Dandelion Mané Vijay Vasudevan Quoc V. Le 93 1,764 0 24 May 2018
SGDR: Stochastic Gradient Descent with Warm Restarts I. Loshchilov Frank Hutter ODL 219 8,030 0 13 Aug 2016
Layer Normalization Jimmy Lei Ba J. Kiros Geoffrey E. Hinton 237 10,412 0 21 Jul 2016
Identity Mappings in Deep Residual Networks Kaiming He Xinming Zhang Shaoqing Ren Jian Sun 274 10,149 0 16 Mar 2016