ResearchTrend.AI
Structured Initialization for Vision Transformers

Structured Initialization for Vision Transformers

Jianqiao Zheng
Xueqian Li
Hemanth Saratchandran
Simon Lucey
    ViT
ArXiv (abs)PDFHTML

Papers citing "Structured Initialization for Vision Transformers"

2 / 2 papers shown
Title
Always Skip Attention
Always Skip Attention
Yiping Ji
Hemanth Saratchandran
Peyman Moghaddam
Simon Lucey
453
3
0
04 May 2025
On the Relationship between Self-Attention and Convolutional Layers
On the Relationship between Self-Attention and Convolutional Layers
Jean-Baptiste Cordonnier
Andreas Loukas
Martin Jaggi
143
535
0
08 Nov 2019