Exploring Learngene via Stage-wise Weight Sharing for Initializing Variable-sized Models

25 April 2024

Papers citing "Exploring Learngene via Stage-wise Weight Sharing for Initializing Variable-sized Models"

4 / 4 papers shown

Title
FINE: Factorizing Knowledge for Initialization of Variable-sized Diffusion Models Yucheng Xie Fu Feng Ruixiao Shi Jing Wang Xin Geng AI4CE 36 2 0 28 Sep 2024
Transformer as Linear Expansion of Learngene Shiyu Xia Miaosen Zhang Xu Yang Ruiming Chen Haokun Chen Xin Geng 38 6 0 09 Dec 2023
Learngene: Inheriting Condensed Knowledge from the Ancestry Model to Descendant Models Qiufeng Wang Xu Yang Shuxia Lin Jing Wang Xin Geng 23 10 0 03 May 2023
Masked Autoencoders Are Scalable Vision Learners Kaiming He Xinlei Chen Saining Xie Yanghao Li Piotr Dollár Ross B. Girshick ViT TPM 305 7,443 0 11 Nov 2021