Transformer as Linear Expansion of Learngene

9 December 2023

Papers citing "Transformer as Linear Expansion of Learngene"

5 / 5 papers shown

Title
Harmonizing Generalization and Personalization in Ring-topology Decentralized Federated Learning Shunxin Guo Jiaqi Lv Xin Geng 49 0 0 27 Apr 2025
KIND: Knowledge Integration and Diversion for Training Decomposable Models Yucheng Xie Fu Feng Jing Wang Jing Wang Yong Rui Xin Geng VLM 36 3 0 14 Aug 2024
Learngene: Inheriting Condensed Knowledge from the Ancestry Model to Descendant Models Qiufeng Wang Xu Yang Shuxia Lin Jing Wang Xin Geng 31 10 0 03 May 2023
Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervision Chao Jia Yinfei Yang Ye Xia Yi-Ting Chen Zarana Parekh Hieu H. Pham Quoc V. Le Yun-hsuan Sung Zhen Li Tom Duerig VLM CLIP 331 3,708 0 11 Feb 2021
BBN: Bilateral-Branch Network with Cumulative Learning for Long-Tailed Visual Recognition Boyan Zhou Quan Cui Xiu-Shen Wei Zhao-Min Chen 253 782 0 05 Dec 2019