HyperRouter: Towards Efficient Training and Inference of Sparse Mixture of Experts

12 December 2023

Papers citing "HyperRouter: Towards Efficient Training and Inference of Sparse Mixture of Experts"

2 / 2 papers shown

Title
Model Selection for Gaussian-gated Gaussian Mixture of Experts Using Dendrograms of Mixing Measures Tuan Thai TrungTin Nguyen Dat Do Nhat Ho Christopher Drovandi 171 0 0 19 May 2025
Layerwise Recurrent Router for Mixture-of-Experts Zihan Qiu Zeyu Huang Shuang Cheng Yizhi Zhou Zili Wang Ivan Titov Jie Fu MoE 149 2 0 13 Aug 2024