Statistical Perspective of Top-K Sparse Softmax Gating Mixture of
Experts

Statistical Perspective of Top-K Sparse Softmax Gating Mixture of Experts

25 September 2023

Huy Nguyen

Pedram Akbarian

Papers citing "Statistical Perspective of Top-K Sparse Softmax Gating Mixture of Experts"

5 / 5 papers shown

Title
A Comprehensive Survey of Mixture-of-Experts: Algorithms, Theory, and Applications Siyuan Mu Sen Lin MoE 126 1 0 10 Mar 2025
Swift Hydra: Self-Reinforcing Generative Framework for Anomaly Detection with Multiple Mamba Models Nguyen H K. Do Truc Nguyen Malik Hassanaly Raed Alharbi Jung Taek Seo My T. Thai 51 0 0 09 Mar 2025
Quadratic Gating Functions in Mixture of Experts: A Statistical Insight Pedram Akbarian Huy Le Nguyen Xing Han Nhat Ho MoE 42 0 0 15 Oct 2024
FuseMoE: Mixture-of-Experts Transformers for Fleximodal Fusion Xing Han Huy Nguyen Carl Harris Nhat Ho S. Saria MoE 77 16 0 05 Feb 2024
A General Theory for Softmax Gating Multinomial Logistic Mixture of Experts Huy Nguyen Pedram Akbarian TrungTin Nguyen Nhat Ho 32 10 0 22 Oct 2023