v1v2 (latest)

Model Selection for Gaussian-gated Gaussian Mixture of Experts Using Dendrograms of Mixing Measures

19 May 2025

Papers citing "Model Selection for Gaussian-gated Gaussian Mixture of Experts Using Dendrograms of Mixing Measures"

26 / 26 papers shown

Title
CAMEx: Curvature-aware Merging of Experts Dung V. Nguyen Minh H. Nguyen Luc Q. Nguyen R. Teo T. Nguyen Linh Duy Tran MoMe 139 4 0 26 Feb 2025
Lory: Fully Differentiable Mixture-of-Experts for Autoregressive Language Model Pre-training Zexuan Zhong Mengzhou Xia Danqi Chen Mike Lewis MoE 85 18 0 06 May 2024
Risk Bounds for Mixture Density Estimation on Compact Domains via the $h$ -Lifted Kullback--Leibler Divergence Mark Chiu Chong Hien Nguyen TrungTin Nguyen 38 1 0 19 Apr 2024
CompeteSMoE -- Effective Training of Sparse Mixture of Experts via Competition Quang Pham Giang Do Huy Nguyen TrungTin Nguyen Chenghao Liu ... Binh T. Nguyen Savitha Ramasamy Xiaoli Li Steven C. H. Hoi Nhat Ho 52 20 0 04 Feb 2024
HyperRouter: Towards Efficient Training and Inference of Sparse Mixture of Experts Giang Do Le Khiem Quang Pham TrungTin Nguyen Thanh-Nam Doan Binh T. Nguyen Chenghao Liu Savitha Ramasamy Xiaoli Li Steven C. H. Hoi MoE 31 13 0 12 Dec 2023
A General Theory for Softmax Gating Multinomial Logistic Mixture of Experts Huy Nguyen Pedram Akbarian TrungTin Nguyen Nhat Ho 90 14 0 22 Oct 2023
Merging Experts into One: Improving Computational Efficiency of Mixture of Experts Shwai He Run-Ze Fan Liang Ding Li Shen Dinesh Manocha Dacheng Tao MoE MoMe 74 17 0 15 Oct 2023
Merge, Then Compress: Demystify Efficient SMoE with Hints from Its Routing Policy Pingzhi Li Zhenyu Zhang Prateek Yadav Yi-Lin Sung Yu Cheng Mohit Bansal Tianlong Chen MoMe 69 39 0 02 Oct 2023
Towards Convergence Rates for Parameter Estimation in Gaussian-gated Mixture of Experts Huy Nguyen TrungTin Nguyen Khai Nguyen Nhat Ho MoE 95 14 0 12 May 2023
Strong identifiability and parameter learning in regression with heterogeneous response Dat Do Linh Do X. Nguyen 38 4 0 08 Dec 2022
Refined Convergence Rates for Maximum Likelihood Estimation under Finite Mixture Models Tudor Manole Nhat Ho 38 22 0 17 Feb 2022
Non-asymptotic model selection in block-diagonal mixture of polynomial experts models TrungTin Nguyen Faicel Chamroukhi Hien Nguyen F. Forbes 18 9 0 18 Apr 2021
A non-asymptotic approach for model selection via penalization in high-dimensional mixture of experts models TrungTin Nguyen Hien Nguyen Faicel Chamroukhi F. Forbes 42 13 0 06 Apr 2021
Approximations of conditional probability density functions in Lebesgue spaces via mixture of experts models Hien Nguyen TrungTin Nguyen Faicel Chamroukhi Geoffrey J. McLachlan 28 22 0 04 Dec 2020
Non-asymptotic oracle inequalities for the Lasso in high-dimensional mixture of experts TrungTin Nguyen Hien Nguyen Faicel Chamroukhi Geoffrey J. McLachlan 53 2 0 22 Sep 2020
Convergence Rates for Gaussian Mixtures of Experts Nhat Ho Chiao-Yu Yang Michael I. Jordan 57 43 0 09 Jul 2019
Approximation by finite mixtures of continuous density functions that vanish at infinity TrungTin Nguyen Hien Nguyen Faicel Chamroukhi Geoffrey J. McLachlan 54 74 0 01 Mar 2019
On posterior contraction of parameters and interpretability in Bayesian mixture modeling Aritra Guha Nhat Ho X. Nguyen 60 57 0 15 Jan 2019
Model Selection for Mixture Models - Perspectives and Strategies G. Celeux Sylvia Fruewirth-Schnatter Christian P. Robert 46 48 0 24 Dec 2018
Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer Noam M. Shazeer Azalia Mirhoseini Krzysztof Maziarz Andy Davis Quoc V. Le Geoffrey E. Hinton J. Dean MoE 253 2,692 0 23 Jan 2017
Singularity structures and impacts on parameter estimation in finite mixtures of distributions Nhat Ho X. Nguyen 52 25 0 09 Sep 2016
A Universal Approximation Theorem for Mixture of Experts Models Hien Nguyen Luke R. Lloyd‐Jones Geoffrey J. McLachlan 60 41 0 11 Feb 2016
High-Dimensional Regression with Gaussian Mixtures and Partially-Latent Response Variables Antoine Deleforge F. Forbes Radu Horaud 53 84 0 10 Aug 2013
Adaptive Bayesian multivariate density estimation with Dirichlet mixtures Weining Shen S. Tokdar S. Ghosal 103 144 0 29 Sep 2011
Convergence of latent mixing measures in finite and infinite mixture models X. Nguyen 120 185 0 15 Sep 2011
Extended Bayesian Information Criteria for Gaussian Graphical Models Rina Foygel Mathias Drton 178 870 0 30 Nov 2010