SMILE: Scaling Mixture-of-Experts with Efficient Bi-level Routing

10 December 2022

George Karypis

Salman Avestimehr

Papers citing "SMILE: Scaling Mixture-of-Experts with Efficient Bi-level Routing"

2 / 2 papers shown

Title
Provable Pathways: Learning Multiple Tasks over Multiple Paths Yingcong Li Samet Oymak MoE 29 4 0 08 Mar 2023
Carbon Emissions and Large Neural Network Training David A. Patterson Joseph E. Gonzalez Quoc V. Le Chen Liang Lluís-Miquel Munguía D. Rothchild David R. So Maud Texier J. Dean AI4CE 253 645 0 21 Apr 2021