ME-Switch: A Memory-Efficient Expert Switching Framework for Large Language Models

13 June 2024

Jianfei Cai

Papers citing "ME-Switch: A Memory-Efficient Expert Switching Framework for Large Language Models"

1 / 1 papers shown

Title
FlexGen: High-Throughput Generative Inference of Large Language Models with a Single GPU Ying Sheng Lianmin Zheng Binhang Yuan Zhuohan Li Max Ryabinin ... Joseph E. Gonzalez Percy Liang Christopher Ré Ion Stoica Ce Zhang 149 369 0 13 Mar 2023