FastSwitch: Optimizing Context Switching Efficiency in Fairness-aware Large Language Model Serving

27 November 2024

Papers citing "FastSwitch: Optimizing Context Switching Efficiency in Fairness-aware Large Language Model Serving"

1 / 1 papers shown

Title
Priority-Aware Preemptive Scheduling for Mixed-Priority Workloads in MoE Inference Mohammad Siavashi Faezeh Keshmiri Dindarloo Dejan Kostić Marco Chiesa MoE VLM 50 0 0 13 Mar 2025