SLOs-Serve: Optimized Serving of Multi-SLO LLMs

5 April 2025

Papers citing "SLOs-Serve: Optimized Serving of Multi-SLO LLMs"

2 / 2 papers shown

Title
Prism: Unleashing GPU Sharing for Cost-Efficient Multi-LLM Serving Shan Yu Jiarong Xing Yifan Qiao Mingyuan Ma Y. Li ... Shiyi Cao Ke Bao Ion Stoica Harry Xu Ying Sheng 36 0 0 06 May 2025
Patchwork: A Unified Framework for RAG Serving Bodun Hu Luis Pabon Saurabh Agarwal Aditya Akella 26 0 0 01 May 2025