Efficient Serving of LLM Applications with Probabilistic Demand Modeling

Efficient Serving of LLM Applications with Probabilistic Demand Modeling

17 June 2025

Yifei Liu

Zuo Gan

Zhenghao Gan

Weiye Wang

Chen Chen

Yizhou Shan

Xusheng Chen

Zhenhua Han

Yifei Zhu

Shixuan Sun

Minyi Guo

ArXiv (abs)PDF HTML

Papers citing "Efficient Serving of LLM Applications with Probabilistic Demand Modeling"

Title
No papers