Papers
Communities
Events
Blog
Pricing
Search
Open menu
Home
Papers
2410.00428
Cited By
LayerKV: Optimizing Large Language Model Serving with Layer-wise KV Cache Management
1 October 2024
Yi Xiong
Hao Wu
Changxu Shao
Ziqing Wang
Rui Zhang
Yuhong Guo
Junping Zhao
Ke Zhang
Zhenxuan Pan
Re-assign community
ArXiv
PDF
HTML
Papers citing
"LayerKV: Optimizing Large Language Model Serving with Layer-wise KV Cache Management"
2 / 2 papers shown
Title
Taming the Titans: A Survey of Efficient LLM Inference Serving
Ranran Zhen
J. Li
Yixin Ji
Z. Yang
Tong Liu
Qingrong Xia
Xinyu Duan
Z. Wang
Baoxing Huai
M. Zhang
LLMAG
77
0
0
28 Apr 2025
HeadInfer: Memory-Efficient LLM Inference by Head-wise Offloading
Cheng Luo
Zefan Cai
Hanshi Sun
Jinqi Xiao
Bo Yuan
Wen Xiao
Junjie Hu
Jiawei Zhao
Beidi Chen
Anima Anandkumar
69
1
0
18 Feb 2025
1