ResearchTrend.AI
EFIM: Efficient Serving of LLMs for Infilling Tasks with Improved KV Cache Reuse
v1v2 (latest)

EFIM: Efficient Serving of LLMs for Infilling Tasks with Improved KV Cache Reuse

Tianyu Guo
Hande Dong
Yichong Leng
Feng Liu
Cheater Lin
Nong Xiao
X. Zhang
    RALM
ArXiv (abs)PDFHTML

Papers citing "EFIM: Efficient Serving of LLMs for Infilling Tasks with Improved KV Cache Reuse"

Title
No papers