ResearchTrend.AI
Towards Coarse-to-Fine Evaluation of Inference Efficiency for Large Language Models

Towards Coarse-to-Fine Evaluation of Inference Efficiency for Large Language Models

Yushuo Chen
Tianyi Tang
Erge Xiang
Linjiang Li
Wayne Xin Zhao
Jing Wang
Yunpeng Chai
Ji-Rong Wen
ArXiv (abs)PDFHTML

Papers citing "Towards Coarse-to-Fine Evaluation of Inference Efficiency for Large Language Models"

1 / 1 papers shown
Title
Full Stack Optimization of Transformer Inference: a Survey
Full Stack Optimization of Transformer Inference: a Survey
Sehoon Kim
Coleman Hooper
Thanakul Wattanawong
Minwoo Kang
Ruohan Yan
...
Qijing Huang
Kurt Keutzer
Michael W. Mahoney
Y. Shao
A. Gholami
MQ
124
104
0
27 Feb 2023

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.