ResearchTrend.AI
Edge Intelligence Optimization for Large Language Model Inference with Batching and Quantization

Edge Intelligence Optimization for Large Language Model Inference with Batching and Quantization

Xinyuan Zhang
Jiang Liu
Zehui Xiong
Yudong Huang
Gaochang Xie
Ran Zhang
ArXiv (abs)PDFHTML

Papers citing "Edge Intelligence Optimization for Large Language Model Inference with Batching and Quantization"

3 / 3 papers shown
Title
Regulating ChatGPT and other Large Generative AI Models
Regulating ChatGPT and other Large Generative AI Models
P. Hacker
A. Engel
M. Mauer
AILaw
79
345
0
05 Feb 2023
Edge AI: On-Demand Accelerating Deep Neural Network Inference via Edge Computing
Edge AI: On-Demand Accelerating Deep Neural Network Inference via Edge Computing
En Li
Liekang Zeng
Zhi Zhou
Xu Chen
54
628
0
04 Oct 2019
Edge Intelligence: Paving the Last Mile of Artificial Intelligence with Edge Computing
Edge Intelligence: Paving the Last Mile of Artificial Intelligence with Edge Computing
Zhi Zhou
Xu Chen
En Li
Liekang Zeng
Ke Luo
Junshan Zhang
93
1,439
0
24 May 2019

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.