ResearchTrend.AI
Adaptive Draft-Verification for Efficient Large Language Model Decoding
v1v2 (latest)

Adaptive Draft-Verification for Efficient Large Language Model Decoding

Xukun Liu
Bowen Lei
Ruqi Zhang
Dongkuan Xu
ArXiv (abs)PDFHTML

Papers citing "Adaptive Draft-Verification for Efficient Large Language Model Decoding"

2 / 2 papers shown
Title
Advancing Decoding Strategies: Enhancements in Locally Typical Sampling for LLMs
Advancing Decoding Strategies: Enhancements in Locally Typical Sampling for LLMs
Jaydip Sen
Saptarshi Sengupta
S. Dasgupta
29
0
0
03 Jun 2025
EAGLE: Speculative Sampling Requires Rethinking Feature Uncertainty
EAGLE: Speculative Sampling Requires Rethinking Feature Uncertainty
Yuhui Li
Fangyun Wei
Chao Zhang
Hongyang R. Zhang
152
165
0
26 Jan 2024

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.