Papers
Communities
Events
Blog
Pricing
Search
Open menu
Home
Papers
2406.03853
Cited By
Speculative Decoding via Early-exiting for Faster LLM Inference with Thompson Sampling Control Mechanism
6 June 2024
Jiahao Liu
Qifan Wang
Jingang Wang
Xunliang Cai
Re-assign community
ArXiv
PDF
HTML
Papers citing
"Speculative Decoding via Early-exiting for Faster LLM Inference with Thompson Sampling Control Mechanism"
2 / 2 papers shown
Title
Judge Decoding: Faster Speculative Sampling Requires Going Beyond Model Alignment
Gregor Bachmann
Sotiris Anagnostidis
Albert Pumarola
Markos Georgopoulos
A. Sanakoyeu
Yuming Du
Edgar Schönfeld
Ali K. Thabet
Jonas Kohler
ALM
BDL
114
8
0
31 Jan 2025
Constrained Decoding with Speculative Lookaheads
Nishanth Nakshatri
Shamik Roy
Rajarshi Das
Suthee Chaidaroon
Leonid Boytsov
Rashmi Gangadharaiah
84
0
0
09 Dec 2024
1