ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2406.03853
  4. Cited By
Speculative Decoding via Early-exiting for Faster LLM Inference with
  Thompson Sampling Control Mechanism

Speculative Decoding via Early-exiting for Faster LLM Inference with Thompson Sampling Control Mechanism

6 June 2024
Jiahao Liu
Qifan Wang
Jingang Wang
Xunliang Cai
ArXivPDFHTML

Papers citing "Speculative Decoding via Early-exiting for Faster LLM Inference with Thompson Sampling Control Mechanism"

2 / 2 papers shown
Title
Judge Decoding: Faster Speculative Sampling Requires Going Beyond Model Alignment
Judge Decoding: Faster Speculative Sampling Requires Going Beyond Model Alignment
Gregor Bachmann
Sotiris Anagnostidis
Albert Pumarola
Markos Georgopoulos
A. Sanakoyeu
Yuming Du
Edgar Schönfeld
Ali K. Thabet
Jonas Kohler
ALM
BDL
114
8
0
31 Jan 2025
Constrained Decoding with Speculative Lookaheads
Constrained Decoding with Speculative Lookaheads
Nishanth Nakshatri
Shamik Roy
Rajarshi Das
Suthee Chaidaroon
Leonid Boytsov
Rashmi Gangadharaiah
84
0
0
09 Dec 2024
1