DySpec: Faster Speculative Decoding with Dynamic Token Tree Structure

15 October 2024

Papers citing "DySpec: Faster Speculative Decoding with Dynamic Token Tree Structure"

3 / 3 papers shown

Title
Token-Driven GammaTune: Adaptive Calibration for Enhanced Speculative Decoding Aayush Gautam Susav Shrestha Narasimha Annapareddy 56 0 0 28 Mar 2025
Speculative Decoding and Beyond: An In-Depth Survey of Techniques Y. Hu Zining Liu Zhenyuan Dong Tianfan Peng Bradley McDanel S. Zhang 93 0 0 27 Feb 2025
Faster Language Models with Better Multi-Token Prediction Using Tensor Decomposition Artem Basharin Andrei Chertkov Ivan Oseledets 48 1 0 23 Oct 2024