SpecHub: Provable Acceleration to Multi-Draft Speculative Decoding

8 November 2024

Papers citing "SpecHub: Provable Acceleration to Multi-Draft Speculative Decoding"

3 / 3 papers shown

Title
Speculative Decoding and Beyond: An In-Depth Survey of Techniques Y. Hu Zining Liu Zhenyuan Dong Tianfan Peng Bradley McDanel Shanghang Zhang 176 0 0 27 Feb 2025
Towards Optimal Multi-draft Speculative Decoding Zhibo Hu Tong Zheng Vignesh Viswanathan Ziyi Chen Ryan Rossi Yihan Wu Dinesh Manocha Heng Huang 111 5 0 26 Feb 2025
EAGLE: Speculative Sampling Requires Rethinking Feature Uncertainty Yuhui Li Fangyun Wei Chao Zhang Hongyang R. Zhang 202 165 0 26 Jan 2024