Judge Decoding: Faster Speculative Sampling Requires Going Beyond Model Alignment

31 January 2025

Papers citing "Judge Decoding: Faster Speculative Sampling Requires Going Beyond Model Alignment"

4 / 4 papers shown

Title
Alignment-Augmented Speculative Decoding with Alignment Sampling and Conditional Verification Jikai Wang Zhenxu Tian Juntao Li Qingrong Xia Xinyu Duan Zhefeng Wang Baoxing Huai Min Zhang 7 0 0 19 May 2025
FLASH: Latent-Aware Semi-Autoregressive Speculative Decoding for Multimodal Tasks Zihua Wang Ruibo Li Haozhe Du Joey Tianyi Zhou Yu Zhang Xu Yang MLLM 17 0 0 19 May 2025
Fuzzy Speculative Decoding for a Tunable Accuracy-Runtime Tradeoff Maximilian Holsman Yukun Huang Bhuwan Dhingra 46 0 0 28 Feb 2025
Speculative Decoding and Beyond: An In-Depth Survey of Techniques Y. Hu Zining Liu Zhenyuan Dong Tianfan Peng Bradley McDanel S. Zhang 93 0 0 27 Feb 2025