When Does Confidence-Based Cascade Deferral Suffice?

v1v2 (latest)

When Does Confidence-Based Cascade Deferral Suffice?

6 July 2023

Wittawat Jitkrittum

Harikrishna Narasimhan

ArXiv (abs)PDF HTML

Papers citing "When Does Confidence-Based Cascade Deferral Suffice?"

8 / 8 papers shown

Title
Detecting High-Stakes Interactions with Activation Probes Alex McKenzie Urja Pawar Phil Blandfort William Bankes David M. Krueger Ekdeep Singh Lubana Dmitrii Krasheninnikov 131 0 0 12 Jun 2025
Harnessing Multiple Large Language Models: A Survey on LLM Ensemble Zhijun Chen Jingzheng Li Pengpeng Chen Zhuoran Li Kai Sun Yuankai Luo Qianren Mao Dingqi Yang Hailong Sun Philip S. Yu ELM 132 20 0 25 Feb 2025
Cost-Saving LLM Cascades with Early Abstention Michael J. Zellinger Rex Liu Matt Thomson 147 2 0 13 Feb 2025
A Unified Approach to Routing and Cascading for LLMs Jasper Dekoninck Maximilian Baader Martin Vechev 136 2 0 14 Oct 2024
Rejection via Learning Density Ratios Alexander Soen Hisham Husain Philip Schulz Vu-Linh Nguyen 135 2 0 29 May 2024
Language Model Cascades: Token-level uncertainty and beyond Neha Gupta Harikrishna Narasimhan Wittawat Jitkrittum A. S. Rawat A. Menon Sanjiv Kumar UQLM 138 56 0 15 Apr 2024
SMART: Automatically Scaling Down Language Models with Accuracy Guarantees for Reduced Processing Fees Saehan Jo Immanuel Trummer 49 0 0 11 Mar 2024
Think before you speak: Training Language Models With Pause Tokens Sachin Goyal Ziwei Ji A. S. Rawat A. Menon Sanjiv Kumar Vaishnavh Nagarajan LRM 111 122 0 03 Oct 2023