Fast yet Safe: Early-Exiting with Risk Control

31 May 2024

Papers citing "Fast yet Safe: Early-Exiting with Risk Control"

31 / 31 papers shown

Title
Adaptive Layer-skipping in Pre-trained LLMs Xuan Luo Weizhi Wang Xifeng Yan 378 1 0 31 Mar 2025
Conformal Risk Control for Ordinal Classification Yunpeng Xu Wenge Guo Zhi Wei 142 6 0 01 May 2024
Adaptive Bounding Box Uncertainties via Two-Step Conformal Prediction Alexander Timans C. Straehle K. Sakmann Eric T. Nalisnick 60 9 0 12 Mar 2024
Prompt Risk Control: A Rigorous Framework for Responsible Deployment of Large Language Models Thomas P. Zollo Todd Morrill Zhun Deng Jake C. Snell T. Pitassi Richard Zemel 68 9 0 22 Nov 2023
Distribution-Free Statistical Dispersion Control for Societal Applications Zhun Deng Thomas P. Zollo Jake C. Snell T. Pitassi R. Zemel 43 5 0 25 Sep 2023
Towards Anytime Classification in Early-Exit Architectures by Enforcing Conditional Monotonicity Metod Jazbec J. Allingham Dan Zhang Eric T. Nalisnick 38 11 0 05 Jun 2023
Fixing Overconfidence in Dynamic Neural Networks Lassi Meronen Martin Trapp Andrea Pilzer Le Yang Arno Solin BDL 63 16 0 13 Feb 2023
What's Behind the Mask: Estimating Uncertainty in Image-to-Image Problems Gilad Kutiel Regev Cohen Michael Elad Daniel Freedman UQCV 76 5 0 28 Nov 2022
All are Worth Words: A ViT Backbone for Diffusion Models Fan Bao Shen Nie Kaiwen Xue Yue Cao Chongxuan Li Hang Su Jun Zhu VLM 83 349 0 25 Sep 2022
Conformal Risk Control Anastasios Nikolas Angelopoulos Stephen Bates Adam Fisch Lihua Lei Tal Schuster 157 136 0 04 Aug 2022
Semantic uncertainty intervals for disentangled latent spaces S. Sankaranarayanan Anastasios Nikolas Angelopoulos Stephen Bates Yaniv Romano Phillip Isola UQCV 92 21 0 20 Jul 2022
Image-to-Image Regression with Distribution-Free Uncertainty Quantification and Applications in Imaging Anastasios Nikolas Angelopoulos Amit Kohli Stephen Bates Michael I. Jordan Jitendra Malik Thayer Alshaabi Srigokul Upadhyayula Yaniv Romano UQCV OOD 72 95 0 10 Feb 2022
Learn then Test: Calibrating Predictive Algorithms to Achieve Risk Control Anastasios Nikolas Angelopoulos Stephen Bates Emmanuel J. Candès Michael I. Jordan Lihua Lei 222 132 0 03 Oct 2021
Zero Time Waste: Recycling Predictions in Early Exit Neural Networks Maciej Wołczyk Bartosz Wójcik Klaudia Bałazy Igor T. Podolak Jacek Tabor Marek Śmieja Tomasz Trzciñski AI4CE 50 50 0 09 Jun 2021
Not All Images are Worth 16x16 Words: Dynamic Transformers for Efficient Image Recognition Yulin Wang Rui Huang S. Song Zeyi Huang Gao Huang ViT 68 193 0 31 May 2021
Carbon Emissions and Large Neural Network Training David A. Patterson Joseph E. Gonzalez Quoc V. Le Chen Liang Lluís-Miquel Munguía D. Rothchild David R. So Maud Texier J. Dean AI4CE 331 667 0 21 Apr 2021
Consistent Accelerated Inference via Confident Adaptive Transformers Tal Schuster Adam Fisch Tommi Jaakkola Regina Barzilay AI4TS 220 72 0 18 Apr 2021
Dynamic Neural Networks: A Survey Yizeng Han Gao Huang Shiji Song Le Yang Honghui Wang Yulin Wang 3DH AI4TS AI4CE 87 645 0 09 Feb 2021
Distribution-Free, Risk-Controlling Prediction Sets Stephen Bates Anastasios Nikolas Angelopoulos Lihua Lei Jitendra Malik Michael I. Jordan OOD 237 196 0 07 Jan 2021
Estimating means of bounded random variables by betting Ian Waudby-Smith Aaditya Ramdas 81 159 0 19 Oct 2020
Learning to Stop While Learning to Predict Xinshi Chen H. Dai Yu Li Xin Gao Le Song OOD 41 47 0 09 Jun 2020
BERT Loses Patience: Fast and Robust Inference with Early Exit Wangchunshu Zhou Canwen Xu Tao Ge Julian McAuley Ke Xu Furu Wei 45 341 0 07 Jun 2020
PAC Confidence Sets for Deep Neural Networks via Calibrated Prediction Sangdon Park Osbert Bastani Nikolai Matni Insup Lee UQCV 207 70 0 31 Dec 2019
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer Colin Raffel Noam M. Shazeer Adam Roberts Katherine Lee Sharan Narang Michael Matena Yanqi Zhou Wei Li Peter J. Liu AIMat 369 20,053 0 23 Oct 2019
Deep High-Resolution Representation Learning for Visual Recognition Jingdong Wang Ke Sun Tianheng Cheng Borui Jiang Chaorui Deng ... Yadong Mu Mingkui Tan Xinggang Wang Wenyu Liu Bin Xiao 366 3,602 0 20 Aug 2019
The Unreasonable Effectiveness of Deep Features as a Perceptual Metric Richard Y. Zhang Phillip Isola Alexei A. Efros Eli Shechtman Oliver Wang EGVM 327 11,734 0 11 Jan 2018
Adaptive Neural Networks for Efficient Inference Tolga Bolukbasi Joseph Wang O. Dekel Venkatesh Saligrama 49 355 0 25 Feb 2017
SQuAD: 100,000+ Questions for Machine Comprehension of Text Pranav Rajpurkar Jian Zhang Konstantin Lopyrev Percy Liang RALM 231 8,113 0 16 Jun 2016
The Cityscapes Dataset for Semantic Urban Scene Understanding Marius Cordts Mohamed Omran Sebastian Ramos Timo Rehfeld Markus Enzweiler Rodrigo Benenson Uwe Franke Stefan Roth Bernt Schiele 938 11,587 0 06 Apr 2016
Teaching Machines to Read and Comprehend Karl Moritz Hermann Tomás Kociský Edward Grefenstette L. Espeholt W. Kay Mustafa Suleyman Phil Blunsom 321 3,538 0 10 Jun 2015
A tutorial on conformal prediction Glenn Shafer V. Vovk 384 1,135 0 21 Jun 2007