Learn then Test: Calibrating Predictive Algorithms to Achieve Risk Control

3 October 2021

Anastasios Nikolas Angelopoulos

Emmanuel J. Candès

Papers citing "Learn then Test: Calibrating Predictive Algorithms to Achieve Risk Control"

33 / 33 papers shown

Title
Conformal Calibration: Ensuring the Reliability of Black-Box AI in Wireless Systems Osvaldo Simeone Sangwoo Park Matteo Zecchin 120 0 0 12 Apr 2025
FaiREE: Fair Classification with Finite-Sample and Distribution-Free Guarantee Puheng Li James Y. Zou Linjun Zhang FaML 88 4 0 13 Mar 2025
Multi-Objective Hyperparameter Selection via Hypothesis Testing on Reliability Graphs Amirmohammad Farzaneh Osvaldo Simeone 86 0 0 22 Jan 2025
Conformal Structured Prediction Botong Zhang Shuo Li Osbert Bastani 35 0 0 08 Oct 2024
Conformal Generative Modeling with Improved Sample Efficiency through Sequential Greedy Filtering K. K. Bernhard Schölkopf Michael Muehlebach 30 0 0 02 Oct 2024
Adaptive Learn-then-Test: Statistically Valid and Efficient Hyperparameter Selection Matteo Zecchin Sangwoo Park Osvaldo Simeone LM&MA 72 3 0 24 Sep 2024
Stratified Prediction-Powered Inference for Hybrid Language Model Evaluation Adam Fisch Joshua Maynez R. A. Hofer Bhuwan Dhingra Amir Globerson William W. Cohen 38 7 0 06 Jun 2024
Conformal Alignment: Knowing When to Trust Foundation Models with Guarantees Yu Gui Ying Jin Zhimei Ren MedIm 38 18 0 16 May 2024
Conformal Semantic Image Segmentation: Post-hoc Quantification of Predictive Uncertainty Luca Mossina Joseba Dalmau Léo Andéol UQCV 40 12 0 16 Apr 2024
Hallucination Detection in Foundation Models for Decision-Making: A Flexible Definition and Review of the State of the Art Neeloy Chakraborty Melkior Ornik Katherine Driggs-Campbell LRM 57 9 0 25 Mar 2024
Prompt Risk Control: A Rigorous Framework for Responsible Deployment of Large Language Models Thomas P. Zollo Todd Morrill Zhun Deng Jake C. Snell T. Pitassi Richard Zemel 43 8 0 22 Nov 2023
On the Out-of-Distribution Coverage of Combining Split Conformal Prediction and Bayesian Deep Learning Paul Scemama Ariel Kapusta 40 0 0 21 Nov 2023
Empirically Validating Conformal Prediction on Modern Vision Architectures Under Distribution Shift and Long-tailed Data Kevin Kasa Graham W. Taylor 32 2 0 03 Jul 2023
Federated Conformal Predictors for Distributed Uncertainty Quantification Charles Lu Yaodong Yu Sai Praneeth Karimireddy Michael I. Jordan Ramesh Raskar FedML 34 21 0 27 May 2023
Confident Object Detection via Conformal Prediction and Conformal Risk Control: an Application to Railway Signaling Léo Andéol Thomas Fel F. D. Grancey Luca Mossina 21 11 0 12 Apr 2023
Quantum Conformal Prediction for Reliable Uncertainty Quantification in Quantum Machine Learning Sangwoo Park Osvaldo Simeone 24 9 0 06 Apr 2023
Improved Online Conformal Prediction via Strongly Adaptive Online Learning Aadyot Bhatnagar Haiquan Wang Caiming Xiong Yu Bai AI4TS 33 47 0 15 Feb 2023
How to Trust Your Diffusion Model: A Convex Optimization Approach to Conformal Risk Control Jacopo Teneggi Matthew Tivnan J. W. Stayman Jeremias Sulam DiffM 35 28 0 07 Feb 2023
Loss-Controlling Calibration for Predictive Models Di Wang Junzhi Shi Pingping Wang Shuo Zhuang Hongyue Li 21 0 0 11 Jan 2023
Conformal Loss-Controlling Prediction Di Wang Pingping Wang Zhong Ji Xiaojun Yang Hongyue Li 31 1 0 06 Jan 2023
Distribution-Free Finite-Sample Guarantees and Split Conformal Prediction Roel Hulsman 16 5 0 26 Oct 2022
Efficiently Controlling Multiple Risks with Pareto Testing Bracha Laufer-Goldshtein Adam Fisch Regina Barzilay Tommi Jaakkola 36 16 0 14 Oct 2022
MAPIE: an open-source library for distribution-free uncertainty quantification V. Taquet Vincent Blot Thomas Morzadec L. Lacombe Nicolas Brunel UQCV 23 17 0 25 Jul 2022
Semantic uncertainty intervals for disentangled latent spaces S. Sankaranarayanan Anastasios Nikolas Angelopoulos Stephen Bates Yaniv Romano Phillip Isola UQCV 25 21 0 20 Jul 2022
Recommendation Systems with Distribution-Free Reliability Guarantees Anastasios Nikolas Angelopoulos K. Krauth Stephen Bates Yixin Wang Michael I. Jordan 35 12 0 04 Jul 2022
T-Cal: An optimal test for the calibration of predictive models Donghwan Lee Xinmeng Huang Hamed Hassani Edgar Dobriban 22 20 0 03 Mar 2022
PAC Prediction Sets Under Covariate Shift Sangdon Park Edgar Dobriban Insup Lee Osbert Bastani 27 42 0 17 Jun 2021
Consistent Accelerated Inference via Confident Adaptive Transformers Tal Schuster Adam Fisch Tommi Jaakkola Regina Barzilay AI4TS 184 69 0 18 Apr 2021
Few-shot Conformal Prediction with Auxiliary Tasks Adam Fisch Tal Schuster Tommi Jaakkola Regina Barzilay 181 53 0 17 Feb 2021
Distribution-Free, Risk-Controlling Prediction Sets Stephen Bates Anastasios Nikolas Angelopoulos Lihua Lei Jitendra Malik Michael I. Jordan OOD 181 186 0 07 Jan 2021
PAC Confidence Sets for Deep Neural Networks via Calibrated Prediction Sangdon Park Osbert Bastani Nikolai Matni Insup Lee UQCV 136 68 0 31 Dec 2019
Cross-conformal predictors V. Vovk 131 196 0 03 Aug 2012
An asymptotically Gaussian bound on the Rademacher tails I. Pinelis 89 26 0 13 Jul 2010