ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2505.21460
19
0

High-Dimensional Calibration from Swap Regret

27 May 2025
Maxwell Fishelson
Noah Golowich
M. Mohri
Jon Schneider
ArXivPDFHTML
Abstract

We study the online calibration of multi-dimensional forecasts over an arbitrary convex set P⊂Rd\mathcal{P} \subset \mathbb{R}^dP⊂Rd relative to an arbitrary norm ∥⋅∥\Vert\cdot\Vert∥⋅∥. We connect this with the problem of external regret minimization for online linear optimization, showing that if it is possible to guarantee O(ρT)O(\sqrt{\rho T})O(ρT​) worst-case regret after TTT rounds when actions are drawn from P\mathcal{P}P and losses are drawn from the dual ∥⋅∥∗\Vert \cdot \Vert_*∥⋅∥∗​ unit norm ball, then it is also possible to obtain ϵ\epsilonϵ-calibrated forecasts after T=exp⁡(O(ρ/ϵ2))T = \exp(O(\rho /\epsilon^2))T=exp(O(ρ/ϵ2)) rounds. When P\mathcal{P}P is the ddd-dimensional simplex and ∥⋅∥\Vert \cdot \Vert∥⋅∥ is the ℓ1\ell_1ℓ1​-norm, the existence of O(Tlog⁡d)O(\sqrt{T\log d})O(Tlogd​)-regret algorithms for learning with experts implies that it is possible to obtain ϵ\epsilonϵ-calibrated forecasts after T=exp⁡(O(log⁡d/ϵ2))=dO(1/ϵ2)T = \exp(O(\log{d}/\epsilon^2)) = d^{O(1/\epsilon^2)}T=exp(O(logd/ϵ2))=dO(1/ϵ2) rounds, recovering a recent result of Peng (2025).Interestingly, our algorithm obtains this guarantee without requiring access to any online linear optimization subroutine or knowledge of the optimal rate ρ\rhoρ -- in fact, our algorithm is identical for every setting of P\mathcal{P}P and ∥⋅∥\Vert \cdot \Vert∥⋅∥. Instead, we show that the optimal regularizer for the above OLO problem can be used to upper bound the above calibration error by a swap regret, which we then minimize by running the recent TreeSwap algorithm with Follow-The-Leader as a subroutine.Finally, we prove that any online calibration algorithm that guarantees ϵT\epsilon TϵT ℓ1\ell_1ℓ1​-calibration error over the ddd-dimensional simplex requires T≥exp⁡(poly(1/ϵ))T \geq \exp(\mathrm{poly}(1/\epsilon))T≥exp(poly(1/ϵ)) (assuming d≥poly(1/ϵ)d \geq \mathrm{poly}(1/\epsilon)d≥poly(1/ϵ)). This strengthens the corresponding dΩ(log⁡1/ϵ)d^{\Omega(\log{1/\epsilon})}dΩ(log1/ϵ) lower bound of Peng, and shows that an exponential dependence on 1/ϵ1/\epsilon1/ϵ is necessary.

View on arXiv
@article{fishelson2025_2505.21460,
  title={ High-Dimensional Calibration from Swap Regret },
  author={ Maxwell Fishelson and Noah Golowich and Mehryar Mohri and Jon Schneider },
  journal={arXiv preprint arXiv:2505.21460},
  year={ 2025 }
}
Comments on this paper