v1v2 (latest)

Stability and Deviation Optimal Risk Bounds with Convergence Rate $O(1/n)$

22 March 2021

Papers citing "Stability and Deviation Optimal Risk Bounds with Convergence Rate $O(1/n)$"

27 / 27 papers shown

Title
Faster WIND: Accelerating Iterative Best-of- $N$ Distillation for LLM Alignment Tong Yang Jincheng Mei H. Dai Zixin Wen Shicong Cen Dale Schuurmans Yuejie Chi Bo Dai 118 4 0 20 Feb 2025
Learning Variational Inequalities from Data: Fast Generalization Rates under Strong Monotonicity Eric Zhao Tatjana Chavdarova Michael I. Jordan 105 0 0 20 Feb 2025
Distribution-Free Robust Linear Regression Jaouad Mourtada Tomas Vaskevicius Nikita Zhivotovskiy OOD 64 24 0 25 Feb 2021
SGD Generalizes Better Than GD (And Regularization Doesn't Help) I Zaghloul Amir Tomer Koren Roi Livni 50 46 0 01 Feb 2021
Stable Sample Compression Schemes: New Applications and an Optimal SVM Margin Bound Steve Hanneke A. Kontorovich 123 27 0 09 Nov 2020
Suboptimality of Constrained Least Squares and Improvements via Non-Linear Predictors Tomas Vaskevicius Nikita Zhivotovskiy 40 14 0 19 Sep 2020
Stability of Stochastic Gradient Descent on Nonsmooth Convex Losses Raef Bassily Vitaly Feldman Cristóbal Guzmán Kunal Talwar MLT 54 198 0 12 Jun 2020
Proper Learning, Helly Number, and an Optimal SVM Bound Olivier Bousquet Steve Hanneke Shay Moran Nikita Zhivotovskiy 115 53 0 24 May 2020
An improper estimator with optimal excess risk in misspecified density estimation and logistic regression Jaouad Mourtada Stéphane Gaïffas 82 29 0 23 Dec 2019
Sharper bounds for uniformly stable algorithms Olivier Bousquet Yegor Klochkov Nikita Zhivotovskiy 64 122 0 17 Oct 2019
High probability generalization bounds for uniformly stable algorithms with nearly optimal rate Vitaly Feldman J. Vondrák 70 155 0 27 Feb 2019
Stochastic Approximation of Smooth and Strongly Convex Functions: Beyond the $O(1/T)$ Convergence Rate Lijun Zhang Zhi Zhou 99 30 0 27 Jan 2019
Generalization Bounds for Uniformly Stable Algorithms Vitaly Feldman J. Vondrák 52 89 0 24 Dec 2018
Tight Analyses for Non-Smooth Stochastic Gradient Descent Nicholas J. A. Harvey Christopher Liaw Y. Plan Sikander Randhawa 55 138 0 13 Dec 2018
Fast Rates of ERM and Stochastic Approximation: Adaptive to Error Bound Conditions Mingrui Liu Xiaoxuan Zhang Lijun Zhang Rong Jin Tianbao Yang 70 25 0 11 May 2018
Stability and Generalization of Learning Algorithms that Converge to Global Optima Zachary B. Charles Dimitris Papailiopoulos MLT 40 163 0 23 Oct 2017
Optimal learning via local entropies and sample compression Nikita Zhivotovskiy 66 15 0 04 Jun 2017
Data-Dependent Stability of Stochastic Gradient Descent Ilja Kuzborskij Christoph H. Lampert MLT 113 166 0 05 Mar 2017
Algorithmic stability and hypothesis complexity Tongliang Liu Gábor Lugosi Gergely Neu Dacheng Tao 54 92 0 28 Feb 2017
Empirical Risk Minimization for Stochastic Convex Optimization: $O(1/n)$ - and $O(1/n^2)$ -type of Risk Bounds Lijun Zhang Tianbao Yang Rong Jin 52 48 0 07 Feb 2017
Linear Convergence of Gradient and Proximal-Gradient Methods Under the Polyak-Łojasiewicz Condition Hamed Karimi J. Nutini Mark Schmidt 280 1,221 0 16 Aug 2016
Generalization of ERM in Stochastic Convex Optimization: The Dimension Strikes Back Vitaly Feldman 45 69 0 15 Aug 2016
Average Stability is Invariant to Data Preconditioning. Implications to Exp-concave Empirical Risk Minimization Alon Gonen Shai Shalev-Shwartz 41 25 0 15 Jan 2016
Train faster, generalize better: Stability of stochastic gradient descent Moritz Hardt Benjamin Recht Y. Singer 116 1,243 0 03 Sep 2015
Fast rates in statistical and online learning T. Erven Peter Grünwald Nishant A. Mehta Mark D. Reid Robert C. Williamson 171 109 0 09 Jul 2015
Non-strongly-convex smooth stochastic approximation with convergence rate O(1/n) Francis R. Bach Eric Moulines 96 405 0 10 Jun 2013
Making Gradient Descent Optimal for Strongly Convex Stochastic Optimization Alexander Rakhlin Ohad Shamir Karthik Sridharan 171 768 0 26 Sep 2011

Stability and Deviation Optimal Risk Bounds with Convergence Rate O(1/n)O(1/n)O(1/n)

Papers citing "Stability and Deviation Optimal Risk Bounds with Convergence Rate $O(1/n)$"

Stability and Deviation Optimal Risk Bounds with Convergence Rate $O(1/n)$