High probability generalization bounds for uniformly stable algorithms with nearly optimal rate

27 February 2019

Papers citing "High probability generalization bounds for uniformly stable algorithms with nearly optimal rate"

50 / 103 papers shown

Title
Stability and Risk Bounds of Iterative Hard Thresholding Xiao-Tong Yuan P. Li 37 12 0 17 Mar 2022
Benign Underfitting of Stochastic Gradient Descent Tomer Koren Roi Livni Yishay Mansour Uri Sherman MLT 20 13 0 27 Feb 2022
On the bias of K-fold cross validation with stable learners Anass Aghbalou François Portier Anne Sabourin 17 6 0 21 Feb 2022
Black-Box Generalization: Stability of Zeroth-Order Learning Konstantinos E. Nikolakakis Farzin Haddadpour Dionysios S. Kalogerias Amin Karbasi MLT 24 2 0 14 Feb 2022
Towards Data-Algorithm Dependent Generalization: a Case Study on Overparameterized Linear Regression Jing Xu Jiaye Teng Yang Yuan Andrew Chi-Chih Yao 23 1 0 12 Feb 2022
Improved Information Theoretic Generalization Bounds for Distributed and Federated Learning L. P. Barnes Alex Dytso H. V. Poor FedML 38 16 0 04 Feb 2022
Adaptive Data Analysis with Correlated Observations A. Kontorovich Menachem Sadigurschi Uri Stemmer 27 10 0 21 Jan 2022
Generalization in Supervised Learning Through Riemannian Contraction L. Kozachkov Patrick M. Wensing Jean-Jacques E. Slotine MLT 21 9 0 17 Jan 2022
Stability Based Generalization Bounds for Exponential Family Langevin Dynamics A. Banerjee Tiancong Chen Xinyan Li Yingxue Zhou 34 8 0 09 Jan 2022
Time-independent Generalization Bounds for SGLD in Non-convex Settings Tyler Farghly Patrick Rebeschini 23 22 0 25 Nov 2021
Multi-fidelity Stability for Graph Representation Learning Yihan He Joan Bruna 17 0 0 25 Nov 2021
On the Generalization of Models Trained with SGD: Information-Theoretic Bounds and Implications Ziqiao Wang Yongyi Mao FedML MLT 37 22 0 07 Oct 2021
Stability and Generalization for Randomized Coordinate Descent Puyu Wang Liang Wu Yunwen Lei 27 7 0 17 Aug 2021
Adapting to Function Difficulty and Growth Conditions in Private Optimization Hilal Asi Daniel Levy John C. Duchi 13 23 0 05 Aug 2021
Stability & Generalisation of Gradient Descent for Shallow Neural Networks without the Neural Tangent Kernel Dominic Richards Ilja Kuzborskij 13 28 0 27 Jul 2021
Improved Learning Rates for Stochastic Optimization: Two Theoretical Viewpoints Shaojie Li Yong Liu 23 13 0 19 Jul 2021
Optimal Rates for Random Order Online Optimization Uri Sherman Tomer Koren Yishay Mansour 21 8 0 29 Jun 2021
Towards Understanding Generalization via Decomposing Excess Risk Dynamics Jiaye Teng Jianhao Ma Yang Yuan 29 4 0 11 Jun 2021
Why Does Multi-Epoch Training Help? Yi Tian Xu Qi Qian Hao Li R. L. Jin 37 1 0 13 May 2021
Stability and Generalization of Stochastic Gradient Methods for Minimax Problems Yunwen Lei Zhenhuan Yang Tianbao Yang Yiming Ying 37 47 0 08 May 2021
Optimal Algorithms for Differentially Private Stochastic Monotone Variational Inequalities and Saddle-Point Problems Digvijay Boob Cristóbal Guzmán 28 15 0 07 Apr 2021
Stability and Deviation Optimal Risk Bounds with Convergence Rate $O(1/n)$ Yegor Klochkov Nikita Zhivotovskiy 26 61 0 22 Mar 2021
Stability of SGD: Tightness Analysis and Improved Bounds Yikai Zhang Wenjia Zhang Sammy Bald Vamsi Pingali Chao Chen Mayank Goswami MLT 21 36 0 10 Feb 2021
Dimension Free Generalization Bounds for Non Linear Metric Learning Mark Kozdoba Shie Mannor 6 0 0 07 Feb 2021
Algorithmic Instabilities of Accelerated Gradient Descent Amit Attia Tomer Koren 8 8 0 03 Feb 2021
Information-Theoretic Generalization Bounds for Stochastic Gradient Descent Gergely Neu Gintare Karolina Dziugaite Mahdi Haghifam Daniel M. Roy 20 85 0 01 Feb 2021
Robustness, Privacy, and Generalization of Adversarial Training Fengxiang He Shaopeng Fu Bohan Wang Dacheng Tao 25 10 0 25 Dec 2020
A Tight Lower Bound for Uniformly Stable Algorithms Qinghua Liu Zhou Lu 18 0 0 24 Dec 2020
Contraction of $E_γ$ -Divergence and Its Applications to Privacy S. Asoodeh Mario Díaz Flavio du Pin Calmon 31 0 0 20 Dec 2020
Generalization bounds for deep learning Guillermo Valle Pérez A. Louis BDL 13 44 0 07 Dec 2020
Characterization of Excess Risk for Locally Strongly Convex Population Risk Mingyang Yi Ruoyu Wang Zhi-Ming Ma 11 2 0 04 Dec 2020
Toward Better Generalization Bounds with Locally Elastic Stability Zhun Deng Hangfeng He Weijie J. Su 11 44 0 27 Oct 2020
Train simultaneously, generalize better: Stability of gradient-based minimax learners Farzan Farnia Asuman Ozdaglar 28 47 0 23 Oct 2020
Hybrid Stochastic-Deterministic Minibatch Proximal Gradient: Less-Than-Single-Pass Optimization with Nearly Optimal Generalization Pan Zhou Xiaotong Yuan 16 6 0 18 Sep 2020
Fine-Grained Analysis of Stability and Generalization for Stochastic Gradient Descent Yunwen Lei Yiming Ying MLT 30 126 0 15 Jun 2020
Stability of Stochastic Gradient Descent on Nonsmooth Convex Losses Raef Bassily Vitaly Feldman Cristóbal Guzmán Kunal Talwar MLT 19 192 0 12 Jun 2020
Proper Learning, Helly Number, and an Optimal SVM Bound Olivier Bousquet Steve Hanneke Shay Moran Nikita Zhivotovskiy 11 51 0 24 May 2020
Upper Bounds on the Generalization Error of Private Algorithms for Discrete Data Borja Rodríguez Gálvez Germán Bassi Mikael Skoglund 15 4 0 12 May 2020
Private Stochastic Convex Optimization: Optimal Rates in Linear Time Vitaly Feldman Tomer Koren Kunal Talwar 8 203 0 10 May 2020
Reasoning About Generalization via Conditional Mutual Information Thomas Steinke Lydia Zakynthinou 23 159 0 24 Jan 2020
Stochastic Approximation versus Sample Average Approximation for population Wasserstein barycenters D. Dvinskikh 19 10 0 21 Jan 2020
Generalization Bounds for High-dimensional M-estimation under Sparsity Constraint Xiao-Tong Yuan Ping Li 11 2 0 20 Jan 2020
PAC learning with stable and private predictions Y. Dagan Vitaly Feldman 12 12 0 24 Nov 2019
Sharper bounds for uniformly stable algorithms Olivier Bousquet Yegor Klochkov Nikita Zhivotovskiy 18 120 0 17 Oct 2019
Private Stochastic Convex Optimization with Optimal Rates Raef Bassily Vitaly Feldman Kunal Talwar Abhradeep Thakurta 21 236 0 27 Aug 2019
The Cost of a Reductions Approach to Private Fair Optimization Daniel Alabi 33 3 0 23 Jun 2019
Does Learning Require Memorization? A Short Tale about a Long Tail Vitaly Feldman TDI 21 481 0 12 Jun 2019
Implicit regularization for deep neural networks driven by an Ornstein-Uhlenbeck like process Guy Blanc Neha Gupta Gregory Valiant Paul Valiant 11 142 0 19 Apr 2019
A Selective Overview of Deep Learning Jianqing Fan Cong Ma Yiqiao Zhong BDL VLM 30 136 0 10 Apr 2019
Hypothesis Set Stability and Generalization Dylan J. Foster Spencer Greenberg Satyen Kale Haipeng Luo M. Mohri Karthik Sridharan 17 35 0 09 Apr 2019