Noise is All You Need: Private Second-Order Convergence of Noisy SGD

9 October 2024

Papers citing "Noise is All You Need: Private Second-Order Convergence of Noisy SGD"

27 / 27 papers shown

Title
FFCV: Accelerating Training by Removing Data Bottlenecks Guillaume Leclerc Andrew Ilyas Logan Engstrom Sung Min Park Hadi Salman Aleksander Madry 43 69 0 21 Jun 2023
Private (Stochastic) Non-Convex Optimization Revisited: Second-Order Stationary Points and Excess Risks Arun Ganesh Daogao Liu Sewoong Oh Abhradeep Thakurta ODL 72 13 0 20 Feb 2023
Automatic Clipping: Differentially Private Deep Learning Made Easier and Stronger Zhiqi Bu Yu Wang Sheng Zha George Karypis 117 71 0 14 Jun 2022
Private Adaptive Gradient Methods for Convex Optimization Hilal Asi John C. Duchi Alireza Fallah O. Javidbakht Kunal Talwar 64 53 0 25 Jun 2021
Remember What You Want to Forget: Algorithms for Machine Unlearning Ayush Sekhari Jayadev Acharya Gautam Kamath A. Suresh FedML MU 86 314 0 04 Mar 2021
Differential Privacy for Industrial Internet of Things: Opportunities, Applications and Challenges Bin Jiang Jianqiang Li Guanghui Yue Haoze Song 91 117 0 26 Jan 2021
Differentially Private SGD with Non-Smooth Losses Puyu Wang Yunwen Lei Yiming Ying Hai Zhang 54 28 0 22 Jan 2021
Enabling Fast Differentially Private SGD via Just-in-Time Compilation and Vectorization P. Subramani Nicholas Vadivelu Gautam Kamath 90 83 0 18 Oct 2020
Private Reinforcement Learning with PAC and Regret Guarantees G. Vietri Borja Balle A. Krishnamurthy Zhiwei Steven Wu 53 63 0 18 Sep 2020
Private Stochastic Convex Optimization: Optimal Rates in Linear Time Vitaly Feldman Tomer Koren Kunal Talwar 63 211 0 10 May 2020
Advances and Open Problems in Federated Learning Peter Kairouz H. B. McMahan Brendan Avent A. Bellet M. Bennis ... Zheng Xu Qiang Yang Felix X. Yu Han Yu Sen Zhao FedML AI4CE 259 6,261 0 10 Dec 2019
Private Stochastic Convex Optimization with Optimal Rates Raef Bassily Vitaly Feldman Kunal Talwar Abhradeep Thakurta 78 242 0 27 Aug 2019
A Short Note on Concentration Inequalities for Random Vectors with SubGaussian Norm Chi Jin Praneeth Netrapalli Rong Ge Sham Kakade Michael I. Jordan 100 150 0 11 Feb 2019
Stochastic Recursive Variance-Reduced Cubic Regularization Methods Dongruo Zhou Quanquan Gu 66 26 0 31 Jan 2019
Tight Analyses for Non-Smooth Stochastic Gradient Descent Nicholas J. A. Harvey Christopher Liaw Y. Plan Sikander Randhawa 55 138 0 13 Dec 2018
SPIDER: Near-Optimal Non-Convex Optimization via Stochastic Path Integrated Differential Estimator Cong Fang C. J. Li Zhouchen Lin Tong Zhang 92 579 0 04 Jul 2018
Neural Network Acceptability Judgments Alex Warstadt Amanpreet Singh Samuel R. Bowman 233 1,411 0 31 May 2018
cpSGD: Communication-efficient and differentially-private distributed SGD Naman Agarwal A. Suresh Felix X. Yu Sanjiv Kumar H. B. McMahan FedML 128 491 0 27 May 2018
The Secret Sharer: Evaluating and Testing Unintended Memorization in Neural Networks Nicholas Carlini Chang-rui Liu Ulfar Erlingsson Jernej Kos Basel Alomair 144 1,146 0 22 Feb 2018
Certified Robustness to Adversarial Examples with Differential Privacy Mathias Lécuyer Vaggelis Atlidakis Roxana Geambasu Daniel J. Hsu Suman Jana SILM AAML 96 939 0 09 Feb 2018
Accelerated Gradient Descent Escapes Saddle Points Faster than Gradient Descent Chi Jin Praneeth Netrapalli Michael I. Jordan ODL 72 262 0 28 Nov 2017
No Spurious Local Minima in Nonconvex Low Rank Problems: A Unified Geometric Analysis Rong Ge Chi Jin Yi Zheng 129 436 0 03 Apr 2017
Deep Learning with Differential Privacy Martín Abadi Andy Chu Ian Goodfellow H. B. McMahan Ilya Mironov Kunal Talwar Li Zhang FedML SyDa 216 6,130 0 01 Jul 2016
Matrix Completion has No Spurious Local Minimum Rong Ge Jason D. Lee Tengyu Ma 111 599 0 24 May 2016
Escaping From Saddle Points --- Online Stochastic Gradient for Tensor Decomposition Rong Ge Furong Huang Chi Jin Yang Yuan 140 1,059 0 06 Mar 2015
Stochastic First- and Zeroth-order Methods for Nonconvex Stochastic Programming Saeed Ghadimi Guanghui Lan ODL 122 1,555 0 22 Sep 2013
Geo-Indistinguishability: Differential Privacy for Location-Based Systems M. Andrés N. E. Bordenabe K. Chatzikokolakis C. Palamidessi 90 1,187 0 10 Dec 2012