Solving Ridge Regression using Sketched Preconditioned SVRG

v1v2 (latest)

Solving Ridge Regression using Sketched Preconditioned SVRG

7 February 2016

Francesco Orabona

Shai Shalev-Shwartz

ArXiv (abs)PDF HTML

Papers citing "Solving Ridge Regression using Sketched Preconditioned SVRG"

18 / 18 papers shown

Title
Faster Linear Systems and Matrix Norm Approximation via Multi-level Sketched Preconditioning Michal Dereziñski Christopher Musco Jiaming Yang 121 2 0 09 May 2024
Fine-grained Analysis and Faster Algorithms for Iteratively Solving Linear Systems Michal Dereziñski Daniel LeJeune Deanna Needell E. Rebrova 84 4 0 09 May 2024
Second-order Information Promotes Mini-Batch Robustness in Variance-Reduced Gradients Sachin Garg A. Berahas Michal Dereziñski 84 1 0 23 Apr 2024
Stochastic Variance-Reduced Newton: Accelerating Finite-Sum Minimization with Large Batches Michal Derezinski 128 6 0 06 Jun 2022
Faster Randomized Methods for Orthogonality Constrained Problems B. Shustin H. Avron 49 2 0 22 Jun 2021
Statistical Limits of Supervised Quantum Learning C. Ciliberto Andrea Rocchetto Alessandro Rudi Leonard Wossnig 42 4 0 28 Jan 2020
Ridge Regression: Structure, Cross-Validation, and Sketching Sifan Liu Yan Sun CML 115 48 0 06 Oct 2019
Adaptive Iterative Hessian Sketch via A-Optimal Subsampling Aijun Zhang Hengtao Zhang G. Yin 14 6 0 20 Feb 2019
Efficient Linear Bandits through Matrix Sketching Ilja Kuzborskij Leonardo Cella Nicolò Cesa-Bianchi 38 19 0 28 Sep 2018
Sketching for Principal Component Regression Liron Mor Yosef H. Avron 51 8 0 07 Mar 2018
Large Scale Constrained Linear Regression Revisited: Faster Algorithms via Preconditioning Di Wang Jinhui Xu 31 5 0 09 Feb 2018
To understand deep learning we need to understand kernel learning M. Belkin Siyuan Ma Soumik Mandal 100 420 0 05 Feb 2018
Improved Optimization of Finite Sums with Minibatch Stochastic Variance Reduced Proximal Iterations Jialei Wang Tong Zhang 70 12 0 21 Jun 2017
FALKON: An Optimal Large Scale Kernel Method Alessandro Rudi Luigi Carratino Lorenzo Rosasco 98 196 0 31 May 2017
Spectrum Approximation Beyond Fast Matrix Multiplication: Algorithms and Hardness Cameron Musco Praneeth Netrapalli Aaron Sidford Shashanka Ubaru David P. Woodruff 157 36 0 13 Apr 2017
Diving into the shallows: a computational perspective on large-scale shallow learning Siyuan Ma M. Belkin 82 78 0 30 Mar 2017
Efficient Second Order Online Learning by Sketching Haipeng Luo Alekh Agarwal Nicolò Cesa-Bianchi John Langford 101 96 0 06 Feb 2016
Average Stability is Invariant to Data Preconditioning. Implications to Exp-concave Empirical Risk Minimization Alon Gonen Shai Shalev-Shwartz 55 25 0 15 Jan 2016