19

Complexity of Classical Acceleration for 1\ell_1-Regularized PageRank

Kimon Fountoulakis
David Martínez-Rubio
Main:9 Pages
8 Figures
Bibliography:2 Pages
Appendix:12 Pages
Abstract

We study the degree-weighted work required to compute 1\ell_1-regularized PageRank using the standard accelerated proximal-gradient method (FISTA). For non-accelerated methods (ISTA), the best known worst-case work is O~((αρ)1)\widetilde{O}((\alpha\rho)^{-1}), where α\alpha is the teleportation parameter and ρ\rho is the 1\ell_1-regularization parameter. It is not known whether classical acceleration methods can improve 1/α1/\alpha to 1/α1/\sqrt{\alpha} while preserving the 1/ρ1/\rho locality scaling, or whether they can be asymptotically worse. For FISTA, we show a negative result by constructing a family of instances for which standard FISTA is asymptotically worse than ISTA. On the positive side, we analyze FISTA on a slightly over-regularized objective and show that, under a confinement condition, all spurious activations remain inside a boundary set B\mathcal{B}. This yields a bound consisting of an accelerated (ρα)1log(α/ε)(\rho\sqrt{\alpha})^{-1}\log(\alpha/\varepsilon) term plus a boundary overhead vol(B)/(ρα3/2)\sqrt{vol(\mathcal{B})}/(\rho\alpha^{3/2}). We also provide graph-structural sufficient conditions that imply such confinement.

View on arXiv
Comments on this paper