OverSketched Newton: Fast Convex Optimization for Serverless Systems

21 March 2019

Papers citing "OverSketched Newton: Fast Convex Optimization for Serverless Systems"

29 / 29 papers shown

Title
ADAHESSIAN: An Adaptive Second Order Optimizer for Machine Learning Z. Yao A. Gholami Sheng Shen Mustafa Mustafa Kurt Keutzer Michael W. Mahoney ODL 94 281 0 01 Jun 2020
Scalable Second Order Optimization for Deep Learning Rohan Anil Vineet Gupta Tomer Koren Kevin Regan Y. Singer ODL 57 29 0 20 Feb 2020
Serverless Straggler Mitigation using Local Error-Correcting Codes Vipul Gupta Dominic Carrano Yaoqing Yang Vaishaal Shankar T. Courtade Kannan Ramchandran 46 9 0 21 Jan 2020
PyHessian: Neural Networks Through the Lens of the Hessian Z. Yao A. Gholami Kurt Keutzer Michael W. Mahoney ODL 51 302 0 16 Dec 2019
Harnessing the Power of Serverless Runtimes for Large-Scale Optimization Arda Aytekin M. Johansson 31 14 0 10 Jan 2019
Serverless Computing: One Step Forward, Two Steps Back J. M. Hellerstein Jose M. Faleiro Joseph E. Gonzalez Johann Schleier-Smith Vikram Sreekanti Alexey Tumanov Chenggang Wu 32 392 0 10 Dec 2018
OverSketch: Approximate Matrix Multiplication for the Cloud Vipul Gupta Ryan Sherman Thomas Courtade Kannan Ramchandran 36 50 0 06 Nov 2018
numpywren: serverless linear algebra Vaishaal Shankar K. Krauth Qifan Pu Eric Jonas Shivaram Venkataraman Ion Stoica Benjamin Recht Jonathan Ragan-Kelley 50 111 0 23 Oct 2018
A Distributed Second-Order Algorithm You Can Trust Celestine Mendler-Dünner Aurelien Lucchi Matilde Gargiani An Bian Thomas Hofmann Martin Jaggi 59 32 0 20 Jun 2018
A Sequential Approximation Framework for Coded Distributed Optimization Jingge Zhu Ye Pu Vipul Gupta Claire Tomlin Kannan Ramchandran 50 23 0 24 Oct 2017
Serving deep learning models in a serverless platform Vatche Isahagian Vinod Muthusamy Aleksander Slominski 50 171 0 23 Oct 2017
GIANT: Globally Improved Approximate Newton Method for Distributed Optimization Shusen Wang Farbod Roosta-Khorasani Peng Xu Michael W. Mahoney 65 129 0 11 Sep 2017
Newton-Type Methods for Non-Convex Optimization Under Inexact Hessian Information Peng Xu Farbod Roosta-Khorasani Michael W. Mahoney 57 211 0 23 Aug 2017
Serverless Computing: Current Trends and Open Problems Ioana Baldini Paul C. Castro K. Chang P. Cheng Stephen J. Fink ... N. Mitchell Vinod Muthusamy Rodric M. Rabbah Aleksander Slominski Philippe Suter AI4TS 33 629 0 10 Jun 2017
Polynomial Codes: an Optimal Design for High-Dimensional Coded Matrix Multiplication Qian-long Yu M. Maddah-ali A. Avestimehr 108 463 0 30 May 2017
An Investigation of Newton-Sketch and Subsampled Newton Methods A. Berahas Raghu Bollapragada J. Nocedal 53 112 0 17 May 2017
EMNIST: an extension of MNIST to handwritten letters Gregory Cohen Saeed Afshar J. Tapson André van Schaik 63 720 0 17 Feb 2017
Occupy the Cloud: Distributed Computing for the 99% Eric Jonas Qifan Pu Shivaram Venkataraman Ion Stoica Benjamin Recht 51 504 0 13 Feb 2017
CoCoA: A General Framework for Communication-Efficient Distributed Optimization Virginia Smith Simone Forte Chenxin Ma Martin Takáč Michael I. Jordan Martin Jaggi 68 273 0 07 Nov 2016
Exact and Inexact Subsampled Newton Methods for Optimization Raghu Bollapragada R. Byrd J. Nocedal 51 180 0 27 Sep 2016
Optimization Methods for Large-Scale Machine Learning Léon Bottou Frank E. Curtis J. Nocedal 233 3,206 0 15 Jun 2016
Revisiting Distributed Synchronous SGD Jianmin Chen Xinghao Pan R. Monga Samy Bengio Rafal Jozefowicz 87 799 0 04 Apr 2016
Sub-Sampled Newton Methods II: Local Convergence Rates Farbod Roosta-Khorasani Michael W. Mahoney 61 84 0 18 Jan 2016
Sub-Sampled Newton Methods I: Globally Convergent Algorithms Farbod Roosta-Khorasani Michael W. Mahoney 64 90 0 18 Jan 2016
Speeding Up Distributed Machine Learning Using Codes Kangwook Lee Maximilian Lam Ramtin Pedarsani Dimitris Papailiopoulos Kannan Ramchandran 189 858 0 08 Dec 2015
On Variance Reduction in Stochastic Gradient Descent and its Asynchronous Variants Sashank J. Reddi Ahmed S. Hefny S. Sra Barnabás Póczós Alex Smola 111 196 0 23 Jun 2015
A Practical Guide to Randomized Matrix Computations with MATLAB Implementations Shusen Wang 57 39 0 28 May 2015
Newton Sketch: A Linear-time Optimization Algorithm with Linear-Quadratic Convergence Mert Pilanci Martin J. Wainwright 43 273 0 09 May 2015
Communication Efficient Distributed Optimization using an Approximate Newton-type Method Ohad Shamir Nathan Srebro Tong Zhang 92 556 0 30 Dec 2013