Dynamic Parameter Allocation in Parameter Servers

3 February 2020

Alexander Renz-Wieland

Rainer Gemulla

Steffen Zeuch

Volker Markl

ArXiv PDF HTML

Papers citing "Dynamic Parameter Allocation in Parameter Servers"

20 / 20 papers shown

Title
Priority-based Parameter Propagation for Distributed DNN Training Anand Jayarajan Jinliang Wei Garth A. Gibson Alexandra Fedorova Gennady Pekhimenko AI4CE 36 178 0 10 May 2019
PyTorch-BigGraph: A Large-scale Graph Embedding System Adam Lerer Ledell Yu Wu Jiajun Shen Timothée Lacroix Luca Wehrstedt Abhijit Bose A. Peysakhovich GNN 45 384 0 28 Mar 2019
Deep contextualized word representations Matthew E. Peters Mark Neumann Mohit Iyyer Matt Gardner Christopher Clark Kenton Lee Luke Zettlemoyer NAI 111 11,520 0 15 Feb 2018
Stochastic Answer Networks for Machine Reading Comprehension Xiaodong Liu Yelong Shen Kevin Duh Jianfeng Gao RALM 30 198 0 10 Dec 2017
Open-World Knowledge Graph Completion Baoxu Shi Tim Weninger 58 287 0 09 Nov 2017
Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour Priya Goyal Piotr Dollár Ross B. Girshick P. Noordhuis Lukasz Wesolowski Aapo Kyrola Andrew Tulloch Yangqing Jia Kaiming He 3DH 94 3,666 0 08 Jun 2017
Analogical Inference for Multi-Relational Embeddings Hanxiao Liu Yuexin Wu Yiming Yang 61 374 0 06 May 2017
Complex Embeddings for Simple Link Prediction Théo Trouillon Johannes Welbl Sebastian Riedel Éric Gaussier Guillaume Bouchard BDL 81 2,955 0 20 Jun 2016
TensorFlow: A system for large-scale machine learning Martín Abadi P. Barham Jianmin Chen Zhiwen Chen Andy Davis ... Vijay Vasudevan Pete Warden Martin Wicke Yuan Yu Xiaoqiang Zhang GNN AI4CE 338 18,300 0 27 May 2016
Computing Web-scale Topic Models using an Asynchronous Parameter Server R. Jagerman Carsten Eickhoff Maarten de Rijke 40 15 0 24 May 2016
MXNet: A Flexible and Efficient Machine Learning Library for Heterogeneous Distributed Systems Tianqi Chen Mu Li Yutian Li Min Lin Naiyan Wang Minjie Wang Tianjun Xiao Bing Xu Chiyuan Zhang Zheng Zhang 125 2,243 0 03 Dec 2015
Holographic Embeddings of Knowledge Graphs Maximilian Nickel Lorenzo Rosasco T. Poggio 40 1,195 0 16 Oct 2015
A Review of Relational Machine Learning for Knowledge Graphs Maximilian Nickel Kevin Patrick Murphy Volker Tresp E. Gabrilovich 119 1,568 0 02 Mar 2015
Embedding Entities and Relations for Learning and Inference in Knowledge Bases Bishan Yang Wen-tau Yih Xiaodong He Jianfeng Gao Li Deng NAI 77 3,174 0 20 Dec 2014
A Scalable Asynchronous Distributed Algorithm for Topic Modeling Hsiang-Fu Yu Cho-Jui Hsieh Hyokun Yun S.V.N. Vishwanathan Inderjit S. Dhillon 40 67 0 16 Dec 2014
High-Performance Distributed ML at Scale through Parameter Server Consistency Models Wei-Ming Dai Abhimanu Kumar Jinliang Wei Qirong Ho Garth A. Gibson Eric Xing 37 120 0 29 Oct 2014
One Billion Word Benchmark for Measuring Progress in Statistical Language Modeling Ciprian Chelba Tomas Mikolov M. Schuster Qi Ge T. Brants P. Koehn T. Robinson 121 1,099 0 11 Dec 2013
NOMAD: Non-locking, stOchastic Multi-machine algorithm for Asynchronous and Decentralized matrix completion Hyokun Yun Hsiang-Fu Yu Cho-Jui Hsieh S.V.N. Vishwanathan Inderjit Dhillon 67 124 0 01 Dec 2013
Efficient Estimation of Word Representations in Vector Space Tomas Mikolov Kai Chen G. Corrado J. Dean 3DV 552 31,406 0 16 Jan 2013
Distributed GraphLab: A Framework for Machine Learning in the Cloud Yucheng Low Joseph E. Gonzalez Aapo Kyrola Danny Bickson Carlos Guestrin J. M. Hellerstein GNN FedML 69 1,069 0 26 Apr 2012