Hercules: Heterogeneity-Aware Inference Serving for At-Scale
Personalized Recommendation

Hercules: Heterogeneity-Aware Inference Serving for At-Scale Personalized Recommendation

14 March 2022

Hsien-Hsin S. Lee

Papers citing "Hercules: Heterogeneity-Aware Inference Serving for At-Scale Personalized Recommendation"

15 / 15 papers shown

Title
LazyBatching: An SLA-aware Batching System for Cloud Machine Learning Inference Yujeong Choi Yunseong Kim Minsoo Rhu 44 66 0 25 Oct 2020
Tensor Casting: Co-Designing Algorithm-Architecture for Personalized Recommendation Training Youngeun Kwon Yunjae Lee Minsoo Rhu 46 40 0 25 Oct 2020
Cross-Stack Workload Characterization of Deep Recommendation Systems Samuel Hsia Udit Gupta Mark Wilkening Carole-Jean Wu Gu-Yeon Wei David Brooks BDL GNN HAI 112 32 0 10 Oct 2020
DeepRecSys: A System for Optimizing End-To-End At-scale Neural Recommendation Inference Udit Gupta Samuel Hsia V. Saraph Xiaodong Wang Brandon Reagen Gu-Yeon Wei Hsien-Hsin S. Lee David Brooks Carole-Jean Wu GNN 58 189 0 08 Jan 2020
RecNMP: Accelerating Personalized Recommendation with Near-Memory Processing Liu Ke Udit Gupta Carole-Jean Wu B. Cho Mark Hempstead ... Dheevatsa Mudigere Maxim Naumov Martin D. Schatz M. Smelyanskiy Xiaodong Wang 53 217 0 30 Dec 2019
TensorDIMM: A Practical Near-Memory Processing Architecture for Embeddings and Tensor Operations in Deep Learning Youngeun Kwon Yunjae Lee Minsoo Rhu 43 210 0 08 Aug 2019
The Architectural Implications of Facebook's DNN-based Personalized Recommendation Udit Gupta Carole-Jean Wu Xiaodong Wang Maxim Naumov Brandon Reagen ... Andrey Malevich Dheevatsa Mudigere M. Smelyanskiy Liang Xiong Xuan Zhang GNN 73 290 0 06 Jun 2019
Deep Learning Recommendation Model for Personalization and Recommendation Systems Maxim Naumov Dheevatsa Mudigere Hao-Jun Michael Shi Jianyu Huang Narayanan Sundaraman ... Wenlin Chen Vijay Rao Bill Jia Liang Xiong M. Smelyanskiy 85 733 0 31 May 2019
Bandana: Using Non-volatile Memory for Storing Deep Learning Models Assaf Eisenman Maxim Naumov Darryl Gardner M. Smelyanskiy S. Pupyrev K. Hazelwood Asaf Cidon Sachin Katti 46 81 0 14 Nov 2018
Deep Interest Evolution Network for Click-Through Rate Prediction Guorui Zhou Na Mou Ying Fan Qi Pi Weijie Bian Chang Zhou Xiaoqiang Zhu Kun Gai 79 1,062 0 11 Sep 2018
Beyond Data and Model Parallelism for Deep Neural Networks Zhihao Jia Matei A. Zaharia A. Aiken GNN AI4CE 56 505 0 14 Jul 2018
Exploring Hidden Dimensions in Parallelizing Convolutional Neural Networks Zhihao Jia Sina Lin C. Qi A. Aiken 49 117 0 14 Feb 2018
Deep Interest Network for Click-Through Rate Prediction Guorui Zhou Cheng-Ning Song Xiaoqiang Zhu Xi-Wang Dai Ziru Xu Xiao Ma Yanghui Yan Junqi Jin Han Li Kun Gai 68 1,820 0 21 Jun 2017
In-Datacenter Performance Analysis of a Tensor Processing Unit N. Jouppi C. Young Nishant Patil David Patterson Gaurav Agrawal ... Vijay Vasudevan Richard Walter Walter Wang Eric Wilcox Doe Hyun Yoon 233 4,630 0 16 Apr 2017
Wide & Deep Learning for Recommender Systems Heng-Tze Cheng L. Koc Jeremiah Harmsen T. Shaked Tushar Chandra ... Zakaria Haque Lichan Hong Vihan Jain Xiaobing Liu Hemal Shah HAI VLM 153 3,658 0 24 Jun 2016

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.