DreamShard: Generalizable Embedding Table Placement for Recommender Systems

5 October 2022

Daochen Zha

Louis Feng

Bhargav Bhushanam

Papers citing "DreamShard: Generalizable Embedding Table Placement for Recommender Systems"

21 / 21 papers shown

Title
Pushing the Performance Envelope of DNN-based Recommendation Systems Inference on GPUs Rishabh Jain Vivek M. Bhasi Adwait Jog A. Sivasubramaniam M. Kandemir Chita R. Das 33 2 0 29 Oct 2024
Towards Universal Performance Modeling for Machine Learning Training on Multi-GPU Platforms Zhongyi Lin Ning Sun Pallab Bhattacharya Xizhou Feng Louis Feng John Douglas Owens 42 1 0 19 Apr 2024
Collaborative Graph Neural Networks for Attributed Network Embedding Qiaoyu Tan Xin Zhang Xiao Shi Huang Haojun Chen Jundong Li Xia Hu 41 11 0 22 Jul 2023
Chakra: Advancing Performance Benchmarking and Co-design using Standardized Execution Traces Srinivas Sridharan Taekyung Heo Louis Feng Zhaodong Wang M. Bergeron ... Shengbao Zheng Brian Coutinho Saeed Rashidi Changhai Man T. Krishna 20 13 0 23 May 2023
Pre-train and Search: Efficient Embedding Table Sharding with Pre-trained Neural Cost Models Daochen Zha Louis Feng Liangchen Luo Bhargav Bhushanam Zirui Liu ... J. McMahon Yuzhen Huang Bryan Clarke A. Kejariwal Xia Hu 55 7 0 03 May 2023
Data-centric Artificial Intelligence: A Survey Daochen Zha Zaid Pervaiz Bhat Kwei-Herng Lai Fan Yang Zhimeng Jiang Shaochen Zhong Xia Hu 27 192 0 17 Mar 2023
Towards Personalized Preprocessing Pipeline Search Diego Martinez Daochen Zha Qiaoyu Tan Xia Hu AI4TS 29 2 0 28 Feb 2023
MP-Rec: Hardware-Software Co-Design to Enable Multi-Path Recommendation Samuel Hsia Udit Gupta Bilge Acun Newsha Ardalani Pan Zhong Gu-Yeon Wei David Brooks Carole-Jean Wu 46 17 0 21 Feb 2023
Bring Your Own View: Graph Neural Networks for Link Prediction with Personalized Subgraph Selection Qiaoyu Tan Xin Zhang Ninghao Liu Daochen Zha Li Li Rui Chen Soo-Hyun Choi Xia Hu 41 41 0 23 Dec 2022
SurCo: Learning Linear Surrogates For Combinatorial Nonlinear Optimization Problems Aaron Ferber Taoan Huang Daochen Zha M. Schubert Benoit Steiner B. Dilkina Yuandong Tian 41 20 0 22 Oct 2022
RSC: Accelerating Graph Neural Networks Training via Randomized Sparse Computations Zirui Liu Sheng-Wei Chen Kaixiong Zhou Daochen Zha Xiao Huang Xia Hu 32 14 0 19 Oct 2022
DIVISION: Memory Efficient Training via Dual Activation Precision Guanchu Wang Zirui Liu Zhimeng Jiang Ninghao Liu Nannan Zou Xia Hu MQ 29 2 0 05 Aug 2022
Heterogeneous Acceleration Pipeline for Recommendation System Training Muhammad Adnan Yassaman Ebrahimzadeh Maboud Divyat Mahajan Prashant J. Nair 28 18 0 11 Apr 2022
RecShard: Statistical Feature-Based Memory Optimization for Industry-Scale Neural Recommendation Geet Sethi Bilge Acun Niket Agarwal Christos Kozyrakis Caroline Trippel Carole-Jean Wu 47 66 0 25 Jan 2022
Learnable Embedding Sizes for Recommender Systems Siyi Liu Chen Gao Yihong Chen Depeng Jin Yong Li 59 83 0 19 Jan 2021
FBGEMM: Enabling High-Performance Low-Precision Deep Learning Inference D. Khudia Jianyu Huang Protonu Basu Summer Deng Haixin Liu Jongsoo Park M. Smelyanskiy FedML MQ 49 46 0 13 Jan 2021
Learning to Embed Categorical Features without Embedding Tables for Recommendation Wang-Cheng Kang D. Cheng Tiansheng Yao Xinyang Yi Ting-Li Chen Lichan Hong Ed H. Chi LMTD CML DML 50 68 0 21 Oct 2020
Deep Learning Training in Facebook Data Centers: Design of Scale-up and Scale-out Systems Maxim Naumov John Kim Dheevatsa Mudigere Srinivas Sridharan Xiaodong Wang ... Krishnakumar Nair Isabel Gao Bor-Yiing Su Jiyan Yang M. Smelyanskiy GNN 46 83 0 20 Mar 2020
Distributed Hierarchical GPU Parameter Server for Massive Scale Deep Learning Ads Systems Weijie Zhao Deping Xie Ronglai Jia Yulei Qian Rui Ding Mingming Sun P. Li MoE 59 150 0 12 Mar 2020
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks Chelsea Finn Pieter Abbeel Sergey Levine OOD 344 11,684 0 09 Mar 2017
Neural Architecture Search with Reinforcement Learning Barret Zoph Quoc V. Le 271 5,329 0 05 Nov 2016