AutoShard: Automated Embedding Table Sharding for Recommender Systems

12 August 2022

Daochen Zha

Louis Feng

Bhargav Bhushanam

ArXiv (abs)PDF HTML Github (22★)

Papers citing "AutoShard: Automated Embedding Table Sharding for Recommender Systems"

27 / 27 papers shown

Title
RecShard: Statistical Feature-Based Memory Optimization for Industry-Scale Neural Recommendation Geet Sethi Bilge Acun Niket Agarwal Christos Kozyrakis Caroline Trippel Carole-Jean Wu 83 69 0 25 Jan 2022
AutoVideo: An Automated Video Action Recognition System Daochen Zha Zaid Pervaiz Bhat Yi-Wei Chen Yicheng Wang Sirui Ding ... Mohammad Bhat AnmollKumar Jain Alfredo Costilla Reyes Na Zou Helen Zhou 98 11 0 09 Aug 2021
DouZero: Mastering DouDizhu with Self-Play Deep Reinforcement Learning Daochen Zha Jingru Xie Wenye Ma Sheng Zhang Xiangru Lian Helen Zhou Ji Liu 65 117 0 11 Jun 2021
Rank the Episodes: A Simple Approach for Exploration in Procedurally-Generated Environments Daochen Zha Wenye Ma Lei Yuan Helen Zhou Ji Liu 126 44 0 20 Jan 2021
Learnable Embedding Sizes for Recommender Systems Siyi Liu Chen Gao Yihong Chen Depeng Jin Yong Li 116 86 0 19 Jan 2021
FBGEMM: Enabling High-Performance Low-Precision Deep Learning Inference D. Khudia Jianyu Huang Protonu Basu Summer Deng Haixin Liu Jongsoo Park M. Smelyanskiy FedML MQ 107 46 0 13 Jan 2021
Understanding Training Efficiency of Deep Learning Recommendation Models at Scale Bilge Acun Matthew Murphy Xiaodong Wang Jade Nie Carole-Jean Wu K. Hazelwood 78 113 0 11 Nov 2020
Learning to Embed Categorical Features without Embedding Tables for Recommendation Wang-Cheng Kang D. Cheng Tiansheng Yao Xinyang Yi Ting-Li Chen Lichan Hong Ed H. Chi LMTD CML DML 99 72 0 21 Oct 2020
TODS: An Automated Time Series Outlier Detection System Kwei-Harng Lai Daochen Zha Guanchu Wang Junjie Xu Yue Zhao ... Yile Chen Purav Zumkhawaka Minyang Wan D. Martinez Helen Zhou AI4TS 129 68 0 18 Sep 2020
Meta-AAD: Active Anomaly Detection with Deep Reinforcement Learning Daochen Zha Kwei-Herng Lai Mingyang Wan X. Hu 87 54 0 16 Sep 2020
Model Size Reduction Using Frequency Based Double Hashing for Recommender Systems Caojin Zhang Yicun Liu Yuanpu Xie S. Ktena Alykhan Tejani ... Suvadip Paul Ikuhiro Ihara P. Upadhyaya Ferenc Huszár Wenzhe Shi 82 56 0 28 Jul 2020
Distributed Hierarchical GPU Parameter Server for Massive Scale Deep Learning Ads Systems Weijie Zhao Deping Xie Ronglai Jia Yulei Qian Rui Ding Mingming Sun P. Li MoE 108 151 0 12 Mar 2020
TorchBeast: A PyTorch Platform for Distributed RL Heinrich Küttler Nantas Nardelli Thibaut Lavril Marco Selvatici V. Sivakumar Tim Rocktaschel Edward Grefenstette OffRL 65 58 0 08 Oct 2019
Compositional Embeddings Using Complementary Partitions for Memory-Efficient Recommendation Systems Hao-Jun Michael Shi Dheevatsa Mudigere Maxim Naumov Jiyan Yang 55 122 0 04 Sep 2019
Neural Input Search for Large Scale Recommendation Models Manas R. Joglekar Cong Li Jay K. Adams Pranav Khaitan Quoc V. Le 52 115 0 10 Jul 2019
Experience Replay Optimization Daochen Zha Kwei-Herng Lai Kaixiong Zhou Helen Zhou OffRL 47 103 0 19 Jun 2019
The Architectural Implications of Facebook's DNN-based Personalized Recommendation Udit Gupta Carole-Jean Wu Xiaodong Wang Maxim Naumov Brandon Reagen ... Andrey Malevich Dheevatsa Mudigere M. Smelyanskiy Liang Xiong Xuan Zhang GNN 79 291 0 06 Jun 2019
Deep Learning Recommendation Model for Personalization and Recommendation Systems Maxim Naumov Dheevatsa Mudigere Hao-Jun Michael Shi Jianyu Huang Narayanan Sundaraman ... Wenlin Chen Vijay Rao Bill Jia Liang Xiong M. Smelyanskiy 91 740 0 31 May 2019
Security and Privacy on Blockchain Rui Zhang Rui Xue Ling Liu 45 774 0 18 Mar 2019
Random Search and Reproducibility for Neural Architecture Search Liam Li Ameet Talwalkar OOD 87 725 0 20 Feb 2019
AutoInt: Automatic Feature Interaction Learning via Self-Attentive Neural Networks Weiping Song Chence Shi Zhiping Xiao Zhijian Duan Yewen Xu Ming Zhang Jian Tang CML 92 859 0 29 Oct 2018
Deep Interest Evolution Network for Click-Through Rate Prediction Guorui Zhou Na Mou Ying Fan Qi Pi Weijie Bian Chang Zhou Xiaoqiang Zhu Kun Gai 91 1,064 0 11 Sep 2018
AutoAugment: Learning Augmentation Policies from Data E. D. Cubuk Barret Zoph Dandelion Mané Vijay Vasudevan Quoc V. Le 135 1,775 0 24 May 2018
IMPALA: Scalable Distributed Deep-RL with Importance Weighted Actor-Learner Architectures L. Espeholt Hubert Soyer Rémi Munos Karen Simonyan Volodymyr Mnih ... Vlad Firoiu Tim Harley Iain Dunning Shane Legg Koray Kavukcuoglu 240 1,607 0 05 Feb 2018
Neural Architecture Search with Reinforcement Learning Barret Zoph Quoc V. Le 478 5,385 0 05 Nov 2016
Wide & Deep Learning for Recommender Systems Heng-Tze Cheng L. Koc Jeremiah Harmsen T. Shaked Tushar Chandra ... Zakaria Haque Lichan Hong Vihan Jain Xiaobing Liu Hemal Shah HAI VLM 192 3,673 0 24 Jun 2016
Playing Atari with Deep Reinforcement Learning Volodymyr Mnih Koray Kavukcuoglu David Silver Alex Graves Ioannis Antonoglou Daan Wierstra Martin Riedmiller 129 12,269 0 19 Dec 2013