Device Placement Optimization with Reinforcement Learning

13 June 2017

Papers citing "Device Placement Optimization with Reinforcement Learning"

50 / 66 papers shown

Title
Gap-Dependent Bounds for Q-Learning using Reference-Advantage Decomposition Zhong Zheng Haochen Zhang Lingzhou Xue OffRL 78 2 0 10 Oct 2024
PaSE: Parallelization Strategies for Efficient DNN Training Venmugil Elango 32 9 0 04 Jul 2024
To Switch or Not to Switch? Balanced Policy Switching in Offline Reinforcement Learning Tao Ma Xuzhi Yang Zoltan Szabo OffRL 70 0 0 01 Jul 2024
A Structure-Aware Framework for Learning Device Placements on Computation Graphs Shukai Duan Heng Ping Nikos Kanakaris Xiongye Xiao Panagiotis Kyriakis ... Guixiang Ma Mihai Capota Shahin Nazarian Theodore L. Willke Paul Bogdan 45 2 0 23 May 2024
Workload-Aware Hardware Accelerator Mining for Distributed Deep Learning Training Muhammad Adnan Amar Phanishayee Janardhan Kulkarni Prashant J. Nair Divyat Mahajan 45 0 0 23 Apr 2024
Q-adaptive: A Multi-Agent Reinforcement Learning Based Routing on Dragonfly Network Yao Kang Xin Wang Z. Lan 24 13 0 24 Mar 2024
Moirai: Towards Optimal Placement for Distributed Inference on Heterogeneous Devices Beibei Zhang Hongwei Zhu Feng Gao Zhihui Yang Xiaoyang Sean Wang 29 1 0 07 Dec 2023
A Survey From Distributed Machine Learning to Distributed Deep Learning Mohammad Dehghani Zahra Yazdanparast 26 0 0 11 Jul 2023
Optimizing Memory Mapping Using Deep Reinforcement Learning Pengming Wang Mikita Sazanovich Berkin Ilbeyi P. Phothilimthana Manish Purohit ... R. Tung Paula Kurylowicz Kieran Milan Oriol Vinyals D. Mankowitz 16 4 0 11 May 2023
Expediting Distributed DNN Training with Device Topology-Aware Graph Deployment Shiwei Zhang Xiaodong Yi Lansong Diao Chuan Wu Siyu Wang W. Lin GNN 22 5 0 13 Feb 2023
Task Placement and Resource Allocation for Edge Machine Learning: A GNN-based Multi-Agent Reinforcement Learning Paradigm Yihong Li Xiaoxi Zhang Tian Zeng Jingpu Duan Chuanxi Wu Di Wu Xu Chen 26 16 0 01 Feb 2023
Near-Optimal Regret Bounds for Multi-batch Reinforcement Learning Zihan Zhang Yuhang Jiang Yuanshuo Zhou Xiangyang Ji OffRL 26 9 0 15 Oct 2022
AMP: Automatically Finding Model Parallel Strategies with Heterogeneity Awareness Dacheng Li Hongyi Wang Eric P. Xing Haotong Zhang MoE 22 21 0 13 Oct 2022
DreamShard: Generalizable Embedding Table Placement for Recommender Systems Daochen Zha Louis Feng Qiaoyu Tan Zirui Liu Kwei-Herng Lai Bhargav Bhushanam Yuandong Tian A. Kejariwal Xia Hu LMTD OffRL 33 28 0 05 Oct 2022
Celeritas: Fast Optimizer for Large Dataflow Graphs Hengwei Xu Yong Liao Haiyong Xie Pengyuan Zhou GNN 17 1 0 30 Jul 2022
Sym-NCO: Leveraging Symmetricity for Neural Combinatorial Optimization Minsu Kim Junyoung Park Jinkyoo Park 78 80 0 26 May 2022
MiCS: Near-linear Scaling for Training Gigantic Model on Public Cloud Zhen Zhang Shuai Zheng Yida Wang Justin Chiu George Karypis Trishul Chilimbi Mu Li Xin Jin 19 39 0 30 Apr 2022
FuncPipe: A Pipelined Serverless Framework for Fast and Cost-efficient Training of Deep Learning Models Yunzhuo Liu Bo Jiang Tian Guo Zimeng Huang Wen-ping Ma Xinbing Wang Chenghu Zhou 24 9 0 28 Apr 2022
Efficient Pipeline Planning for Expedited Distributed DNN Training Ziyue Luo Xiaodong Yi Guoping Long Shiqing Fan Chuan Wu Jun Yang Wei Lin 36 16 0 22 Apr 2022
Reinforcement Learning in Practice: Opportunities and Challenges Yuxi Li OffRL 38 9 0 23 Feb 2022
TopoOpt: Co-optimizing Network Topology and Parallelization Strategy for Distributed Training Jobs Weiyang Wang Moein Khazraee Zhizhen Zhong M. Ghobadi Zhihao Jia Dheevatsa Mudigere Ying Zhang A. Kewitsch 39 85 0 01 Feb 2022
Accelerate Model Parallel Training by Using Efficient Graph Traversal Order in Device Placement Tianze Wang A. H. Payberah D. Hagos Vladimir Vlassov GNN 28 0 0 21 Jan 2022
Automated Deep Learning: Neural Architecture Search Is Not the End Xuanyi Dong D. Kedziora Katarzyna Musial Bogdan Gabrys 29 26 0 16 Dec 2021
BoGraph: Structured Bayesian Optimization From Logs for Expensive Systems with Many Parameters Sami Alabed Eiko Yoneki 17 7 0 16 Dec 2021
HeterPS: Distributed Deep Learning With Reinforcement Learning Based Scheduling in Heterogeneous Environments Ji Liu Zhihua Wu Dianhai Yu Yanjun Ma Danlei Feng Minxu Zhang Xinxuan Wu Xuefeng Yao Dejing Dou 18 44 0 20 Nov 2021
FTPipeHD: A Fault-Tolerant Pipeline-Parallel Distributed Training Framework for Heterogeneous Edge Devices Yuhao Chen Qianqian Yang Shibo He Zhiguo Shi Jiming Chen 18 3 0 06 Oct 2021
Toward Efficient Online Scheduling for Distributed Machine Learning Systems Menglu Yu Jia Liu Chuan Wu Bo Ji Elizabeth S. Bentley 16 6 0 06 Aug 2021
High-Dimensional Bayesian Optimization with Multi-Task Learning for RocksDB Sami Alabed Eiko Yoneki 21 17 0 30 Mar 2021
A Survey of Machine Learning for Computer Architecture and Systems Nan Wu Yuan Xie AI4TS AI4CE 20 145 0 16 Feb 2021
AutoDropout: Learning Dropout Patterns to Regularize Deep Networks Hieu H. Pham Quoc V. Le 76 56 0 05 Jan 2021
Scaling Distributed Deep Learning Workloads beyond the Memory Capacity with KARMA M. Wahib Haoyu Zhang Truong Thao Nguyen Aleksandr Drozd Jens Domke Lingqi Zhang Ryousei Takano Satoshi Matsuoka OODD 34 23 0 26 Aug 2020
Runtime Task Scheduling using Imitation Learning for Heterogeneous Many-Core Systems A. Krishnakumar Samet E. Arda A. Alper Goksoy Sumit K. Mandal Ümit Y. Ogras A. L. Sartor R. Marculescu 14 31 0 18 Jul 2020
Optimizing Memory Placement using Evolutionary Graph Reinforcement Learning Shauharda Khadka Estelle Aflalo Mattias Marder Avrech Ben-David Santiago Miret Shie Mannor Tamir Hazan Hanlin Tang Somdeb Majumdar GNN 27 11 0 14 Jul 2020
DAPPLE: A Pipelined Data Parallel Approach for Training Large Models Shiqing Fan Yi Rong Chen Meng Zongyan Cao Siyu Wang ... Jun Yang Lixue Xia Lansong Diao Xiaoyong Liu Wei Lin 21 233 0 02 Jul 2020
Hardware Acceleration of Sparse and Irregular Tensor Computations of ML Models: A Survey and Insights Shail Dave Riyadh Baghdadi Tony Nowatzki Sasikanth Avancha Aviral Shrivastava Baoxin Li 61 82 0 02 Jul 2020
Data Movement Is All You Need: A Case Study on Optimizing Transformers A. Ivanov Nikoli Dryden Tal Ben-Nun Shigang Li Torsten Hoefler 36 131 0 30 Jun 2020
Efficient Algorithms for Device Placement of DNN Graph Operators Jakub Tarnawski Amar Phanishayee Nikhil R. Devanur Divya Mahajan Fanny Nina Paravecino 27 66 0 29 Jun 2020
Automated Optical Multi-layer Design via Deep Reinforcement Learning Haozhu Wang Zeyu Zheng Chengang Ji L. J. Guo 17 3 0 21 Jun 2020
DeepSoCS: A Neural Scheduler for Heterogeneous System-on-Chip (SoC) Resource Scheduling Tegg Taekyong Sung J. Ha Jeewoo Kim Alex Yahja Chae-Bong Sohn Bo Ryu 21 9 0 15 May 2020
Taskflow: A Lightweight Parallel and Heterogeneous Task Graph Computing System Tsung-Wei Huang Dian-Lun Lin Chun-Xun Lin Yibo Lin 6 117 0 23 Apr 2020
TensorOpt: Exploring the Tradeoffs in Distributed DNN Training with Auto-Parallelism Zhenkun Cai Kaihao Ma Xiao Yan Yidi Wu Yuzhen Huang James Cheng Teng Su F. Yu 24 42 0 16 Apr 2020
ProGraML: Graph-based Deep Learning for Program Optimization and Analysis Chris Cummins Zacharias V. Fisches Tal Ben-Nun Torsten Hoefler Hugh Leather 88 56 0 23 Mar 2020
Communication-Efficient Edge AI: Algorithms and Systems Yuanming Shi Kai Yang Tao Jiang Jun Zhang Khaled B. Letaief GNN 29 327 0 22 Feb 2020
Chameleon: Adaptive Code Optimization for Expedited Deep Neural Network Compilation Byung Hoon Ahn Prannoy Pilligundla Amir Yazdanbakhsh H. Esmaeilzadeh ODL 61 80 0 23 Jan 2020
Wield: Systematic Reinforcement Learning With Progressive Randomization Michael Schaarschmidt Kai Fricke Eiko Yoneki 19 2 0 15 Sep 2019
DL2: A Deep Learning-driven Scheduler for Deep Learning Clusters Size Zheng Yixin Bao Yangrui Chen Chuan Wu Chen Meng Wei Lin 21 79 0 13 Sep 2019
Optimizing Multi-GPU Parallelization Strategies for Deep Learning Training Saptadeep Pal Eiman Ebrahimi A. Zulfiqar Yaosheng Fu Victor Zhang Szymon Migacz D. Nellans Puneet Gupta 34 55 0 30 Jul 2019
DeepPlace: Learning to Place Applications in Multi-Tenant Clusters Subrata Mitra S. S. Mondal Nikhil Sheoran Neeraj Dhake Ravinder Nehra Ramanuja Simha 19 7 0 30 Jul 2019
Co-training for Policy Learning Jialin Song Ravi Lanka Yisong Yue M. Ono OffRL 15 19 0 03 Jul 2019
Database Meets Deep Learning: Challenges and Opportunities Wei Wang Meihui Zhang Gang Chen H. V. Jagadish Beng Chin Ooi K. Tan 13 147 0 21 Jun 2019