A Graph Theoretic Framework of Recomputation Algorithms for
Memory-Efficient Backpropagation

A Graph Theoretic Framework of Recomputation Algorithms for Memory-Efficient Backpropagation

28 May 2019

Masanori Koyama

ArXiv (abs)PDF HTML

Papers citing "A Graph Theoretic Framework of Recomputation Algorithms for Memory-Efficient Backpropagation"

15 / 15 papers shown

Title
Chainer: A Deep Learning Framework for Accelerating the Research Cycle Seiya Tokui Ryosuke Okuta Takuya Akiba Yusuke Niitani Toru Ogawa Shunta Saito Shuji Suzuki Kota Uenishi Brian K. Vogel Hiroyuki Yamazaki Vincent BDL AI4CE 58 130 0 01 Aug 2019
SuperNeurons: Dynamic GPU Memory Management for Training Deep Neural Networks Linnan Wang Jinmian Ye Yiyang Zhao Wei Wu Ang Li Shuaiwen Leon Song Zenglin Xu Tim Kraska 3DH 94 265 0 13 Jan 2018
MegDet: A Large Mini-Batch Object Detector Chao Peng Tete Xiao Zeming Li Yuning Jiang Xiangyu Zhang Kai Jia Gang Yu Jian Sun ObjD 179 318 0 20 Nov 2017
Mixed Precision Training Paulius Micikevicius Sharan Narang Jonah Alben G. Diamos Erich Elsen ... Boris Ginsburg Michael Houston Oleksii Kuchaiev Ganesh Venkatesh Hao Wu 157 1,799 0 10 Oct 2017
Memory-Efficient Implementation of DenseNets Geoff Pleiss Danlu Chen Gao Huang Tongcheng Li Laurens van der Maaten Kilian Q. Weinberger 68 159 0 21 Jul 2017
ThiNet: A Filter Level Pruning Method for Deep Neural Network Compression Jian-Hao Luo Jianxin Wu Weiyao Lin 58 1,760 0 20 Jul 2017
Pyramid Scene Parsing Network Hengshuang Zhao Jianping Shi Xiaojuan Qi Xiaogang Wang Jiaya Jia VOS SSeg 665 12,015 0 04 Dec 2016
Densely Connected Convolutional Networks Gao Huang Zhuang Liu Laurens van der Maaten Kilian Q. Weinberger PINN 3DV 772 36,813 0 25 Aug 2016
Memory-Efficient Backpropagation Through Time A. Gruslys Rémi Munos Ivo Danihelka Marc Lanctot Alex Graves 63 229 0 10 Jun 2016
Training Deep Nets with Sublinear Memory Cost Tianqi Chen Bing Xu Chiyuan Zhang Carlos Guestrin 103 1,167 0 21 Apr 2016
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 2.2K 194,020 0 10 Dec 2015
U-Net: Convolutional Networks for Biomedical Image Segmentation Olaf Ronneberger Philipp Fischer Thomas Brox SSeg 3DV 1.8K 77,196 0 18 May 2015
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift Sergey Ioffe Christian Szegedy OOD 463 43,305 0 11 Feb 2015
Going Deeper with Convolutions Christian Szegedy Wei Liu Yangqing Jia P. Sermanet Scott E. Reed Dragomir Anguelov D. Erhan Vincent Vanhoucke Andrew Rabinovich 468 43,658 0 17 Sep 2014
Very Deep Convolutional Networks for Large-Scale Image Recognition Karen Simonyan Andrew Zisserman FAtt MDE 1.6K 100,386 0 04 Sep 2014