v1v2v3 (latest)

How Low Can We Go: Trading Memory for Error in Low-Precision Training

17 June 2021

Papers citing "How Low Can We Go: Trading Memory for Error in Low-Precision Training"

25 / 25 papers shown

Title
A Bregman Learning Framework for Sparse Neural Networks Leon Bungert Tim Roith Daniel Tenbrinck Martin Burger 64 18 0 10 May 2021
The Hardware Lottery Sara Hooker 75 212 0 14 Sep 2020
Extending and Analyzing Self-Supervised Learning Across Domains Bram Wallace B. Hariharan SSL 34 43 0 24 Apr 2020
Rethinking Differentiable Search for Mixed-Precision Neural Networks Zhaowei Cai Nuno Vasconcelos MQ 42 126 0 13 Apr 2020
Meta-Learning in Neural Networks: A Survey Timothy M. Hospedales Antreas Antoniou P. Micaelli Amos Storkey OOD 393 1,987 0 11 Apr 2020
Missing Not at Random in Matrix Completion: The Effectiveness of Estimating Missingness Probabilities Under a Low Nuclear Norm Assumption Wei-Ying Ma George H. Chen 118 51 0 28 Oct 2019
QPyTorch: A Low-Precision Arithmetic Simulation Framework Tianyi Zhang Zhiqiu Lin Guandao Yang Christopher De Sa MQ 53 66 0 09 Oct 2019
Cheetah: Mixed Low-Precision Hardware & Software Co-Design Framework for DNNs on the Edge H. F. Langroudi Zachariah Carmichael David Pastuch Dhireesha Kudithipudi 46 24 0 06 Aug 2019
Low-Memory Neural Network Training: A Technical Report N. Sohoni Christopher R. Aberger Megan Leszczynski Jian Zhang Christopher Ré 50 102 0 24 Apr 2019
MetaPruning: Meta Learning for Automatic Neural Network Channel Pruning Zechun Liu Haoyuan Mu Xiangyu Zhang Zichao Guo Xin Yang K. Cheng Jian Sun 78 563 0 25 Mar 2019
Mixed Precision Quantization of ConvNets via Differentiable Neural Architecture Search Bichen Wu Yanghan Wang Peizhao Zhang Yuandong Tian Peter Vajda Kurt Keutzer MQ 68 273 0 30 Nov 2018
Meta-Learning: A Survey Joaquin Vanschoren FedML OOD 69 762 0 08 Oct 2018
OBOE: Collaborative Filtering for AutoML Model Selection Chengrun Yang Yuji Akimoto Dae Won Kim Madeleine Udell 50 101 0 09 Aug 2018
A Tutorial on Bayesian Optimization P. Frazier GP 111 1,788 0 08 Jul 2018
High-Accuracy Low-Precision Training Christopher De Sa Megan Leszczynski Jian Zhang Alana Marzoev Christopher R. Aberger K. Olukotun Christopher Ré 67 109 0 09 Mar 2018
Apprentice: Using Knowledge Distillation Techniques To Improve Low-Precision Network Accuracy Asit K. Mishra Debbie Marr FedML 65 331 0 15 Nov 2017
Mixed Precision Training Paulius Micikevicius Sharan Narang Jonah Alben G. Diamos Erich Elsen ... Boris Ginsburg Michael Houston Oleksii Kuchaiev Ganesh Venkatesh Hao Wu 166 1,804 0 10 Oct 2017
Probabilistic Matrix Factorization for Automated Machine Learning Nicolò Fusi Rishit Sheth Melih Elibol 51 135 0 15 May 2017
Understanding the Impact of Precision Quantization on the Accuracy and Energy of Neural Networks S. Hashemi Nicholas Anthony Hokchhay Tann R. I. Bahar Sherief Reda MQ HAI 52 118 0 12 Dec 2016
The ZipML Framework for Training Models with End-to-End Low Precision: The Cans, the Cannots, and a Little Bit of Deep Learning Hantian Zhang Jerry Li Kaan Kara Dan Alistarh Ji Liu Ce Zhang MQ 52 20 0 16 Nov 2016
DoReFa-Net: Training Low Bitwidth Convolutional Neural Networks with Low Bitwidth Gradients Shuchang Zhou Yuxin Wu Zekun Ni Xinyu Zhou He Wen Yuheng Zou MQ 122 2,090 0 20 Jun 2016
Deep Learning with Limited Numerical Precision Suyog Gupta A. Agrawal K. Gopalakrishnan P. Narayanan HAI 207 2,049 0 09 Feb 2015
Matrix Completion and Low-Rank SVD via Fast Alternating Least Squares Trevor Hastie Rahul Mazumder Jason D. Lee R. Zadeh 154 526 0 09 Oct 2014
Very Deep Convolutional Networks for Large-Scale Image Recognition Karen Simonyan Andrew Zisserman FAtt MDE 1.7K 100,479 0 04 Sep 2014
Templates for Convex Cone Problems with Applications to Sparse Signal Recovery Stephen Becker Emmanuel J. Candès Michael C. Grant 98 681 0 10 Sep 2010