Deep Learning Training on the Edge with Low-Precision Posits

30 July 2019

Dhireesha Kudithipudi

Papers citing "Deep Learning Training on the Edge with Low-Precision Posits"

20 / 20 papers shown

Title
GSQ-Tuning: Group-Shared Exponents Integer in Fully Quantized Training for LLMs On-Device Fine-tuning Sifan Zhou Shuo Wang Zhihang Yuan Mingjia Shi Yuzhang Shang Dawei Yang MQ ALM 128 0 0 18 Feb 2025
Template-Based Posit Multiplication for Training and Inferring in Neural Networks Raul Murillo Alberto A. Del Barrio Guillermo Botella Juan 26 16 0 09 Jul 2019
Mixed Precision Training With 8-bit Floating Point Naveen Mellempudi Sudarshan Srinivasan Dipankar Das Bharat Kaul MQ 32 69 0 29 May 2019
A Study of BFLOAT16 for Deep Learning Training Dhiraj D. Kalamkar Dheevatsa Mudigere Naveen Mellempudi Dipankar Das K. Banerjee ... Sudarshan Srinivasan Abhisek Kundu M. Smelyanskiy Bharat Kaul Pradeep Dubey MQ 70 340 0 29 May 2019
Drop an Octave: Reducing Spatial Redundancy in Convolutional Neural Networks with Octave Convolution Yunpeng Chen Haoqi Fan Bing Xu Zhicheng Yan Yannis Kalantidis Marcus Rohrbach Shuicheng Yan Jiashi Feng 95 556 0 10 Apr 2019
Performance-Efficiency Trade-off of Low-Precision Numerical Formats in Deep Neural Networks Zachariah Carmichael H. F. Langroudi Char Khazanov Jeffrey Lillie J. Gustafson Dhireesha Kudithipudi 33 55 0 25 Mar 2019
Training Deep Neural Networks with 8-bit Floating Point Numbers Naigang Wang Jungwook Choi D. Brand Chia-Yu Chen K. Gopalakrishnan MQ 53 500 0 19 Dec 2018
Deep Positron: A Deep Neural Network Using the Posit Number System Zachariah Carmichael Seyed Hamed Fatemi Langroudi Char Khazanov Jeffrey Lillie J. Gustafson Dhireesha Kudithipudi MQ 41 96 0 05 Dec 2018
Rethinking floating point for deep learning Jeff Johnson MQ 92 138 0 01 Nov 2018
Edge Intelligence: On-Demand Deep Learning Model Co-Inference with Device-Edge Synergy En Li Zhi Zhou Xu Chen 38 325 0 20 Jun 2018
Revisiting the Importance of Individual Units in CNNs via Ablation Bolei Zhou Yiyou Sun David Bau Antonio Torralba FAtt 77 117 0 07 Jun 2018
Deep Learning Inference on Embedded Devices: Fixed-Point vs Posit Seyed Hamed Fatemi Langroudi Tej Pandit Dhireesha Kudithipudi MQ 37 41 0 22 May 2018
SBNet: Sparse Blocks Network for Fast Inference Mengye Ren A. Pokrovsky Binh Yang R. Urtasun 97 179 0 07 Jan 2018
Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference Benoit Jacob S. Kligys Bo Chen Menglong Zhu Matthew Tang Andrew G. Howard Hartwig Adam Dmitry Kalenichenko MQ 126 3,090 0 15 Dec 2017
Flexpoint: An Adaptive Numerical Format for Efficient Training of Deep Neural Networks Urs Koster T. Webb Xin Eric Wang Marcel Nassar Arjun K. Bansal ... Luke Hornof A. Khosrowshahi Carey Kloss Ruby J. Pai N. Rao MQ 43 261 0 06 Nov 2017
Mixed Precision Training Paulius Micikevicius Sharan Narang Jonah Alben G. Diamos Erich Elsen ... Boris Ginsburg Michael Houston Oleksii Kuchaiev Ganesh Venkatesh Hao Wu 139 1,779 0 10 Oct 2017
MEC: Memory-efficient Convolution for Deep Neural Network Minsik Cho D. Brand 41 86 0 21 Jun 2017
MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications Andrew G. Howard Menglong Zhu Bo Chen Dmitry Kalenichenko Weijun Wang Tobias Weyand M. Andreetto Hartwig Adam 3DH 1.1K 20,747 0 17 Apr 2017
Understanding the Impact of Precision Quantization on the Accuracy and Energy of Neural Networks S. Hashemi Nicholas Anthony Hokchhay Tann R. I. Bahar Sherief Reda MQ HAI 30 117 0 12 Dec 2016
Deep Learning with Limited Numerical Precision Suyog Gupta A. Agrawal K. Gopalakrishnan P. Narayanan HAI 141 2,043 0 09 Feb 2015