Rethinking floating point for deep learning

1 November 2018

Papers citing "Rethinking floating point for deep learning"

14 / 14 papers shown

Title
MinUn: Accurate ML Inference on Microcontrollers Shikhar Jaiswal R. Goli Aayan Kumar Vivek Seshadri Rahul Sharma 29 2 0 29 Oct 2022
FP8 Formats for Deep Learning Paulius Micikevicius Dusan Stosic N. Burgess Marius Cornea Pradeep Dubey ... Naveen Mellempudi S. Oberman M. Shoeybi Michael Siu Hao Wu BDL VLM MQ 77 126 0 12 Sep 2022
8-bit Numerical Formats for Deep Neural Networks Badreddine Noune Philip Jones Daniel Justus Dominic Masters Carlo Luschi MQ 23 34 0 06 Jun 2022
Single-Shot Optical Neural Network Liane Bernstein Alexander Sludds C. Panuski Sivan Trajtenberg‐Mills R. Hamerly Dirk Englund BDL 33 44 0 18 May 2022
The Efficiency Misnomer Daoyuan Chen Liuyi Yao Dawei Gao Ashish Vaswani Yaliang Li 39 99 0 25 Oct 2021
LNS-Madam: Low-Precision Training in Logarithmic Number System using Multiplicative Weight Update Jiawei Zhao Steve Dai Rangharajan Venkatesan Brian Zimmer Mustafa Ali Xuan Li Brucek Khailany B. Dally Anima Anandkumar MQ 39 13 0 26 Jun 2021
PositNN: Training Deep Neural Networks with Mixed Low-Precision Posit Gonçalo Raposo P. Tomás Nuno Roma MQ 42 19 0 30 Apr 2021
PLAM: a Posit Logarithm-Approximate Multiplier Raul Murillo Alberto A. Del Barrio Guillermo Botella Min Soo Kim Hyunjin Kim N. Bagherzadeh TPM 29 25 0 18 Feb 2021
Towards Fully 8-bit Integer Inference for the Transformer Model Ye Lin Yanyang Li Tengbo Liu Tong Xiao Tongran Liu Jingbo Zhu MQ 6 62 0 17 Sep 2020
Shifted and Squeezed 8-bit Floating Point format for Low-Precision Training of Deep Neural Networks Léopold Cambier Anahita Bhiwandiwalla Ting Gong M. Nekuii Oguz H. Elibol Hanlin Tang MQ 21 48 0 16 Jan 2020
Neural Network Training with Approximate Logarithmic Computations Arnab Sanyal P. Beerel K. Chugg 27 11 0 22 Oct 2019
Training Deep Neural Networks Using Posit Number System Jinming Lu Siyuan Lu Zhisheng Wang Chao Fang Jun Lin Zhongfeng Wang Li Du MQ 27 13 0 06 Sep 2019
Deep Learning Training on the Edge with Low-Precision Posits H. F. Langroudi Zachariah Carmichael Dhireesha Kudithipudi MQ 21 14 0 30 Jul 2019
Deep Positron: A Deep Neural Network Using the Posit Number System Zachariah Carmichael Seyed Hamed Fatemi Langroudi Char Khazanov Jeffrey Lillie J. Gustafson Dhireesha Kudithipudi MQ 17 96 0 05 Dec 2018