Is Integer Arithmetic Enough for Deep Learning Training?

v1v2v3 (latest)

Is Integer Arithmetic Enough for Deep Learning Training?

18 July 2022

Alireza Ghaffari

Marzieh S. Tahaei

Mohammadreza Tayaranian

ArXiv (abs)PDF HTML

Papers citing "Is Integer Arithmetic Enough for Deep Learning Training?"

10 / 10 papers shown

Title
HOT: Hadamard-based Optimized Training Seonggon Kim Juncheol Shin Seung-taek Woo Eunhyeok Park 102 0 0 27 Mar 2025
Rethinking Post-Training Quantization: Introducing a Statistical Pre-Calibration Approach Alireza Ghaffari Sharareh Younesian Boxing Chen Vahid Partovi Nia M. Asgharian MQ 75 0 0 17 Jan 2025
Towards Accurate and Efficient Sub-8-Bit Integer Training Wenjin Guo Donglai Liu Weiying Xie Yunsong Li Xuefei Ning Zihan Meng Shulin Zeng Jie Lei Zhenman Fang Yu Wang MQ 51 1 0 17 Nov 2024
AdpQ: A Zero-shot Calibration Free Adaptive Post Training Quantization Method for LLMs Alireza Ghaffari Sharareh Younesian Vahid Partovi Nia Boxing Chen M. Asgharian MQ 70 0 0 22 May 2024
Understanding Neural Network Binarization with Forward and Backward Proximal Quantizers Yiwei Lu Yaoliang Yu Xinlin Li Vahid Partovi Nia MQ 78 3 0 27 Feb 2024
Mitigating Outlier Activations in Low-Precision Fine-Tuning of Language Models Alireza Ghaffari Justin Yu Mahsa Ghazvini Nejad M. Asgharian Boxing Chen Vahid Partovi Nia 60 2 0 14 Dec 2023
Mathematical Challenges in Deep Learning V. Nia Guojun Zhang I. Kobyzev Michael R. Metel Xinlin Li ... S. Hemati M. Asgharian Linglong Kong Wulong Liu Boxing Chen AI4CE VLM 63 1 0 24 Mar 2023
Virtualization of Tiny Embedded Systems with a robust real-time capable and extensible Stack Virtual Machine REXAVM supporting Material-integrated Intelligent Systems and Tiny Machine Learning S. Bosse Sarah Bornemann B. Lüssem 31 3 0 17 Feb 2023
On the Convergence of Stochastic Gradient Descent in Low-precision Number Formats M. Cacciola A. Frangioni M. Asgharian Alireza Ghaffari V. Nia 84 4 0 04 Jan 2023
Towards Fine-tuning Pre-trained Language Models with Integer Forward and Backward Propagation Mohammadreza Tayaranian Alireza Ghaffari Marzieh S. Tahaei Mehdi Rezagholizadeh M. Asgharian V. Nia MQ 63 6 0 20 Sep 2022

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.