v1v2v3 (latest)

Training Quantized Nets: A Deeper Understanding

7 June 2017

Hao Li

Papers citing "Training Quantized Nets: A Deeper Understanding"

50 / 116 papers shown

Title
Beyond Discreteness: Finite-Sample Analysis of Straight-Through Estimator for Quantization Halyun Jeong Jack Xin Penghang Yin MQ 29 0 0 23 May 2025
Deploying Large AI Models on Resource-Limited Devices with Split Federated Learning Xianke Qiang Hongda Liu Xinran Zhang Zheng Chang Ying-Chang Liang FedML 65 0 0 12 Apr 2025
Optimization of Layer Skipping and Frequency Scaling for Convolutional Neural Networks under Latency Constraint Minh David Thao Chan Ruoyu Zhao Yukuan Jia Ruiqing Mao Sheng Zhou 80 0 0 31 Mar 2025
PARQ: Piecewise-Affine Regularized Quantization Lisa Jin Jianhao Ma Zechun Liu Andrey Gromov Aaron Defazio Lin Xiao MQ 71 1 0 19 Mar 2025
Stochastic Rounding for LLM Training: Theory and Practice Kaan Ozkara Tao Yu Youngsuk Park 69 0 0 27 Feb 2025
LORENZA: Enhancing Generalization in Low-Rank Gradient LLM Training via Efficient Zeroth-Order Adaptive SAM Yehonathan Refael Iftach Arbel Ofir Lindenbaum Tom Tirer 169 1 0 26 Feb 2025
AdaRankGrad: Adaptive Gradient-Rank and Moments for Memory-Efficient LLMs Training and Fine-Tuning Yehonathan Refael Jonathan Svirsky Boris Shustin Wasim Huleihel Ofir Lindenbaum 101 4 0 31 Dec 2024
Ex Uno Pluria: Insights on Ensembling in Low Precision Number Systems G. Nam Juho Lee 133 0 0 22 Nov 2024
Robust Training of Neural Networks at Arbitrary Precision and Sparsity Chengxi Ye Grace Chu Yanfeng Liu Yichi Zhang Lukasz Lew Andrew G. Howard MQ 56 2 0 14 Sep 2024
Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients Zhenyu Zhang Ajay Jaiswal L. Yin Shiwei Liu Jiawei Zhao Yuandong Tian Zhangyang Wang VLM 75 23 0 11 Jul 2024
BOLD: Boolean Logic Deep Learning Van Minh Nguyen Cristian Ocampo Aymen Askri Louis Leconte Ba-Hien Tran AI4CE 110 1 0 25 May 2024
OAC: Output-adaptive Calibration for Accurate Post-training Quantization Ali Edalati Alireza Ghaffari M. Asgharian Lu Hou Boxing Chen Vahid Partovi Nia V. Nia MQ 171 0 0 23 May 2024
Collage: Light-Weight Low-Precision Strategy for LLM Training Tao Yu Gaurav Gupta Karthick Gopalswamy Amith R. Mamidala Hao Zhou Jeffrey Huynh Youngsuk Park Ron Diamant Anoop Deoras Jun Huan MQ 99 3 0 06 May 2024
QGen: On the Ability to Generalize in Quantization Aware Training Mohammadhossein Askarihemmat Ahmadreza Jeddi Reyhane Askari Hemmat Ivan Lazarevich Alexander Hoffman Sudhakar Sah Ehsan Saboori Yvon Savaria Jean-Pierre David MQ 99 1 0 17 Apr 2024
Lowering PyTorch's Memory Consumption for Selective Differentiation Samarth Bhatia Felix Dangel 52 1 0 15 Apr 2024
RQP-SGD: Differential Private Machine Learning through Noisy SGD and Randomized Quantization Ce Feng Parv Venkitasubramaniam 69 1 0 09 Feb 2024
Effect of Weight Quantization on Learning Models by Typical Case Analysis Shuhei Kashiwamura Ayaka Sakata Masaaki Imaizumi MQ 61 1 0 30 Jan 2024
Boolean Logic as an Error feedback mechanism Louis Leconte 37 0 0 29 Jan 2024
Experimental Analysis of Large-scale Learnable Vector Storage Compression Hailin Zhang Penghao Zhao Xupeng Miao Yingxia Shao Zirui Liu Tong Yang Tengjiao Wang 79 13 0 27 Nov 2023
Multiplication-Free Transformer Training via Piecewise Affine Operations Atli Kosson Martin Jaggi 32 5 0 26 May 2023
FAVANO: Federated AVeraging with Asynchronous NOdes Louis Leconte Van Minh Nguyen Eric Moulines FedML 77 2 0 25 May 2023
A Novel Stochastic LSTM Model Inspired by Quantum Machine Learning Joseph Lindsay Ramtin Zand 34 3 0 17 May 2023
Fixed-point quantization aware training for on-device keyword-spotting Sashank Macha Om Oza Alex Escott Francesco Calivá Robert M. Armitano S. Cheekatmalla S. Parthasarathi Yuzong Liu MQ 42 4 0 04 Mar 2023
Stochastic Approximation Beyond Gradient for Signal Processing and Machine Learning Aymeric Dieuleveut G. Fort Eric Moulines Hoi-To Wai 74 12 0 22 Feb 2023
Hard Prompts Made Easy: Gradient-Based Discrete Optimization for Prompt Tuning and Discovery Yuxin Wen Neel Jain John Kirchenbauer Micah Goldblum Jonas Geiping Tom Goldstein VLM DiffM 116 273 1 07 Feb 2023
Straight-Through meets Sparse Recovery: the Support Exploration Algorithm Mimoun Mohamed Franccois Malgouyres Valentin Emiya C. Chaux 26 1 0 31 Jan 2023
Gradient Shaping: Enhancing Backdoor Attack Against Reverse Engineering Rui Zhu Di Tang Siyuan Tang Guanhong Tao Shiqing Ma Xiaofeng Wang Haixu Tang DD 61 4 0 29 Jan 2023
Adaptive Low-Precision Training for Embeddings in Click-Through Rate Prediction Shiwei Li Huifeng Guo Luyao Hou Wei Zhang Xing Tang Ruiming Tang Rui Zhang Rui Li MQ 315 11 0 12 Dec 2022
AskewSGD : An Annealed interval-constrained Optimisation method to train Quantized Neural Networks Louis Leconte S. Schechtman Eric Moulines 85 4 0 07 Nov 2022
MinUn: Accurate ML Inference on Microcontrollers Shikhar Jaiswal R. Goli Aayan Kumar Vivek Seshadri Rahul Sharma 88 3 0 29 Oct 2022
Reducing Computational Complexity of Neural Networks in Optical Channel Equalization: From Concepts to Implementation Pedro J. Freire A. Napoli D. A. Ron B. Spinnler M. Anderson W. Schairer T. Bex N. Costa S. Turitsyn Jaroslaw E. Prilepsky 76 29 0 26 Aug 2022
Quantized Training of Gradient Boosting Decision Trees Yu Shi Guolin Ke Zhuoming Chen Shuxin Zheng Tie-Yan Liu MQ AI4CE 73 19 0 20 Jul 2022
Quantization Robust Federated Learning for Efficient Inference on Heterogeneous Devices Kartik Gupta Marios Fournarakis M. Reisser Christos Louizos Markus Nagel FedML 69 16 0 22 Jun 2022
Low-Precision Stochastic Gradient Langevin Dynamics Ruqi Zhang A. Wilson Chris De Sa BDL 63 14 0 20 Jun 2022
AMED: Automatic Mixed-Precision Quantization for Edge Devices Moshe Kimhi T. Rozen A. Mendelson Chaim Baskin MQ 61 3 0 30 May 2022
Wavelet Feature Maps Compression for Image-to-Image CNNs Shahaf E. Finder Yair Zohav Maor Ashkenazi Eran Treister 114 22 0 24 May 2022
Service Delay Minimization for Federated Learning over Mobile Devices Rui Chen Dian Shi Xiaoqi Qin Dongjie Liu Miao Pan Shuguang Cui FedML 90 34 0 19 May 2022
Training Quantised Neural Networks with STE Variants: the Additive Noise Annealing Algorithm Matteo Spallanzani G. P. Leonardi Luca Benini 48 3 0 21 Mar 2022
CoCoFL: Communication- and Computation-Aware Federated Learning via Partial NN Freezing and Quantization Kilian Pfeiffer Martin Rapp R. Khalili J. Henkel FedML 114 11 0 10 Mar 2022
Update Compression for Deep Neural Networks on the Edge Bo Chen A. Bakhshi Gustavo E. A. P. A. Batista Brian Ng Tat-Jun Chin 48 18 0 09 Mar 2022
On the influence of stochastic roundoff errors and their bias on the convergence of the gradient descent method with low-precision floating-point computation Lu Xia Stefano Massei M. Hochstenbach B. Koren 44 2 0 24 Feb 2022
LG-LSQ: Learned Gradient Linear Symmetric Quantization Shih-Ting Lin Zhaofang Li Yu-Hsiang Cheng Hao-Wen Kuo Chih-Cheng Lu K. Tang MQ 68 2 0 18 Feb 2022
PokeBNN: A Binary Pursuit of Lightweight Accuracy Yichi Zhang Zhiru Zhang Lukasz Lew MQ 97 61 0 30 Nov 2021
DAdaQuant: Doubly-adaptive quantization for communication-efficient Federated Learning Robert Hönig Yiren Zhao Robert D. Mullins FedML 168 59 0 31 Oct 2021
Demystifying and Generalizing BinaryConnect Abhishek Sharma Yaoliang Yu Eyyub Sari Mahdi Zolnouri V. Nia MQ 64 9 0 25 Oct 2021
VC dimension of partially quantized neural networks in the overparametrized regime Yutong Wang Clayton D. Scott 81 1 0 06 Oct 2021
Efficient Visual Recognition with Deep Neural Networks: A Survey on Recent Advances and New Directions Yang Wu Dingheng Wang Xiaotong Lu Fan Yang Guoqi Li W. Dong Jianbo Shi 104 18 0 30 Aug 2021
QuPeD: Quantized Personalization via Distillation with Applications to Federated Learning Kaan Ozkara Navjot Singh Deepesh Data Suhas Diggavi FedML MQ 91 58 0 29 Jul 2021
Adaptive Precision Training (AdaPT): A dynamic fixed point quantized training approach for DNNs Lorenz Kummer Kevin Sidak Tabea Reichmann Wilfried Gansterer MQ 70 6 0 28 Jul 2021
Exact Backpropagation in Binary Weighted Networks with Group Weight Transformations Yaniv Shulman MQ 26 1 0 03 Jul 2021