How Do Adam and Training Strategies Help BNNs Optimization?

21 June 2021

Papers citing "How Do Adam and Training Strategies Help BNNs Optimization?"

45 / 45 papers shown

Title
A Langevin sampling algorithm inspired by the Adam optimizer B. Leimkuhler René Lohmann P. Whalley 79 0 0 26 Apr 2025
Expanding-and-Shrinking Binary Neural Networks Xulong Shi Caiyi Sun Zhi Qi Liu Hao Xiaodong Yang MQ 54 0 0 31 Mar 2025
Diagnosis of Malignant Lymphoma Cancer Using Hybrid Optimized Techniques Based on Dense Neural Networks Salah A. Aly Ali M. Bakhiet Mazen Balat 26 0 0 09 Oct 2024
Robust Training of Neural Networks at Arbitrary Precision and Sparsity Chengxi Ye Grace Chu Yanfeng Liu Yichi Zhang Lukasz Lew Andrew G. Howard MQ 27 2 0 14 Sep 2024
Sparks of Quantum Advantage and Rapid Retraining in Machine Learning William Troy AI4CE 18 5 0 22 Jul 2024
FBI-LLM: Scaling Up Fully Binarized LLMs from Scratch via Autoregressive Distillation Liqun Ma Mingjie Sun Zhiqiang Shen 29 6 0 09 Jul 2024
OvSW: Overcoming Silent Weights for Accurate Binary Neural Networks Jingyang Xiang Zuohui Chen Siqi Li Qing Wu Yong-Jin Liu 26 1 0 07 Jul 2024
Towards Communication-efficient Federated Learning via Sparse and Aligned Adaptive Optimization Xiumei Deng Jun Li Kang Wei Long Shi Zeihui Xiong Ming Ding Wen Chen Shi Jin H. Vincent Poor FedML 51 0 0 28 May 2024
Efficient Multitask Dense Predictor via Binarization Yuzhang Shang Dan Xu Gaowen Liu Ramana Rao Kompella Yan Yan MQ AAML 27 1 0 23 May 2024
Custom Gradient Estimators are Straight-Through Estimators in Disguise Matt Schoenbauer Daniele Moro Lukasz Lew Andrew G. Howard MQ 23 3 0 08 May 2024
Long-Tailed Recognition on Binary Networks by Calibrating A Pre-trained Model Jihun Kim Dahyun Kim Hyungrok Jung Taeil Oh Jonghyun Choi MQ 47 0 0 30 Mar 2024
PikeLPN: Mitigating Overlooked Inefficiencies of Low-Precision Neural Networks Marina Neseem Conor McCullough Randy Hsin Chas Leichner Shan Li ... Andrew G. Howard Lukasz Lew Sherief Reda Ville Rautio Daniele Moro MQ 42 0 0 29 Mar 2024
A&B BNN: Add&Bit-Operation-Only Hardware-Friendly Binary Neural Network Ruichen Ma G. Qiao Yián Liu L. Meng N. Ning Yang Liu Shaogang Hu AAML MQ 26 3 0 06 Mar 2024
Understanding Neural Network Binarization with Forward and Backward Proximal Quantizers Yiwei Lu Yaoliang Yu Xinlin Li Vahid Partovi Nia MQ 30 3 0 27 Feb 2024
BitNet: Scaling 1-bit Transformers for Large Language Models Hongyu Wang Shuming Ma Li Dong Shaohan Huang Huaijie Wang Lingxiao Ma Fan Yang Ruiping Wang Yi Wu Furu Wei MQ 20 95 0 17 Oct 2023
DCP-NAS: Discrepant Child-Parent Neural Architecture Search for 1-bit CNNs Yanjing Li Sheng Xu Xianbin Cao Lian Zhuo Baochang Zhang Tian Wang Guodong Guo 30 3 0 27 Jun 2023
Binary domain generalization for sparsifying binary neural networks Riccardo Schiavone Francesco Galati Maria A. Zuluaga MQ 19 0 0 23 Jun 2023
Training Transformers with 4-bit Integers Haocheng Xi Changhao Li Jianfei Chen Jun Zhu MQ 25 47 0 21 Jun 2023
Optimizing data-flow in Binary Neural Networks Lorenzo Vorabbi Davide Maltoni Stefano Santi MQ 9 5 0 03 Apr 2023
Robotic Packaging Optimization with Reinforcement Learning E. Drijver Rodrigo Pérez-Dattari Jens Kober Cosimo Della Santina Zlatan Ajanović OffRL 21 1 0 26 Mar 2023
Understanding weight-magnitude hyperparameters in training binary networks Joris Quist Yun-qiang Li J. C. V. Gemert MQ 26 0 0 04 Mar 2023
Binarized Neural Machine Translation Yichi Zhang Ankush Garg Yuan Cao Lukasz Lew Behrooz Ghorbani Zhiru Zhang Orhan Firat MQ 29 14 0 09 Feb 2023
Oscillation-free Quantization for Low-bit Vision Transformers Shi Liu Zechun Liu Kwang-Ting Cheng MQ 13 34 0 04 Feb 2023
Join the High Accuracy Club on ImageNet with A Binary Neural Network Ticket Nianhui Guo Joseph Bethge Christoph Meinel Haojin Yang MQ 24 19 0 23 Nov 2022
BiViT: Extremely Compressed Binary Vision Transformer Yefei He Zhenyu Lou Luoming Zhang Jing Liu Weijia Wu Hong Zhou Bohan Zhuang ViT MQ 18 28 0 14 Nov 2022
Boosting Binary Neural Networks via Dynamic Thresholds Learning Jiehua Zhang Xueyang Zhang Z. Su Zitong Yu Yanghe Feng Xin Lu M. Pietikäinen Li Liu MQ 30 0 0 04 Nov 2022
LAB: Learnable Activation Binarizer for Binary Neural Networks Sieger Falkena Hadi Jamali Rad J. C. V. Gemert MQ 24 3 0 25 Oct 2022
Convolutional Neural Networks Quantization with Attention Binyi Wu Bernd Waschneck Christian Mayr MQ 13 1 0 30 Sep 2022
Towards Accurate Binary Neural Networks via Modeling Contextual Dependencies Xingrun Xing Yangguang Li Wei Li Wenrui Ding Yalong Jiang Yufeng Wang Jinghua Shao Chunlei Liu Xianglong Liu MQ 11 8 0 03 Sep 2022
RepBNN: towards a precise Binary Neural Network with Enhanced Feature Map via Repeating Xulong Shi Zhi Qi Jiaxuan Cai Keqi Fu Yaru Zhao Zan Li Xuanyu Liu Hao Liu MQ 14 3 0 19 Jul 2022
How to train accurate BNNs for embedded systems? F. D. Putter Henk Corporaal MQ 16 6 0 24 Jun 2022
Binarizing by Classification: Is soft function really necessary? Yefei He Luoming Zhang Weijia Wu Hong Zhou MQ 18 3 0 16 May 2022
LeHDC: Learning-Based Hyperdimensional Computing Classifier Shijin Duan Yejia Liu Shaolei Ren Xiaolin Xu 14 28 0 18 Mar 2022
A Brain-Inspired Low-Dimensional Computing Classifier for Inference on Tiny Devices Shijin Duan Xiaolin Xu Shaolei Ren 26 12 0 09 Mar 2022
TerViT: An Efficient Ternary Vision Transformer Sheng Xu Yanjing Li Teli Ma Bo-Wen Zeng Baochang Zhang Peng Gao Jinhu Lv ViT 15 11 0 20 Jan 2022
PokeBNN: A Binary Pursuit of Lightweight Accuracy Yichi Zhang Zhiru Zhang Lukasz Lew MQ 33 57 0 30 Nov 2021
Sharpness-aware Quantization for Deep Neural Networks Jing Liu Jianfei Cai Bohan Zhuang MQ 27 24 0 24 Nov 2021
Deep learning via message passing algorithms based on belief propagation C. Lucibello Fabrizio Pittorino Gabriele Perugini R. Zecchina 32 14 0 27 Oct 2021
A comprehensive review of Binary Neural Network Chunyu Yuan S. Agaian MQ 39 95 0 11 Oct 2021
Dynamic Binary Neural Network by learning channel-wise thresholds Jiehua Zhang Z. Su Yang Feng Xin Lu M. Pietikäinen Li Liu MQ 19 18 0 08 Oct 2021
S2-BNN: Bridging the Gap Between Self-Supervised Real and 1-bit Neural Networks via Guided Distribution Calibration Zhiqiang Shen Zechun Liu Jie Qin Lei Huang Kwang-Ting Cheng Marios Savvides UQCV SSL MQ 246 22 0 17 Feb 2021
Single-path Bit Sharing for Automatic Loss-aware Model Compression Jing Liu Bohan Zhuang Peng Chen Chunhua Shen Jianfei Cai Mingkui Tan MQ 13 7 0 13 Jan 2021
Forward and Backward Information Retention for Accurate Binary Neural Networks Haotong Qin Ruihao Gong Xianglong Liu Mingzhu Shen Ziran Wei F. Yu Jingkuan Song MQ 119 324 0 24 Sep 2019
Projection Convolutional Neural Networks for 1-bit CNNs via Discrete Back Propagation Jiaxin Gu Ce Li Baochang Zhang J. Han Xianbin Cao Jianzhuang Liu David Doermann 3DV 168 86 0 30 Nov 2018
Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation Yonghui Wu M. Schuster Z. Chen Quoc V. Le Mohammad Norouzi ... Alex Rudnick Oriol Vinyals G. Corrado Macduff Hughes J. Dean AIMat 716 6,743 0 26 Sep 2016