Compression of Fully-Connected Layer in Neural Network by Kronecker
Product

Compression of Fully-Connected Layer in Neural Network by Kronecker Product

21 July 2015

Shuchang Zhou

Papers citing "Compression of Fully-Connected Layer in Neural Network by Kronecker Product"

14 / 14 papers shown

Title
Krony-PT: GPT2 compressed with Kronecker Products M. Ayoub Ben Ayad Jelena Mitrović Michael Granitzer 73 0 0 16 Dec 2024
Layer-Specific Optimization: Sensitivity Based Convolution Layers Basis Search V. Alekseev Ilya Lukashevich Ilia Zharikov Ilya Vasiliev 29 0 0 12 Aug 2024
Fully invertible hyperbolic neural networks for segmenting large-scale surface and sub-surface data Bas Peters Eldad Haber Keegan Lensink 25 0 0 30 Jun 2024
TQCompressor: improving tensor decomposition methods in neural networks via permutations V. Abronin A. Naumov D. Mazur D. Bystrov K. Tsarova Ar. Melnikov Ivan Oseledets S. Dolgov R. Brasher M. Perelshtein 28 6 0 29 Jan 2024
Kronecker Decomposition for Knowledge Graph Embeddings Caglar Demir Julian Lienen A. N. Ngomo 23 3 0 13 May 2022
Learning Robust and Lightweight Model through Separable Structured Transformations Xian Wei Yanhui Huang Yang Xu Mingsong Chen Hai Lan Yuanxiang Li Zhongfeng Wang Xuan Tang OOD 24 0 0 27 Dec 2021
Kronecker Decomposition for GPT Compression Ali Edalati Marzieh S. Tahaei Ahmad Rashid V. Nia J. Clark Mehdi Rezagholizadeh 36 33 0 15 Oct 2021
KroneckerBERT: Learning Kronecker Decomposition for Pre-trained Language Models via Knowledge Distillation Marzieh S. Tahaei Ella Charlaix V. Nia A. Ghodsi Mehdi Rezagholizadeh 46 22 0 13 Sep 2021
Pushing the limits of RNN Compression Urmish Thakker Igor Fedorov Jesse G. Beu Dibakar Gope Chu Zhou Ganesh S. Dasika Matthew Mattina 16 13 0 04 Oct 2019
Deep Graph-Convolutional Image Denoising D. Valsesia Giulia Fracastoro E. Magli GNN SSL 19 144 0 19 Jul 2019
Compressing RNNs for IoT devices by 15-38x using Kronecker Products Urmish Thakker Jesse G. Beu Dibakar Gope Chu Zhou Igor Fedorov Ganesh S. Dasika Matthew Mattina 21 36 0 07 Jun 2019
Image Denoising with Graph-Convolutional Neural Networks D. Valsesia Giulia Fracastoro E. Magli 8 44 0 29 May 2019
Quantized Convolutional Neural Networks for Mobile Devices Jiaxiang Wu Cong Leng Yuhang Wang Qinghao Hu Jian Cheng MQ 21 1,156 0 21 Dec 2015
Improving neural networks by preventing co-adaptation of feature detectors Geoffrey E. Hinton Nitish Srivastava A. Krizhevsky Ilya Sutskever Ruslan Salakhutdinov VLM 266 7,638 0 03 Jul 2012