Tensorized Embedding Layers for Efficient Model Compression

Tensorized Embedding Layers for Efficient Model Compression

30 January 2019

Oleksii Hrinchuk

Valentin Khrulkov

L. Mirvakhabova

Papers citing "Tensorized Embedding Layers for Efficient Model Compression"

16 / 16 papers shown

Title
Geometry is All You Need: A Unified Taxonomy of Matrix and Tensor Factorization for Compression of Generative Language Models Mingxue Xu Sadia Sharmin Danilo Mandic 35 2 0 03 Oct 2024
COOL: Efficient and Reliable Chain-Oriented Objective Logic with Neural Networks Feedback Control for Program Synthesis Jipeng Han 39 0 0 02 Oct 2024
A Matrix Product State Model for Simultaneous Classification and Generation Alex Mossi Bojan Žunkovic Kyriakos Flouris 29 3 0 25 Jun 2024
TQCompressor: improving tensor decomposition methods in neural networks via permutations V. Abronin A. Naumov D. Mazur D. Bystrov K. Tsarova Ar. Melnikov Ivan Oseledets S. Dolgov R. Brasher M. Perelshtein 28 6 0 29 Jan 2024
Enhancing Cross-Category Learning in Recommendation Systems with Multi-Layer Embedding Training Selim F. Yilmaz Benjamin Ghaemmaghami A. Singh Benjamin Cho Leo Orshansky Lei Deng Michael Orshansky AI4TS 28 0 0 27 Sep 2023
Efficient GPT Model Pre-training using Tensor Train Matrix Representation V. Chekalina Georgii Sergeevich Novikov Julia Gusak Ivan Oseledets Alexander Panchenko 17 8 0 05 Jun 2023
Self-Supervised Learning for Data Scarcity in a Fatigue Damage Prognostic Problem A. Akrim C. Gogu R. Vingerhoeds M. Salaün AI4CE 35 23 0 20 Jan 2023
Deep tensor networks with matrix product operators Bojan Žunkovič 72 4 0 16 Sep 2022
Learning Robust and Lightweight Model through Separable Structured Transformations Xian Wei Yanhui Huang Yang Xu Mingsong Chen Hai Lan Yuanxiang Li Zhongfeng Wang Xuan Tang OOD 24 0 0 27 Dec 2021
KroneckerBERT: Learning Kronecker Decomposition for Pre-trained Language Models via Knowledge Distillation Marzieh S. Tahaei Ella Charlaix V. Nia A. Ghodsi Mehdi Rezagholizadeh 46 22 0 13 Sep 2021
3U-EdgeAI: Ultra-Low Memory Training, Ultra-Low BitwidthQuantization, and Ultra-Low Latency Acceleration Yao Chen Cole Hawkins Kaiqi Zhang Zheng-Wei Zhang Cong Hao 26 8 0 11 May 2021
TT-Rec: Tensor Train Compression for Deep Learning Recommendation Models Chunxing Yin Bilge Acun Xing Liu Carole-Jean Wu 50 102 0 25 Jan 2021
Understanding Capacity-Driven Scale-Out Neural Recommendation Inference Michael Lui Yavuz Yetim Özgür Özkan Zhuoran Zhao Shin-Yeh Tsai Carole-Jean Wu Mark Hempstead GNN BDL LRM 22 51 0 04 Nov 2020
Mixed-Precision Embedding Using a Cache J. Yang Jianyu Huang Jongsoo Park P. T. P. Tang Andrew Tulloch 27 36 0 21 Oct 2020
OpenNMT: Open-Source Toolkit for Neural Machine Translation Guillaume Klein Yoon Kim Yuntian Deng Jean Senellart Alexander M. Rush 273 1,896 0 10 Jan 2017
Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation Yonghui Wu M. Schuster Z. Chen Quoc V. Le Mohammad Norouzi ... Alex Rudnick Oriol Vinyals G. Corrado Macduff Hughes J. Dean AIMat 716 6,748 0 26 Sep 2016