Slim Embedding Layers for Recurrent Neural Language Models

27 November 2017

Papers citing "Slim Embedding Layers for Recurrent Neural Language Models"

6 / 6 papers shown

Title
KroneckerBERT: Learning Kronecker Decomposition for Pre-trained Language Models via Knowledge Distillation Marzieh S. Tahaei Ella Charlaix V. Nia A. Ghodsi Mehdi Rezagholizadeh 46 22 0 13 Sep 2021
Compression of Deep Learning Models for Text: A Survey Manish Gupta Puneet Agrawal VLM MedIm AI4CE 22 115 0 12 Aug 2020
DeFINE: DEep Factorized INput Token Embeddings for Neural Sequence Modeling Sachin Mehta Rik Koncel-Kedziorski Mohammad Rastegari Hannaneh Hajishirzi AI4TS 38 23 0 27 Nov 2019
Shared-Private Bilingual Word Embeddings for Neural Machine Translation Xuebo Liu Derek F. Wong Yang Liu Lidia S. Chao Tong Xiao Jingbo Zhu 35 37 0 07 Jun 2019
Efficient Contextualized Representation: Language Model Pruning for Sequence Labeling Liyuan Liu Xiang Ren Jingbo Shang Jian-wei Peng Jiawei Han 25 44 0 20 Apr 2018
Neural Architecture Search with Reinforcement Learning Barret Zoph Quoc V. Le 274 5,331 0 05 Nov 2016