MorphTE: Injecting Morphology in Tensorized Embeddings

27 October 2022

Sunzhu Li

Papers citing "MorphTE: Injecting Morphology in Tensorized Embeddings"

21 / 21 papers shown

Title
KroneckerBERT: Learning Kronecker Decomposition for Pre-trained Language Models via Knowledge Distillation Marzieh S. Tahaei Ella Charlaix V. Nia A. Ghodsi Mehdi Rezagholizadeh 91 22 0 13 Sep 2021
TT-Rec: Tensor Train Compression for Deep Learning Recommendation Models Chunxing Yin Bilge Acun Xing Liu Carole-Jean Wu 91 105 0 25 Jan 2021
Rank and run-time aware compression of NLP Applications Urmish Thakker Jesse G. Beu Dibakar Gope Ganesh S. Dasika Matthew Mattina 33 11 0 06 Oct 2020
word2ket: Space-efficient Word Embeddings inspired by Quantum Entanglement Ali (Aliakbar) Panahi Seyran Saeedi Tom Arodz 28 32 0 12 Nov 2019
ALBERT: A Lite BERT for Self-supervised Learning of Language Representations Zhenzhong Lan Mingda Chen Sebastian Goodman Kevin Gimpel Piyush Sharma Radu Soricut SSL AIMat 373 6,467 0 26 Sep 2019
Simple and Effective Text Matching with Richer Alignment Features Runqi Yang Jianhai Zhang Xing Gao Feng Ji Haiqing Chen 3DV 61 153 0 01 Aug 2019
RoBERTa: A Robustly Optimized BERT Pretraining Approach Yinhan Liu Myle Ott Naman Goyal Jingfei Du Mandar Joshi Danqi Chen Omer Levy M. Lewis Luke Zettlemoyer Veselin Stoyanov AIMat 677 24,541 0 26 Jul 2019
Morphological Word Embeddings Ryan Cotterell Hinrich Schütze 48 101 0 04 Jul 2019
fairseq: A Fast, Extensible Toolkit for Sequence Modeling Myle Ott Sergey Edunov Alexei Baevski Angela Fan Sam Gross Nathan Ng David Grangier Michael Auli VLM FaML 114 3,156 0 01 Apr 2019
Online Embedding Compression for Text Classification using Low Rank Matrix Factorization Anish Acharya Rahul Goel A. Metallinou Inderjit Dhillon 70 62 0 01 Nov 2018
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.8K 95,175 0 11 Oct 2018
GroupReduce: Block-Wise Low-Rank Approximation for Neural Language Model Shrinking Patrick H. Chen Si Si Yang Li Ciprian Chelba Cho-Jui Hsieh 59 70 0 18 Jun 2018
Near-lossless Binarization of Word Embeddings Julien Tissier Christophe Gravier Amaury Habrard MQ 59 50 0 24 Mar 2018
Slim Embedding Layers for Recurrent Neural Language Models Zhongliang Li Raymond Kulhanek Shaojun Wang Yunxin Zhao Shuang Wu KELM 57 23 0 27 Nov 2017
Compressing Word Embeddings via Deep Compositional Code Learning Raphael Shu Hideki Nakayama 79 129 0 03 Nov 2017
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 732 132,363 0 12 Jun 2017
The Interplay of Semantics and Morphology in Word Embeddings Oded Avraham Yoav Goldberg 38 41 0 06 Apr 2017
Morphological Priors for Probabilistic Neural Word Embeddings Parminder Bhatia Robert Guthrie Jacob Eisenstein 60 42 0 03 Aug 2016
A large annotated corpus for learning natural language inference Samuel R. Bowman Gabor Angeli Christopher Potts Christopher D. Manning 324 4,294 0 21 Aug 2015
Compositional Morphology for Word Representations and Language Modelling Jan A. Botha Phil Blunsom 83 253 0 16 May 2014
One Billion Word Benchmark for Measuring Progress in Statistical Language Modeling Ciprian Chelba Tomas Mikolov M. Schuster Qi Ge T. Brants P. Koehn T. Robinson 190 1,109 0 11 Dec 2013