LEALLA: Learning Lightweight Language-agnostic Sentence Embeddings with Knowledge Distillation

16 February 2023

Papers citing "LEALLA: Learning Lightweight Language-agnostic Sentence Embeddings with Knowledge Distillation"

15 / 15 papers shown

Title
Lightweight Cross-Lingual Sentence Representation Learning Zhuoyuan Mao Prakhar Gupta Pei Wang Chenhui Chu Martin Jaggi Sadao Kurohashi VLM 91 9 0 28 May 2021
Language-agnostic BERT Sentence Embedding Fangxiaoyu Feng Yinfei Yang Daniel Cer N. Arivazhagan Wei Wang 135 904 0 03 Jul 2020
Making Monolingual Sentence Embeddings Multilingual using Knowledge Distillation Nils Reimers Iryna Gurevych 89 1,021 0 21 Apr 2020
MobileBERT: a Compact Task-Agnostic BERT for Resource-Limited Devices Zhiqing Sun Hongkun Yu Xiaodan Song Renjie Liu Yiming Yang Denny Zhou MQ 99 811 0 06 Apr 2020
Unsupervised Cross-lingual Representation Learning at Scale Alexis Conneau Kartikay Khandelwal Naman Goyal Vishrav Chaudhary Guillaume Wenzek Francisco Guzmán Edouard Grave Myle Ott Luke Zettlemoyer Veselin Stoyanov 193 6,522 0 05 Nov 2019
WikiMatrix: Mining 135M Parallel Sentences in 1620 Language Pairs from Wikipedia Holger Schwenk Vishrav Chaudhary Shuo Sun Hongyu Gong Francisco Guzmán CVBM 93 404 0 10 Jul 2019
Multilingual Universal Sentence Encoder for Semantic Retrieval Yinfei Yang Daniel Cer Amin Ahmad Mandy Guo Jax Law ... Steve Yuan Chris Tar Yun-hsuan Sung B. Strope R. Kurzweil 3DV 64 477 0 09 Jul 2019
Distilling Task-Specific Knowledge from BERT into Simple Neural Networks Raphael Tang Yao Lu Linqing Liu Lili Mou Olga Vechtomova Jimmy J. Lin 61 419 0 28 Mar 2019
Improving Multilingual Sentence Embedding using Bi-directional Dual Encoder with Additive Margin Softmax Yinfei Yang Gustavo Hernández Ábrego Steve Yuan Mandy Guo Qinlan Shen Daniel Cer Yun-hsuan Sung B. Strope R. Kurzweil 68 116 0 22 Feb 2019
Massively Multilingual Sentence Embeddings for Zero-Shot Cross-Lingual Transfer and Beyond Mikel Artetxe Holger Schwenk 3DV 132 1,010 0 26 Dec 2018
Margin-based Parallel Corpus Mining with Multilingual Sentence Embeddings Mikel Artetxe Holger Schwenk 61 202 0 03 Nov 2018
Effective Parallel Corpus Mining using Bilingual Sentence Embeddings Mandy Guo Qinlan Shen Yinfei Yang Heming Ge Daniel Cer ... K. Stevens Noah Constant Yun-hsuan Sung B. Strope R. Kurzweil 82 111 0 31 Jul 2018
Neural Machine Translation of Rare Words with Subword Units Rico Sennrich Barry Haddow Alexandra Birch 195 7,729 0 31 Aug 2015
Distilling the Knowledge in a Neural Network Geoffrey E. Hinton Oriol Vinyals J. Dean FedML 306 19,580 0 09 Mar 2015
FitNets: Hints for Thin Deep Nets Adriana Romero Nicolas Ballas Samira Ebrahimi Kahou Antoine Chassang C. Gatta Yoshua Bengio FedML 272 3,870 0 19 Dec 2014