ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2212.12510
  4. Cited By
MicroBERT: Effective Training of Low-resource Monolingual BERTs through
  Parameter Reduction and Multitask Learning

MicroBERT: Effective Training of Low-resource Monolingual BERTs through Parameter Reduction and Multitask Learning

23 December 2022
Luke Gessler
Amir Zeldes
ArXivPDFHTML

Papers citing "MicroBERT: Effective Training of Low-resource Monolingual BERTs through Parameter Reduction and Multitask Learning"

13 / 13 papers shown
Title
A UD Treebank for Bohairic Coptic
A UD Treebank for Bohairic Coptic
Amir Zeldes
Nina Speransky
Nicholas Wagner
Caroline T. Schroeder
50
0
0
25 Apr 2025
Classifier identification in Ancient Egyptian as a low-resource
  sequence-labelling task
Classifier identification in Ancient Egyptian as a low-resource sequence-labelling task
Dmitry Nikolaev
J. Grotenhuis
Haleli Harel
O. Goldwasser
18
0
0
29 Jun 2024
Natural Language Processing RELIES on Linguistics
Natural Language Processing RELIES on Linguistics
Juri Opitz
Shira Wein
Nathan Schneider
AI4CE
55
7
0
09 May 2024
Transferring BERT Capabilities from High-Resource to Low-Resource
  Languages Using Vocabulary Matching
Transferring BERT Capabilities from High-Resource to Low-Resource Languages Using Vocabulary Matching
Piotr Rybak
29
1
0
22 Feb 2024
Robust Generalization Strategies for Morpheme Glossing in an Endangered
  Language Documentation Context
Robust Generalization Strategies for Morpheme Glossing in an Endangered Language Documentation Context
Michael Ginn
Alexis Palmer
19
5
0
05 Nov 2023
Syntactic Inductive Bias in Transformer Language Models: Especially
  Helpful for Low-Resource Languages?
Syntactic Inductive Bias in Transformer Language Models: Especially Helpful for Low-Resource Languages?
Luke Gessler
Nathan Schneider
11
1
0
01 Nov 2023
Taxonomic Loss for Morphological Glossing of Low-Resource Languages
Taxonomic Loss for Morphological Glossing of Low-Resource Languages
Michael Ginn
Alexis Palmer
26
0
0
29 Aug 2023
FonMTL: Towards Multitask Learning for the Fon Language
FonMTL: Towards Multitask Learning for the Fon Language
Bonaventure F. P. Dossou
Iffanice B. Houndayi
Pamely Zantou
Gilles Hacheme
33
0
0
28 Aug 2023
Security Knowledge-Guided Fuzzing of Deep Learning Libraries
Security Knowledge-Guided Fuzzing of Deep Learning Libraries
Nima Shiri Harzevili
Mohammad Mahdi Mohajer
Moshi Wei
H. Pham
Song Wang
AAML
AI4CE
19
1
0
05 Jun 2023
PrOnto: Language Model Evaluations for 859 Languages
PrOnto: Language Model Evaluations for 859 Languages
Luke Gessler
21
1
0
22 May 2023
SIGMORPHON 2023 Shared Task of Interlinear Glossing: Baseline Model
SIGMORPHON 2023 Shared Task of Interlinear Glossing: Baseline Model
Michael Ginn
11
7
0
24 Mar 2023
When Being Unseen from mBERT is just the Beginning: Handling New
  Languages With Multilingual Language Models
When Being Unseen from mBERT is just the Beginning: Handling New Languages With Multilingual Language Models
Benjamin Muller
Antonis Anastasopoulos
Benoît Sagot
Djamé Seddah
LRM
136
165
0
24 Oct 2020
Efficient Estimation of Word Representations in Vector Space
Efficient Estimation of Word Representations in Vector Space
Tomáš Mikolov
Kai Chen
G. Corrado
J. Dean
3DV
293
31,267
0
16 Jan 2013
1