ResearchTrend.AI
Typhoon: Towards an Effective Task-Specific Masking Strategy for Pre-trained Language Models

Typhoon: Towards an Effective Task-Specific Masking Strategy for Pre-trained Language Models

Muhammed Shahir Abdurrahman
Hashem Elezabi
B. Xu
ArXiv (abs)PDFHTML

Papers citing "Typhoon: Towards an Effective Task-Specific Masking Strategy for Pre-trained Language Models"

4 / 4 papers shown
Title
BLOOM: A 176B-Parameter Open-Access Multilingual Language Model
BLOOM: A 176B-Parameter Open-Access Multilingual Language Model
BigScience Workshop
:
Teven Le Scao
Angela Fan
Christopher Akiki
...
Zhongli Xie
Zifan Ye
M. Bras
Younes Belkada
Thomas Wolf
VLM
408
2,393
0
09 Nov 2022
Emergent Abilities of Large Language Models
Emergent Abilities of Large Language Models
Jason W. Wei
Yi Tay
Rishi Bommasani
Colin Raffel
Barret Zoph
...
Tatsunori Hashimoto
Oriol Vinyals
Percy Liang
J. Dean
W. Fedus
ELMReLMLRM
288
2,518
0
15 Jun 2022
PaLM: Scaling Language Modeling with Pathways
PaLM: Scaling Language Modeling with Pathways
Aakanksha Chowdhery
Sharan Narang
Jacob Devlin
Maarten Bosma
Gaurav Mishra
...
Kathy Meier-Hellstern
Douglas Eck
J. Dean
Slav Petrov
Noah Fiedel
PILMLRM
529
6,293
0
05 Apr 2022
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding
Alex Jinpeng Wang
Amanpreet Singh
Julian Michael
Felix Hill
Omer Levy
Samuel R. Bowman
ELM
1.1K
7,201
0
20 Apr 2018