HeRo: RoBERTa and Longformer Hebrew Language Models

18 April 2023

Papers citing "HeRo: RoBERTa and Longformer Hebrew Language Models"

7 / 7 papers shown

Title
Mevaker: Conclusion Extraction and Allocation Resources for the Hebrew Language Vitaly Shalumov Harel Haskey Yuval Solaz 52 0 0 12 Mar 2024
Explicit Morphological Knowledge Improves Pre-training of Language Models for Hebrew Eylon Gueta Omer Goldman Reut Tsarfaty 24 1 0 01 Nov 2023
Introducing DictaLM -- A Large Generative Language Model for Modern Hebrew Shaltiel Shmidman Avi Shmidman Amir DN Cohen Moshe Koppel 33 0 0 25 Sep 2023
DictaBERT: A State-of-the-Art BERT Suite for Modern Hebrew Shaltiel Shmidman Avi Shmidman Moshe Koppel 30 7 0 31 Aug 2023
ParaShoot: A Hebrew Question Answering Dataset Omri Keren Omer Levy 37 17 0 23 Sep 2021
Deduplicating Training Data Makes Language Models Better Katherine Lee Daphne Ippolito A. Nystrom Chiyuan Zhang Douglas Eck Chris Callison-Burch Nicholas Carlini SyDa 242 599 0 14 Jul 2021
Big Bird: Transformers for Longer Sequences Manzil Zaheer Guru Guruganesh Kumar Avinava Dubey Joshua Ainslie Chris Alberti ... Philip Pham Anirudh Ravula Qifan Wang Li Yang Amr Ahmed VLM 288 2,028 0 28 Jul 2020