RoQLlama: A Lightweight Romanian Adapted Language Model

RoQLlama: A Lightweight Romanian Adapted Language Model

5 October 2024

George-Andrei Dima

Andrei-Marius Avram

Cristian-George Crăciun

Dumitru-Clementin Cercel

ArXiv (abs)PDF HTML

Papers citing "RoQLlama: A Lightweight Romanian Adapted Language Model"

11 / 11 papers shown

Title
Teaching Llama a New Language Through Cross-Lingual Knowledge Transfer Hele-Andra Kuulmets Taido Purason Agnes Luhtaru Mark Fishel 67 19 0 05 Apr 2024
A Continued Pretrained LLM Approach for Automatic Medical Note Generation Dong Yuan Eti Rastogi Gautam Naik Sree Prasanna Rajagopal Sagar Goyal Fen Zhao Jai Chintagunta Jeff Ward LM&MA AI4MH 112 26 0 14 Mar 2024
LLaMandement: Large Language Models for Summarization of French Legislative Proposals Joseph Gesnouin Yannis Tannier Christophe Gomes Da Silva Hatim Tapory Camille Brier ... Emmanuel Cortes Pierre-Etienne Devineau Ulrich Tan Esther Mac Namara Su Yang AILaw 86 8 0 29 Jan 2024
ORCA: A Challenging Benchmark for Arabic Language Understanding AbdelRahim Elmadany El Moatez Billah Nagoudi Muhammad Abdul-Mageed ELM 80 45 0 21 Dec 2022
ParaShoot: A Hebrew Question Answering Dataset Omri Keren Omer Levy 92 17 0 23 Sep 2021
LoRA: Low-Rank Adaptation of Large Language Models J. E. Hu Yelong Shen Phillip Wallis Zeyuan Allen-Zhu Yuanzhi Li Shean Wang Lu Wang Weizhu Chen OffRL AI4TS AI4CE ALM AIMat 504 10,526 0 17 Jun 2021
The birth of Romanian BERT Stefan Daniel Dumitrescu Andrei-Marius Avram S. Pyysalo VLM 61 78 0 18 Sep 2020
Unsupervised Cross-lingual Representation Learning at Scale Alexis Conneau Kartikay Khandelwal Naman Goyal Vishrav Chaudhary Guillaume Wenzek Francisco Guzmán Edouard Grave Myle Ott Luke Zettlemoyer Veselin Stoyanov 228 6,593 0 05 Nov 2019
On the Cross-lingual Transferability of Monolingual Representations Mikel Artetxe Sebastian Ruder Dani Yogatama 226 800 0 25 Oct 2019
GeoSQA: A Benchmark for Scenario-based Question Answering in the Geography Domain at High School Level Zixian Huang Yulin Shen Xiao Li Yuang Wei Gong Cheng Lin Zhou Xinyu Dai Yuzhong Qu RALM ELM 50 24 0 20 Aug 2019
SQuAD: 100,000+ Questions for Machine Comprehension of Text Pranav Rajpurkar Jian Zhang Konstantin Lopyrev Percy Liang RALM 316 8,177 0 16 Jun 2016