SMaLL-100: Introducing Shallow Multilingual Machine Translation Model
for Low-Resource Languages

SMaLL-100: Introducing Shallow Multilingual Machine Translation Model for Low-Resource Languages

20 October 2022

Alireza Mohammadshahi

Vassilina Nikoulina

Alexandre Berard

James Henderson

Laurent Besacier

Papers citing "SMaLL-100: Introducing Shallow Multilingual Machine Translation Model for Low-Resource Languages"

18 / 18 papers shown

Title
Towards Cross-Tokenizer Distillation: the Universal Logit Distillation Loss for LLMs Nicolas Boizard Kevin El Haddad C´eline Hudelot Pierre Colombo 73 14 0 28 Jan 2025
Efficient Compression of Multitask Multilingual Speech Models Thomas Palmeira Ferraz 39 0 0 02 May 2024
HistNERo: Historical Named Entity Recognition for the Romanian Language Andrei-Marius Avram Andreea Iuga George-Vlad Manolache Vlad-Cristian Matei Ruazvan-Gabriel Micliucs ... Manuel-Petru Sorlescu Dragocs-Andrei cSerban Adrian-Dinu Urse Vasile Puaics Dumitru-Clementin Cercel 30 2 0 30 Apr 2024
Multilingual DistilWhisper: Efficient Distillation of Multi-task Speech Models via Language-Specific Experts Thomas Palmeira Ferraz Marcely Zanon Boito Caroline Brun Vassilina Nikoulina 29 12 0 02 Nov 2023
Mitigating Hallucinations and Off-target Machine Translation with Source-Contrastive and Language-Contrastive Decoding Rico Sennrich Jannis Vamvas Alireza Mohammadshahi HILM 25 38 0 13 Sep 2023
Low-Resource Cross-Lingual Adaptive Training for Nigerian Pidgin Pin-Jie Lin Muhammed Saeed Ernie Chang Merel C. J. Scholman 40 5 0 01 Jul 2023
Target-Agnostic Gender-Aware Contrastive Learning for Mitigating Bias in Multilingual Machine Translation Minwoo Lee Hyukhun Koh Kang-il Lee Dongdong Zhang Minsu Kim Kyomin Jung 24 9 0 23 May 2023
Hallucinations in Large Multilingual Translation Models Nuno M. Guerreiro Duarte M. Alves Jonas Waldendorf Barry Haddow Alexandra Birch Pierre Colombo André F.T. Martins VLM HILM LRM 22 140 0 28 Mar 2023
Exploring the Potential of Machine Translation for Generating Named Entity Datasets: A Case Study between Persian and English A. Sartipi A. Fatemi 24 3 0 19 Feb 2023
Efficiently Upgrading Multilingual Machine Translation Models to Support More Languages Simeng Sun Maha Elbayad Anna Y. Sun James Cross CLL LRM 24 3 0 07 Feb 2023
Memory-efficient NLLB-200: Language-specific Expert Pruning of a Massively Multilingual Machine Translation Model Yeskendir Koishekenov Alexandre Berard Vassilina Nikoulina MoE 30 29 0 19 Dec 2022
RQUGE: Reference-Free Metric for Evaluating Question Generation by Answering the Question Alireza Mohammadshahi Thomas Scialom Majid Yazdani Pouya Yanki Angela Fan James Henderson Marzieh Saeidi 26 20 0 02 Nov 2022
What Do Compressed Multilingual Machine Translation Models Forget? Alireza Mohammadshahi Vassilina Nikoulina Alexandre Berard Caroline Brun James Henderson Laurent Besacier AI4CE 40 9 0 22 May 2022
Efficient Inference for Multilingual Neural Machine Translation Alexandre Berard Dain Lee S. Clinchant K. Jung Vassilina Nikoulina 31 12 0 14 Sep 2021
Syntax-Aware Graph-to-Graph Transformer for Semantic Role Labelling Alireza Mohammadshahi James Henderson 28 12 0 15 Apr 2021
Learning Light-Weight Translation Models from Deep Transformer Bei Li Ziyang Wang Hui Liu Quan Du Tong Xiao Chunliang Zhang Jingbo Zhu VLM 117 40 0 27 Dec 2020
The Tatoeba Translation Challenge -- Realistic Data Sets for Low Resource and Multilingual MT Jörg Tiedemann 162 164 0 13 Oct 2020
Multi-Way, Multilingual Neural Machine Translation with a Shared Attention Mechanism Orhan Firat Kyunghyun Cho Yoshua Bengio LRM AIMat 211 623 0 06 Jan 2016