A Survey on Multilingual Large Language Models: Corpora, Alignment, and Bias

1 April 2024

Papers citing "A Survey on Multilingual Large Language Models: Corpora, Alignment, and Bias"

27 / 77 papers shown

Title
LNMap: Departures from Isomorphic Assumption in Bilingual Lexicon Induction Through Non-Linear Mapping in Latent Space Tasnim Mohiuddin M Saiful Bari Shafiq Joty 50 50 0 28 Apr 2020
A Study of Cross-Lingual Ability and Language-specific Information in Multilingual BERT Chi-Liang Liu Tsung-Yuan Hsu Yung-Sung Chuang Hung-yi Lee 51 15 0 20 Apr 2020
Null It Out: Guarding Protected Attributes by Iterative Nullspace Projection Shauli Ravfogel Yanai Elazar Hila Gonen Michael Twiton Yoav Goldberg 126 381 0 16 Apr 2020
XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalization Junjie Hu Sebastian Ruder Aditya Siddhant Graham Neubig Orhan Firat Melvin Johnson ELM 167 973 0 24 Mar 2020
AraBERT: Transformer-based Model for Arabic Language Understanding Wissam Antoun Fady Baly Hazem M. Hajj 100 968 0 28 Feb 2020
Multilingual Alignment of Contextual Word Representations Steven Cao Nikita Kitaev Dan Klein 76 193 0 10 Feb 2020
BERTje: A Dutch BERT Model Wietse de Vries Andreas van Cranenburgh Arianna Bisazza Tommaso Caselli Gertjan van Noord Malvina Nissim VLM SSeg 66 293 0 19 Dec 2019
Cross-Lingual Ability of Multilingual BERT: An Empirical Study Karthikeyan K Zihan Wang Stephen D. Mayhew Dan Roth LRM 66 339 0 17 Dec 2019
FlauBERT: Unsupervised Language Model Pre-training for French Hang Le Loïc Vial Jibril Frej Vincent Segonne Maximin Coavoux Benjamin Lecouteux A. Allauzen Benoît Crabbé Laurent Besacier D. Schwab AI4CE 83 399 0 11 Dec 2019
Unsupervised Cross-lingual Representation Learning at Scale Alexis Conneau Kartikay Khandelwal Naman Goyal Vishrav Chaudhary Guillaume Wenzek Francisco Guzmán Edouard Grave Myle Ott Luke Zettlemoyer Veselin Stoyanov 201 6,546 0 05 Nov 2019
On the Cross-lingual Transferability of Monolingual Representations Mikel Artetxe Sebastian Ruder Dani Yogatama 191 796 0 25 Oct 2019
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer Colin Raffel Noam M. Shazeer Adam Roberts Katherine Lee Sharan Narang Michael Matena Yanqi Zhou Wei Li Peter J. Liu AIMat 409 20,114 0 23 Oct 2019
Are We Consistently Biased? Multidimensional Analysis of Biases in Distributional Word Vectors Anne Lauscher Goran Glavaš 62 55 0 26 Apr 2019
BERTScore: Evaluating Text Generation with BERT Tianyi Zhang Varsha Kishore Felix Wu Kilian Q. Weinberger Yoav Artzi 302 5,801 0 21 Apr 2019
Revisiting Adversarial Autoencoder for Unsupervised Word Translation with Cycle Consistency and Improved Training Tasnim Mohiuddin Shafiq Joty 37 37 0 04 Apr 2019
Cross-Lingual Alignment of Contextual Word Embeddings, with Applications to Zero-shot Dependency Parsing Tal Schuster Ori Ram Regina Barzilay Amir Globerson 68 210 0 25 Feb 2019
Bias in Bios: A Case Study of Semantic Representation Bias in a High-Stakes Setting Maria De-Arteaga Alexey Romanov Hanna M. Wallach J. Chayes C. Borgs Alexandra Chouldechova S. Geyik K. Kenthapadi Adam Tauman Kalai 175 455 0 27 Jan 2019
Gromov-Wasserstein Alignment of Word Embedding Spaces David Alvarez-Melis Tommi Jaakkola OT 54 328 0 31 Aug 2018
A robust self-learning method for fully unsupervised cross-lingual mappings of word embeddings Mikel Artetxe Gorka Labaka Eneko Agirre SSL 65 590 0 16 May 2018
On the Limitations of Unsupervised Bilingual Dictionary Induction Anders Søgaard Sebastian Ruder Ivan Vulić 58 261 0 09 May 2018
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 1.1K 7,154 0 20 Apr 2018
Word Translation Without Parallel Data Alexis Conneau Guillaume Lample MarcÁurelio Ranzato Ludovic Denoyer Hervé Jégou 284 1,657 0 11 Oct 2017
Transfer Learning across Low-Resource, Related Languages for Neural Machine Translation Toan Q. Nguyen David Chiang 67 210 0 31 Aug 2017
Proximal Policy Optimization Algorithms John Schulman Filip Wolski Prafulla Dhariwal Alec Radford Oleg Klimov OffRL 468 19,006 0 20 Jul 2017
Enriching Word Vectors with Subword Information Piotr Bojanowski Edouard Grave Armand Joulin Tomas Mikolov NAI SSL VLM 220 9,958 0 15 Jul 2016
Asynchronous Methods for Deep Reinforcement Learning Volodymyr Mnih Adria Puigdomenech Badia M. Berk Mirza Alex Graves Timothy Lillicrap Tim Harley David Silver Koray Kavukcuoglu 191 8,850 0 04 Feb 2016
Distributed Representations of Words and Phrases and their Compositionality Tomas Mikolov Ilya Sutskever Kai Chen G. Corrado J. Dean NAI OCL 382 33,521 0 16 Oct 2013