Using Optimal Transport as Alignment Objective for fine-tuning Multilingual Contextualized Embeddings

6 October 2021

Papers citing "Using Optimal Transport as Alignment Objective for fine-tuning Multilingual Contextualized Embeddings"

25 / 25 papers shown

Title
Embedding Empirical Distributions for Computing Optimal Transport Maps Mingchen Jiang Peng Xu Xichen Ye Xiaohui Chen Yun Yang Yifan Chen OT 93 0 0 24 Apr 2025
Improving Pretrained Cross-Lingual Language Models via Self-Labeled Word Alignment Zewen Chi Li Dong Bo Zheng Shaohan Huang Xian-Ling Mao Heyan Huang Furu Wei 61 68 0 11 Jun 2021
Language-agnostic BERT Sentence Embedding Fangxiaoyu Feng Yinfei Yang Daniel Cer N. Arivazhagan Wei Wang 139 905 0 03 Jul 2020
MAD-X: An Adapter-Based Framework for Multi-Task Cross-Lingual Transfer Jonas Pfeiffer Ivan Vulić Iryna Gurevych Sebastian Ruder 96 625 0 30 Apr 2020
A Supervised Word Alignment Method based on Cross-Language Span Prediction using Multilingual BERT Masaaki Nagata Katsuki Chousa Masaaki Nishino 36 47 0 29 Apr 2020
XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalization Junjie Hu Sebastian Ruder Aditya Siddhant Graham Neubig Orhan Firat Melvin Johnson ELM 161 970 0 24 Mar 2020
Multilingual Alignment of Contextual Word Representations Steven Cao Nikita Kitaev Dan Klein 74 193 0 10 Feb 2020
Unsupervised Hierarchy Matching with Optimal Transport over Hyperbolic Spaces David Alvarez-Melis Youssef Mroueh Tommi Jaakkola OT 53 24 0 06 Nov 2019
Unsupervised Cross-lingual Representation Learning at Scale Alexis Conneau Kartikay Khandelwal Naman Goyal Vishrav Chaudhary Guillaume Wenzek Francisco Guzmán Edouard Grave Myle Ott Luke Zettlemoyer Veselin Stoyanov 193 6,538 0 05 Nov 2019
On the Cross-lingual Transferability of Monolingual Representations Mikel Artetxe Sebastian Ruder Dani Yogatama 165 793 0 25 Oct 2019
Cross-Lingual BERT Transformation for Zero-Shot Dependency Parsing Yuxuan Wang Wanxiang Che Jiang Guo Yijia Liu Ting Liu 48 118 0 15 Sep 2019
Context-Aware Cross-Lingual Mapping Hanan Aldarmaki Mona T. Diab 44 58 0 08 Mar 2019
Cross-Lingual Alignment of Contextual Word Embeddings, with Applications to Zero-shot Dependency Parsing Tal Schuster Ori Ram Regina Barzilay Amir Globerson 68 210 0 25 Feb 2019
Interpolating between Optimal Transport and MMD using Sinkhorn Divergences Jean Feydy Thibault Séjourné François-Xavier Vialard S. Amari A. Trouvé Gabriel Peyré OT 55 526 0 18 Oct 2018
Gromov-Wasserstein Alignment of Word Embedding Spaces David Alvarez-Melis Tommi Jaakkola OT 54 328 0 31 Aug 2018
Towards Optimal Transport with Global Invariances David Alvarez-Melis Stefanie Jegelka Tommi Jaakkola OT 52 71 0 25 Jun 2018
Optimal Transport for structured data with application on graphs Titouan Vayer Laetitia Chapel Rémi Flamary R. Tavenard Nicolas Courty OT 63 272 0 23 May 2018
Computational Optimal Transport Gabriel Peyré Marco Cuturi OT 189 2,143 0 01 Mar 2018
Deep contextualized word representations Matthew E. Peters Mark Neumann Mohit Iyyer Matt Gardner Christopher Clark Kenton Lee Luke Zettlemoyer NAI 184 11,542 0 15 Feb 2018
A Survey Of Cross-lingual Word Embedding Models Sebastian Ruder Ivan Vulić Anders Søgaard 74 530 0 15 Jun 2017
A Broad-Coverage Challenge Corpus for Sentence Understanding through Inference Adina Williams Nikita Nangia Samuel R. Bowman 497 4,473 0 18 Apr 2017
Offline bilingual word vectors, orthogonal transformations and the inverted softmax Samuel L. Smith David H. P. Turban Steven Hamblin Nils Y. Hammerla OffRL 63 536 0 13 Feb 2017
SQuAD: 100,000+ Questions for Machine Comprehension of Text Pranav Rajpurkar Jian Zhang Konstantin Lopyrev Percy Liang RALM 231 8,113 0 16 Jun 2016
Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distances Marco Cuturi OT 184 4,251 0 04 Jun 2013
A Kernel Method for the Two-Sample Problem Arthur Gretton Karsten Borgwardt Malte J. Rasch Bernhard Schölkopf Alex Smola 213 2,353 0 15 May 2008