Cross-Lingual Alignment of Contextual Word Embeddings, with Applications to Zero-shot Dependency Parsing

25 February 2019

Papers citing "Cross-Lingual Alignment of Contextual Word Embeddings, with Applications to Zero-shot Dependency Parsing"

44 / 44 papers shown

Title
ALGEN: Few-shot Inversion Attacks on Textual Embeddings using Alignment and Generation Yiyi Chen Qiongkai Xu Johannes Bjerva 49 0 0 16 Feb 2025
The Semantic Hub Hypothesis: Language Models Share Semantic Representations Across Languages and Modalities Zhaofeng Wu Xinyan Velocity Yu Dani Yogatama Jiasen Lu Yoon Kim AIFin 54 10 0 07 Nov 2024
Building Dialogue Understanding Models for Low-resource Language Indonesian from Scratch Donglin Di Weinan Zhang Yue Zhang Fanglin Wang 23 1 0 24 Oct 2024
Language Imbalance Driven Rewarding for Multilingual Self-improving Wen Yang Junhong Wu Chen Wang Chengqing Zong J.N. Zhang ALM LRM 71 4 0 11 Oct 2024
UniPSDA: Unsupervised Pseudo Semantic Data Augmentation for Zero-Shot Cross-Lingual Natural Language Understanding Dongyang Li Taolin Zhang Jiali Deng Longtao Huang Chengyu Wang Xiaofeng He Hui Xue 34 1 0 24 Jun 2024
Enhancing Multilingual Capabilities of Large Language Models through Self-Distillation from Resource-Rich Languages Yuan Zhang Yile Wang Zijun Liu Shuo Wang Xiaolong Wang Peng Li Maosong Sun Yang Liu LRM 35 11 0 19 Feb 2024
Improving Cross-Lingual Transfer through Subtree-Aware Word Reordering Ofir Arviv Dmitry Nikolaev Taelin Karidi Omri Abend LRM 38 3 0 20 Oct 2023
GRI: Graph-based Relative Isomorphism of Word Embedding Spaces Muhammad Asif Ali Yan Hu Jianbin Qin Di Wang 26 4 0 18 Oct 2023
Combating the Curse of Multilinguality in Cross-Lingual WSD by Aligning Sparse Contextualized Word Representations Gábor Berend 38 7 0 25 Jul 2023
Extracting Text Representations for Terms and Phrases in Technical Domains Francesco Fusco Diego Antognini 35 0 0 25 May 2023
Language Models are Multilingual Chain-of-Thought Reasoners Freda Shi Mirac Suzgun Markus Freitag Xuezhi Wang Suraj Srivats ... Yi Tay Sebastian Ruder Denny Zhou Dipanjan Das Jason W. Wei ReLM LRM 172 326 0 06 Oct 2022
Lost in Context? On the Sense-wise Variance of Contextualized Word Embeddings Yile Wang Yue Zhang 19 4 0 20 Aug 2022
Compute Trends Across Three Eras of Machine Learning J. Sevilla Lennart Heim A. Ho T. Besiroglu Marius Hobbhahn Pablo Villalobos 39 269 0 11 Feb 2022
Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Survey Bonan Min Hayley L Ross Elior Sulem Amir Pouran Ben Veyseh Thien Huu Nguyen Oscar Sainz Eneko Agirre Ilana Heinz Dan Roth LM&MA VLM AI4CE 83 1,035 0 01 Nov 2021
Substructure Distribution Projection for Zero-Shot Cross-Lingual Dependency Parsing Freda Shi Kevin Gimpel Karen Livescu 147 7 0 16 Oct 2021
On the Relation between Syntactic Divergence and Zero-Shot Performance Ofir Arviv Dmitry Nikolaev Taelin Karidi Omri Abend 32 4 0 09 Oct 2021
Putting Words in BERT's Mouth: Navigating Contextualized Vector Spaces with Pseudowords Taelin Karidi Yichu Zhou Nathan Schneider Omri Abend Vivek Srikumar 86 13 0 23 Sep 2021
Cross-lingual Transferring of Pre-trained Contextualized Language Models Zuchao Li Kevin Parnow Hai Zhao Zhuosheng Zhang Rui Wang Masao Utiyama Eiichiro Sumita 13 8 0 27 Jul 2021
Evaluation of contextual embeddings on less-resourced languages Matej Ulvcar Alevs vZagar C. S. Armendariz Andravz Repar Senja Pollak Matthew Purver Marko Robnik-vSikonja 36 11 0 22 Jul 2021
Unsupervised Multilingual Sentence Embeddings for Parallel Corpus Mining Ivana Kvapilíková Mikel Artetxe Gorka Labaka Eneko Agirre Ondrej Bojar SSL 19 36 0 21 May 2021
Crossing the Conversational Chasm: A Primer on Natural Language Processing for Multilingual Task-Oriented Dialogue Systems E. Razumovskaia Goran Glavavs Olga Majewska E. Ponti Anna Korhonen Ivan Vulić 23 32 0 17 Apr 2021
Multilingual Multimodal Pre-training for Zero-Shot Cross-Lingual Transfer of Vision-Language Models Po-Yao (Bernie) Huang Mandela Patrick Junjie Hu Graham Neubig Florian Metze Alexander G. Hauptmann MLLM VLM 24 56 0 16 Mar 2021
Automated Concatenation of Embeddings for Structured Prediction Xinyu Wang Yong-jia Jiang Nguyen Bach Tao Wang Zhongqiang Huang Fei Huang Kewei Tu 35 172 0 10 Oct 2020
Cross-lingual Alignment Methods for Multilingual BERT: A Comparative Study Saurabh Kulshreshtha José Luis Redondo García Ching-Yun Chang 22 46 0 29 Sep 2020
Parsing with Multilingual BERT, a Small Corpus, and a Small Treebank Ethan C. Chau Lucy H. Lin Noah A. Smith 19 15 0 29 Sep 2020
Cross-lingual Semantic Role Labeling with Model Transfer Hao Fei Meishan Zhang Fei Li Donghong Ji 26 33 0 24 Aug 2020
CoSDA-ML: Multi-Lingual Code-Switching Data Augmentation for Zero-Shot Cross-Lingual NLP Libo Qin Minheng Ni Yue Zhang Wanxiang Che 35 149 0 11 Jun 2020
Adversarial Alignment of Multilingual Models for Extracting Temporal Expressions from Text Lukas Lange Anastasiia Iurshina Heike Adel Jannik Strötgen 30 29 0 19 May 2020
Cross-Lingual Low-Resource Set-to-Description Retrieval for Global E-Commerce Juntao Li Chang Liu Jian Wang Lidong Bing Hongsong Li Xiaozhong Liu Dongyan Zhao Rui Yan 22 12 0 17 May 2020
Finding Universal Grammatical Relations in Multilingual BERT Ethan A. Chi John Hewitt Christopher D. Manning 18 151 0 09 May 2020
On the Limitations of Cross-lingual Encoders as Exposed by Reference-Free Machine Translation Evaluation Wei-Ye Zhao Goran Glavavs Maxime Peyrard Yang Gao Robert West Steffen Eger ELM 23 63 0 03 May 2020
Exploring Fine-tuning Techniques for Pre-trained Cross-lingual Models via Continual Learning Zihan Liu Genta Indra Winata Andrea Madotto Pascale Fung CLL 43 18 0 29 Apr 2020
A Study of Cross-Lingual Ability and Language-specific Information in Multilingual BERT Chi-Liang Liu Tsung-Yuan Hsu Yung-Sung Chuang Hung-yi Lee 34 14 0 20 Apr 2020
XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalization Junjie Hu Sebastian Ruder Aditya Siddhant Graham Neubig Orhan Firat Melvin Johnson ELM 62 955 0 24 Mar 2020
XPersona: Evaluating Multilingual Personalized Chatbot Zhaojiang Lin Zihan Liu Genta Indra Winata Samuel Cahyawijaya Andrea Madotto Yejin Bang Etsuko Ishii Pascale Fung 45 57 0 17 Mar 2020
Multilingual Alignment of Contextual Word Representations Steven Cao Nikita Kitaev Dan Klein 44 191 0 10 Feb 2020
On the Cross-lingual Transferability of Monolingual Representations Mikel Artetxe Sebastian Ruder Dani Yogatama 28 774 0 25 Oct 2019
Deep Contextualized Word Embeddings in Transition-Based and Graph-Based Dependency Parsing -- A Tale of Two Parsers Revisited Artur Kulmizev Miryam de Lhoneux Johannes Gontrum Elena Fano Joakim Nivre 30 56 0 20 Aug 2019
Cross-Lingual Syntactic Transfer through Unsupervised Adaptation of Invertible Projections Junxian He Zhisong Zhang Taylor Berg-Kirkpatrick Graham Neubig 25 21 0 06 Jun 2019
Beto, Bentz, Becas: The Surprising Cross-Lingual Effectiveness of BERT Shijie Wu Mark Dredze VLM SSeg 24 671 0 19 Apr 2019
75 Languages, 1 Model: Parsing Universal Dependencies Universally Dan Kondratyuk Milan Straka 28 263 0 03 Apr 2019
Linguistic Knowledge and Transferability of Contextual Representations Nelson F. Liu Matt Gardner Yonatan Belinkov Matthew E. Peters Noah A. Smith 52 718 0 21 Mar 2019
Context-Aware Cross-Lingual Mapping Hanan Aldarmaki Mona T. Diab 23 57 0 08 Mar 2019
Word Translation Without Parallel Data Alexis Conneau Guillaume Lample MarcÁurelio Ranzato Ludovic Denoyer Hervé Jégou 189 1,635 0 11 Oct 2017