v1v2 (latest)

Are Structural Concepts Universal in Transformer Language Models? Towards Interpretable Cross-Lingual Generalization

19 October 2023

Xuanjing Huang

Papers citing "Are Structural Concepts Universal in Transformer Language Models? Towards Interpretable Cross-Lingual Generalization"

32 / 32 papers shown

Title
MEGA: Multilingual Evaluation of Generative AI Kabir Ahuja Harshita Diddee Rishav Hada Millicent Ochieng Krithika Ramesh ... T. Ganu Sameer Segal Maxamed Axmed Kalika Bali Sunayana Sitaram LM&MA LRM ELM 97 282 0 22 Mar 2023
Cross-Linguistic Syntactic Difference in Multilingual BERT: How Good is It and How Does It Affect Transfer? Ningyu Xu Tao Gui Ruotian Ma Qi Zhang Jingting Ye Menghan Zhang Xuanjing Huang 71 13 0 21 Dec 2022
Probing for Incremental Parse States in Autoregressive Language Models Tiwalayo Eisape Vineet Gangireddy R. Levy Yoon Kim 51 12 0 17 Nov 2022
Prompting as Probing: Using Language Models for Knowledge Base Construction Dimitrios Alivanistos Selene Báez Santamaría Michael Cochez Jan-Christoph Kalo Emile van Krieken Thiviyan Thanapalasingam KELM 69 48 0 23 Aug 2022
On the cross-lingual transferability of multilingual prototypical models across NLU tasks Oralie Cattan Christophe Servan S. Rosset 64 9 0 19 Jul 2022
Zero-Shot Dependency Parsing with Worst-Case Aware Automated Curriculum Learning Miryam de Lhoneux Shenmin Zhang Anders Søgaard 54 11 0 16 Mar 2022
Systematic Inequalities in Language Technology Performance across the World's Languages Damián E. Blasi Antonios Anastasopoulos Graham Neubig 157 138 0 13 Oct 2021
Cross-domain Few-shot Learning with Task-specific Adapters Weihong Li Xialei Liu Hakan Bilen OOD 84 116 0 01 Jul 2021
Minimax and Neyman-Pearson Meta-Learning for Outlier Languages Edoardo Ponti Rahul Aralikatte Disha Shrivastava Siva Reddy Anders Søgaard 91 16 0 02 Jun 2021
Meta-Learning for Fast Cross-Lingual Adaptation in Dependency Parsing Anna Langedijk Verna Dankers Phillip Lippe Sander Bos B. C. Guevara H. Yannakoudakis Ekaterina Shutova CLL 53 15 0 10 Apr 2021
How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language Models Phillip Rust Jonas Pfeiffer Ivan Vulić Sebastian Ruder Iryna Gurevych 128 254 0 31 Dec 2020
Finding Universal Grammatical Relations in Multilingual BERT Ethan A. Chi John Hewitt Christopher D. Manning 45 151 0 09 May 2020
Syntactic Structure from Deep Learning Tal Linzen Marco Baroni NAI 58 185 0 22 Apr 2020
The State and Fate of Linguistic Diversity and Inclusion in the NLP World Pratik M. Joshi Sebastin Santy A. Budhiraja Kalika Bali Monojit Choudhury LMTD 117 850 0 20 Apr 2020
Zero-Shot Cross-Lingual Transfer with Meta Learning Farhad Nooralahzadeh Giannis Bekoulis Johannes Bjerva Isabelle Augenstein FedML 61 113 0 05 Mar 2020
Multilingual Alignment of Contextual Word Representations Steven Cao Nikita Kitaev Dan Klein 87 193 0 10 Feb 2020
Learning as the Unsupervised Alignment of Conceptual Systems Brett D. Roads Bradley C. Love OCL 47 46 0 21 Jun 2019
What Does BERT Look At? An Analysis of BERT's Attention Kevin Clark Urvashi Khandelwal Omer Levy Christopher D. Manning MILM 218 1,598 0 11 Jun 2019
How multilingual is Multilingual BERT? Telmo Pires Eva Schlinger Dan Garrette LRM VLM 153 1,410 0 04 Jun 2019
Choosing Transfer Languages for Cross-Lingual Learning Yu-Hsiang Lin Chian-Yu Chen Jean Lee Zirui Li Yuyan Zhang ... Zhisong Zhang Xuezhe Ma Antonios Anastasopoulos Patrick Littell Graham Neubig 89 233 0 29 May 2019
What do you learn from context? Probing for sentence structure in contextualized word representations Ian Tenney Patrick Xia Berlin Chen Alex Jinpeng Wang Adam Poliak ... Najoung Kim Benjamin Van Durme Samuel R. Bowman Dipanjan Das Ellie Pavlick 175 861 0 15 May 2019
Beto, Bentz, Becas: The Surprising Cross-Lingual Effectiveness of BERT Shijie Wu Mark Dredze VLM SSeg 100 679 0 19 Apr 2019
Linguistic Knowledge and Transferability of Contextual Representations Nelson F. Liu Matt Gardner Yonatan Belinkov Matthew E. Peters Noah A. Smith 130 733 0 21 Mar 2019
Cross-Lingual Alignment of Contextual Word Embeddings, with Applications to Zero-shot Dependency Parsing Tal Schuster Ori Ram Regina Barzilay Amir Globerson 80 210 0 25 Feb 2019
How to (Properly) Evaluate Cross-Lingual Word Embeddings: On Strong Baselines, Comparative Analyses, and Some Misconceptions Goran Glavaš Robert Litschko Sebastian Ruder Ivan Vulić ELM 71 183 0 01 Feb 2019
Deep RNNs Encode Soft Hierarchical Syntax Terra Blevins Omer Levy Luke Zettlemoyer 71 111 0 11 May 2018
What you can cram into a single vector: Probing sentence embeddings for linguistic properties Alexis Conneau Germán Kruszewski Guillaume Lample Loïc Barrault Marco Baroni 342 894 0 03 May 2018
On First-Order Meta-Learning Algorithms Alex Nichol Joshua Achiam John Schulman 230 2,232 0 08 Mar 2018
Word Translation Without Parallel Data Alexis Conneau Guillaume Lample MarcÁurelio Ranzato Ludovic Denoyer Hervé Jégou 291 1,660 0 11 Oct 2017
A Survey Of Cross-lingual Word Embedding Models Sebastian Ruder Ivan Vulić Anders Søgaard 84 531 0 15 Jun 2017
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks Chelsea Finn Pieter Abbeel Sergey Levine OOD 823 11,909 0 09 Mar 2017
Exploiting Similarities among Languages for Machine Translation Tomas Mikolov Quoc V. Le Ilya Sutskever 96 1,596 0 17 Sep 2013