Breaking the Language Barrier: Improving Cross-Lingual Reasoning with
Structured Self-Attention

Breaking the Language Barrier: Improving Cross-Lingual Reasoning with Structured Self-Attention

23 October 2023

Mohammadreza Banaei

Antoine Bosselut

ArXiv (abs)PDF HTML

Papers citing "Breaking the Language Barrier: Improving Cross-Lingual Reasoning with Structured Self-Attention"

18 / 18 papers shown

Title
Large Language Models are In-Context Semantic Reasoners rather than Symbolic Reasoners Xiaojuan Tang Zilong Zheng Jiaqi Li Fanxu Meng Song-Chun Zhu Yitao Liang Muhan Zhang ReLM LRM 77 61 0 24 May 2023
BLOOM: A 176B-Parameter Open-Access Multilingual Language Model BigScience Workshop : Teven Le Scao Angela Fan Christopher Akiki ... Zhongli Xie Zifan Ye M. Bras Younes Belkada Thomas Wolf VLM 394 2,392 0 09 Nov 2022
Language Models are Multilingual Chain-of-Thought Reasoners Freda Shi Mirac Suzgun Markus Freitag Xuezhi Wang Suraj Srivats ... Yi Tay Sebastian Ruder Denny Zhou Dipanjan Das Jason W. Wei ReLM LRM 244 368 0 06 Oct 2022
Discovering Language-neutral Sub-networks in Multilingual Language Models Negar Foroutan Mohammadreza Banaei R. Lebret Antoine Bosselut Karl Aberer LRM 103 25 0 25 May 2022
RobustLR: Evaluating Robustness to Logical Perturbation in Deductive Reasoning Soumya Sanyal Zeyi Liao Xiang Ren ELM ReLM LRM 82 21 0 25 May 2022
Speaker Information Can Guide Models to Better Inductive Biases: A Case Study On Predicting Code-Switching Alissa Ostapenko S. Wintner Melinda Fricke Yulia Tsvetkov 69 5 0 16 Mar 2022
One Question Answering Model for Many Languages with Cross-lingual Dense Passage Retrieval Akari Asai Xinyan Velocity Yu Jungo Kasai Hannaneh Hajishirzi RALM LRM 68 73 0 26 Jul 2021
From Machine Translation to Code-Switching: Generating High-Quality Code-Switched Text Ishan Tarunesh Syamantak Kumar Preethi Jyothi 79 46 0 14 Jul 2021
BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models Elad Ben-Zaken Shauli Ravfogel Yoav Goldberg 171 1,240 0 18 Jun 2021
ESTER: A Machine Reading Comprehension Dataset for Event Semantic Relation Reasoning Rujun Han I-Hung Hsu Jiao Sun J. Baylón Qiang Ning Dan Roth Nanyun Peng 63 46 0 16 Apr 2021
GLUECoS : An Evaluation Benchmark for Code-Switched NLP Simran Khanuja Sandipan Dandapat A. Srinivasan Sunayana Sitaram Monojit Choudhury ELM 60 148 0 26 Apr 2020
XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalization Junjie Hu Sebastian Ruder Aditya Siddhant Graham Neubig Orhan Firat Melvin Johnson ELM 183 975 0 24 Mar 2020
TyDi QA: A Benchmark for Information-Seeking Question Answering in Typologically Diverse Languages J. Clark Eunsol Choi Michael Collins Dan Garrette Tom Kwiatkowski Vitaly Nikolaev J. Palomaki 153 612 0 10 Mar 2020
Transformers as Soft Reasoners over Language Peter Clark Oyvind Tafjord Kyle Richardson ReLM OffRL LRM 99 360 0 14 Feb 2020
Unsupervised Cross-lingual Representation Learning at Scale Alexis Conneau Kartikay Khandelwal Naman Goyal Vishrav Chaudhary Guillaume Wenzek Francisco Guzmán Edouard Grave Myle Ott Luke Zettlemoyer Veselin Stoyanov 226 6,585 0 05 Nov 2019
On the Cross-lingual Transferability of Monolingual Representations Mikel Artetxe Sebastian Ruder Dani Yogatama 202 798 0 25 Oct 2019
How multilingual is Multilingual BERT? Telmo Pires Eva Schlinger Dan Garrette LRM VLM 159 1,411 0 04 Jun 2019
Beto, Bentz, Becas: The Surprising Cross-Lingual Effectiveness of BERT Shijie Wu Mark Dredze VLM SSeg 100 679 0 19 Apr 2019