Language Contamination Helps Explain the Cross-lingual Capabilities of
English Pretrained Models

Language Contamination Helps Explain the Cross-lingual Capabilities of English Pretrained Models

17 April 2022

Luke Zettlemoyer

Papers citing "Language Contamination Helps Explain the Cross-lingual Capabilities of English Pretrained Models"

17 / 67 papers shown

Title
Extrapolating Large Language Models to Non-English by Aligning Languages Wenhao Zhu Yunzhe Lv Qingxiu Dong Fei Yuan Jingjing Xu Shujian Huang Lingpeng Kong Jiajun Chen Lei Li 45 66 0 09 Aug 2023
How User Language Affects Conflict Fatality Estimates in ChatGPT Daniel Kazenwadel C. Steinert 19 1 0 26 Jul 2023
On Evaluating and Mitigating Gender Biases in Multilingual Settings Aniket Vashishtha Kabir Ahuja Sunayana Sitaram 26 23 0 04 Jul 2023
BUFFET: Benchmarking Large Language Models for Few-shot Cross-lingual Transfer Akari Asai Sneha Kudugunta Xinyan Velocity Yu Terra Blevins Hila Gonen Machel Reid Yulia Tsvetkov Sebastian Ruder Hannaneh Hajishirzi 44 54 0 24 May 2023
Can ChatGPT Defend its Belief in Truth? Evaluating LLM Reasoning via Debate Boshi Wang Xiang Yue Huan Sun ELM LRM 46 60 0 22 May 2023
DUMB: A Benchmark for Smart Evaluation of Dutch Models Wietse de Vries Martijn B. Wieling Malvina Nissim ELM ALM MoE 34 6 0 22 May 2023
Searching for Needles in a Haystack: On the Role of Incidental Bilingualism in PaLM's Translation Capability Eleftheria Briakou Colin Cherry George F. Foster 15 55 0 17 May 2023
Large Language Models Leverage External Knowledge to Extend Clinical Insight Beyond Language Boundaries Jiageng Wu X. Wu Zhaopeng Qiu Minghui Li Yingying Zhang Yefeng Zheng Changzheng Yuan Jie Yang LM&MA ELM AI4MH 26 16 0 17 May 2023
How Good are Commercial Large Language Models on African Languages? Jessica Ojo Kelechi Ogueji 26 5 0 11 May 2023
Speak, Memory: An Archaeology of Books Known to ChatGPT/GPT-4 Kent K. Chang Mackenzie Cramer Sandeep Soni David Bamman RALM 148 112 0 28 Apr 2023
Translate to Disambiguate: Zero-shot Multilingual Word Sense Disambiguation with Pretrained Language Models Haoqiang Kang Terra Blevins Luke Zettlemoyer 27 2 0 26 Apr 2023
MEGA: Multilingual Evaluation of Generative AI Kabir Ahuja Harshita Diddee Rishav Hada Millicent Ochieng Krithika Ramesh ... T. Ganu Sameer Segal Maxamed Axmed Kalika Bali Sunayana Sitaram LM&MA LRM ELM 27 269 0 22 Mar 2023
Investigating the Translation Performance of a Large Multilingual Language Model: the Case of BLOOM Rachel Bawden François Yvon VLM LRM 25 60 0 03 Mar 2023
Prompting Language Models for Linguistic Structure Terra Blevins Hila Gonen Luke Zettlemoyer LRM 35 40 0 15 Nov 2022
GreenPLM: Cross-Lingual Transfer of Monolingual Pre-Trained Language Models at Almost No Cost Qingcheng Zeng Lucas Garay Peilin Zhou Dading Chong Yining Hua Jiageng Wu Yi-Cheng Pan Han Zhou Rob Voigt Jie Yang VLM 26 23 0 13 Nov 2022
Whose Language Counts as High Quality? Measuring Language Ideologies in Text Data Selection Suchin Gururangan Dallas Card Sarah K. Drier E. K. Gade Leroy Z. Wang Zeyu Wang Luke Zettlemoyer Noah A. Smith 175 73 0 25 Jan 2022
Cross-lingual Transfer of Monolingual Models Evangelia Gogoulou Ariel Ekgren T. Isbister Magnus Sahlgren 29 17 0 15 Sep 2021