Khayyam Challenge (PersianMMLU): Is Your LLM Truly Wise to The Persian
Language?

Khayyam Challenge (PersianMMLU): Is Your LLM Truly Wise to The Persian Language?

9 April 2024

Mohammad V. Sanian

Ehsaneddin Asgari

Papers citing "Khayyam Challenge (PersianMMLU): Is Your LLM Truly Wise to The Persian Language?"

8 / 8 papers shown

Title
ELAB: Extensive LLM Alignment Benchmark in Persian Language Zahra Pourbahman Fatemeh Rajabi Mohammadhossein Sadeghi Omid Ghahroodi Somaye Bakhshaei Arash Amini Reza Kazemi M. Baghshah 32 0 0 17 Apr 2025
LAG-MMLU: Benchmarking Frontier LLM Understanding in Latvian and Giriama Naome A. Etori Kevin Lu Randu Karisa Arturs Kanepajs LRM ELM 187 0 0 14 Mar 2025
INCLUDE: Evaluating Multilingual Language Understanding with Regional Knowledge Angelika Romanou Negar Foroutan Anna Sotnikova Zeming Chen Sree Harsha Nelaturu ... Mike Zhang Imanol Schlag Marzieh Fadaee Sara Hooker Antoine Bosselut ELM 113 6 0 29 Nov 2024
MEXA: Multilingual Evaluation of English-Centric LLMs via Cross-Lingual Alignment Amir Hossein Kargaran Ali Modarressi Nafiseh Nikeghbal Jana Diesner François Yvon Hinrich Schütze ELM 46 3 0 08 Oct 2024
PsychoLex: Unveiling the Psychological Mind of Large Language Models Mohammad Amin Abbasi Farnaz Sadat Mirnezami Hassan Naderi LM&MA 38 1 0 16 Aug 2024
Benchmark Data Contamination of Large Language Models: A Survey Cheng Xu Shuhao Guan Derek Greene Mohand-Tahar Kechadi ELM ALM 38 39 0 06 Jun 2024
KMMLU: Measuring Massive Multitask Language Understanding in Korean Guijin Son Hanwool Albert Lee Sungdong Kim Seungone Kim Niklas Muennighoff Taekyoon Choi Cheonbok Park Kang Min Yoo Stella Biderman ALM RALM ELM 52 37 0 18 Feb 2024
Scaling Laws for Neural Language Models Jared Kaplan Sam McCandlish T. Henighan Tom B. Brown B. Chess R. Child Scott Gray Alec Radford Jeff Wu Dario Amodei 264 4,489 0 23 Jan 2020