Multilingual LAMA: Investigating Knowledge in Multilingual Pretrained Language Models

1 February 2021

Papers citing "Multilingual LAMA: Investigating Knowledge in Multilingual Pretrained Language Models"

50 / 109 papers shown

Title
Can Knowledge Graphs Reduce Hallucinations in LLMs? : A Survey Garima Agrawal Tharindu Kumarage Zeyad Alghami Huanmin Liu 111 97 0 14 Nov 2023
Language Representation Projection: Can We Transfer Factual Knowledge across Languages in Multilingual Language Models? Shaoyang Xu Junzhuo Li Deyi Xiong KELM 143 20 0 07 Nov 2023
Counterfactually Probing Language Identity in Multilingual Models Anirudh Srinivasan Venkata S Govindarajan Kyle Mahowald 77 1 0 29 Oct 2023
Give Me the Facts! A Survey on Factual Knowledge Probing in Pre-trained Language Models Paul Youssef Osman Alperen Koracs Meijie Li Jorg Schlotterer Christin Seifert KELM 81 19 0 25 Oct 2023
Cross-Lingual Consistency of Factual Knowledge in Multilingual Language Models Jirui Qi Raquel Fernández Arianna Bisazza KELM HILM 223 76 0 16 Oct 2023
Impact of Co-occurrence on Factual Knowledge of Large Language Models Cheongwoong Kang Jaesik Choi KELM 91 18 0 12 Oct 2023
RelBERT: Embedding Relations with Language Models Asahi Ushio Jose Camacho-Collados Steven Schockaert KELM 82 1 0 30 Sep 2023
Journey to the Center of the Knowledge Neurons: Discoveries of Language-Independent Knowledge Neurons and Degenerate Knowledge Neurons Yuheng Chen Pengfei Cao Yubo Chen Kang Liu Jun Zhao KELM 95 49 0 25 Aug 2023
Anonymity at Risk? Assessing Re-Identification Capabilities of Large Language Models Alex Nyffenegger Matthias Sturmer Joel Niklaus 97 7 0 22 Aug 2023
Text2KGBench: A Benchmark for Ontology-Driven Knowledge Graph Generation from Text Nandana Mihindukulasooriya Sanju Tiwari Carlos F. Enguix K. Lata 91 62 0 04 Aug 2023
Empowering Cross-lingual Behavioral Testing of NLP Models with Typological Features Ester Hlavnova Sebastian Ruder 84 5 0 11 Jul 2023
Extracting Multi-valued Relations from Language Models Sneha Singhania Simon Razniewski Gerhard Weikum KELM 81 4 0 06 Jul 2023
On Evaluating Multilingual Compositional Generalization with Translated Datasets Zi Wang Daniel Hershcovich 106 7 0 20 Jun 2023
DLAMA: A Framework for Curating Culturally Diverse Facts for Probing the Knowledge of Pretrained Language Models Amr Keleg Walid Magdy KELM HILM 95 11 0 08 Jun 2023
ModuleFormer: Modularity Emerges from Mixture-of-Experts Songlin Yang Zheyu Zhang Tianyou Cao Shawn Tan Zhenfang Chen Chuang Gan KELM MoE 60 10 0 07 Jun 2023
A Comprehensive Survey on Relation Extraction: Recent Advances and New Frontiers Xiaoyan Zhao Yang Deng Min Yang Lingzhi Wang Rui Zhang Hong Cheng W. Lam Ying Shen Ruifeng Xu KELM 100 37 0 03 Jun 2023
Exploring Large Language Models for Classical Philology Frederick Riemenschneider Anette Frank 68 16 0 23 May 2023
Polyglot or Not? Measuring Multilingual Encyclopedic Knowledge in Foundation Models Tim Schott Daniel Furman Shreshta Bhat ELM 76 4 0 23 May 2023
Multi-CrossRE A Multi-Lingual Multi-Domain Dataset for Relation Extraction Elisa Bassignana Filip Ginter S. Pyysalo Rob van der Goot Barbara Plank 75 5 0 18 May 2023
Retentive or Forgetful? Diving into the Knowledge Memorizing Mechanism of Language Models Boxi Cao Qiaoyu Tang Hongyu Lin Shanshan Jiang Bin Dong Xianpei Han Jiawei Chen Tianshu Wang Le Sun CLL KELM 59 17 0 16 May 2023
The Life Cycle of Knowledge in Big Language Models: A Survey Boxi Cao Hongyu Lin Xianpei Han Le Sun KELM 95 29 0 14 Mar 2023
Dynamic Benchmarking of Masked Language Models on Temporal Concept Drift with Multiple Views Katerina Margatina Shuai Wang Yogarshi Vyas Neha Ann John Yassine Benajiba Miguel Ballesteros 73 17 0 23 Feb 2023
TempEL: Linking Dynamically Evolving and Newly Emerging Entities Klim Zaporojets Lucie-Aimée Kaffee Johannes Deleu Thomas Demeester Chris Develder Isabelle Augenstein KELM 121 16 0 05 Feb 2023
Event knowledge in large language models: the gap between the impossible and the unlikely Carina Kauf Anna A. Ivanova Giulia Rambelli Emmanuele Chersoni Jingyuan Selena She Zawad Chowdhury Evelina Fedorenko Alessandro Lenci 124 70 0 02 Dec 2022
Unsupervised extraction, labelling and clustering of segments from clinical notes Petr Zelina J. Halámková V. Nováček 48 3 0 21 Nov 2022
Measuring Reliability of Large Language Models through Semantic Consistency Harsh Raj Domenic Rosati Subhabrata Majumdar HILM 91 31 0 10 Nov 2022
MetaFill: Text Infilling for Meta-Path Generation on Heterogeneous Information Networks Zequn Liu Kefei Duan Junwei Yang Hanwen Xu Ming Zhang Sheng Wang MoE 78 0 0 14 Oct 2022
Language Models are Multilingual Chain-of-Thought Reasoners Freda Shi Mirac Suzgun Markus Freitag Xuezhi Wang Suraj Srivats ... Yi Tay Sebastian Ruder Denny Zhou Dipanjan Das Jason W. Wei ReLM LRM 276 369 0 06 Oct 2022
Neural Approaches to Multilingual Information Retrieval Dawn J Lawrie Eugene Yang Douglas W. Oard J. Mayfield 75 23 0 03 Sep 2022
Evaluate Confidence Instead of Perplexity for Zero-shot Commonsense Reasoning Letian Peng Z. Li Hai Zhao ReLM LRM 55 1 0 23 Aug 2022
Measuring Causal Effects of Data Statistics on Language Model's `Factual' Predictions Yanai Elazar Nora Kassner Shauli Ravfogel Amir Feder Abhilasha Ravichander Marius Mosbach Yonatan Belinkov Hinrich Schütze Yoav Goldberg CML SyDa MILM 110 55 0 28 Jul 2022
Square One Bias in NLP: Towards a Multi-Dimensional Exploration of the Research Manifold Sebastian Ruder Ivan Vulić Anders Søgaard 86 30 0 20 Jun 2022
Language Anisotropic Cross-Lingual Model Editing Yang Xu Yutai Hou Wanxiang Che Min Zhang KELM 159 28 0 25 May 2022
GeoMLAMA: Geo-Diverse Commonsense Probing on Multilingual Pre-Trained Language Models Da Yin Hritik Bansal Masoud Monajatipoor Liunian Harold Li Kai-Wei Chang 99 31 0 24 May 2022
What do You Mean by Relation Extraction? A Survey on Datasets and Study on Scientific Relation Classification Elisa Bassignana Barbara Plank 86 23 0 28 Apr 2022
mGPT: Few-Shot Learners Go Multilingual Oleh Shliazhko Alena Fenogenova Maria Tikhonova Vladislav Mikhailov Anastasia Kozlova Tatiana Shavrina 155 155 0 15 Apr 2022
A Comparative Study of Pre-trained Encoders for Low-Resource Named Entity Recognition Yuxuan Chen Jonas Mikkelsen Arne Binder Christoph Alt Leonhard Hennig 74 2 0 11 Apr 2022
How Pre-trained Language Models Capture Factual Knowledge? A Causal-Inspired Analysis Shaobo Li Xiaoguang Li Lifeng Shang Zhenhua Dong Chengjie Sun Bingquan Liu Zhenzhou Ji Xin Jiang Qun Liu KELM 94 55 0 31 Mar 2022
Factual Consistency of Multilingual Pretrained Language Models Constanza Fierro Anders Søgaard HILM 77 16 0 22 Mar 2022
Challenges and Strategies in Cross-Cultural NLP Daniel Hershcovich Stella Frank Heather Lent Miryam de Lhoneux Mostafa Abdou ... Ruixiang Cui Constanza Fierro Katerina Margatina Phillip Rust Anders Søgaard 140 182 0 18 Mar 2022
Distilling Hypernymy Relations from Language Models: On the Effectiveness of Zero-Shot Taxonomy Induction Devansh Jain Luis Espinosa Anke 85 12 0 10 Feb 2022
Few-shot Learning with Multilingual Language Models Xi Lin Todor Mihaylov Mikel Artetxe Tianlu Wang Shuohui Chen ... Luke Zettlemoyer Zornitsa Kozareva Mona T. Diab Ves Stoyanov Xian Li BDL ELM LRM 153 309 0 20 Dec 2021
LMTurk: Few-Shot Learners as Crowdsourcing Workers in a Language-Model-as-a-Service Framework Mengjie Zhao Fei Mi Yasheng Wang Minglei Li Xin Jiang Qun Liu Hinrich Schütze RALM 115 11 0 14 Dec 2021
Dataset Geography: Mapping Language Data to Language Users Fahim Faisal Yinkai Wang Antonios Anastasopoulos 113 24 0 07 Dec 2021
Leveraging Knowledge in Multilingual Commonsense Reasoning Yuwei Fang Shuohang Wang Yichong Xu Ruochen Xu Siqi Sun Chenguang Zhu Michael Zeng LRM 299 17 0 16 Oct 2021
Prix-LM: Pretraining for Multilingual Knowledge Base Construction Wenxuan Zhou Fangyu Liu Ivan Vulić Nigel Collier Muhao Chen KELM 133 19 0 16 Oct 2021
Rewire-then-Probe: A Contrastive Recipe for Probing Biomedical Knowledge of Pre-trained Language Models Zaiqiao Meng Fangyu Liu Ehsan Shareghi Yixuan Su Charlotte Collins Nigel Collier 93 28 0 15 Oct 2021
mLUKE: The Power of Entity Representations in Multilingual Pretrained Language Models Ryokan Ri Ikuya Yamada Yoshimasa Tsuruoka 95 31 0 15 Oct 2021
Cross-Lingual Fine-Grained Entity Typing N. Selvaraj Yasumasa Onoe Greg Durrett 57 2 0 15 Oct 2021
XLM-K: Improving Cross-Lingual Language Model Pre-training with Multilingual Knowledge X. Jiang Yaobo Liang Weizhu Chen Nan Duan 87 24 0 26 Sep 2021