v1v2 (latest)

Language Models as Knowledge Bases?

3 September 2019

Patrick Lewis

ArXiv (abs)PDF HTML Github (1382★)

Papers citing "Language Models as Knowledge Bases?"

50 / 1,722 papers shown

Title
OpenPrompt: An Open-source Framework for Prompt-learning Ning Ding Shengding Hu Weilin Zhao Yulin Chen Zhiyuan Liu Haitao Zheng Maosong Sun VLM LLMAG 120 300 0 03 Nov 2021
Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Survey Bonan Min Hayley L Ross Elior Sulem Amir Pouran Ben Veyseh Thien Huu Nguyen Oscar Sainz Eneko Agirre Ilana Heinz Dan Roth LM&MA VLM AI4CE 202 1,103 0 01 Nov 2021
A Systematic Investigation of Commonsense Knowledge in Large Language Models Xiang Lorraine Li A. Kuncoro Jordan Hoffmann Cyprien de Masson dÁutume Phil Blunsom Aida Nematzadeh LRM 107 59 0 31 Oct 2021
MetaICL: Learning to Learn In Context Sewon Min M. Lewis Luke Zettlemoyer Hannaneh Hajishirzi LRM 262 493 0 29 Oct 2021
MEmoBERT: Pre-training Model with Prompt-based Learning for Multimodal Emotion Recognition Jinming Zhao Ruichen Li Qin Jin Xinchao Wang Haizhou Li 49 25 0 27 Oct 2021
Open Rule Induction Wanyun Cui Xingran Chen AI4TS AI4CE 66 4 0 26 Oct 2021
Improving Embedded Knowledge Graph Multi-hop Question Answering by introducing Relational Chain Reasoning Weiqiang Jin Biao Zhao Hang Yu Xi Tao Ruiping Yin Guizhong Liu 118 62 0 25 Oct 2021
Fast Model Editing at Scale E. Mitchell Charles Lin Antoine Bosselut Chelsea Finn Christopher D. Manning KELM 394 379 0 21 Oct 2021
Neural Lexicon Reader: Reduce Pronunciation Errors in End-to-end TTS by Leveraging External Textual Knowledge Mutian He Jingzhou Yang Lei He Frank Soong 86 1 0 19 Oct 2021
Knowledge Enhanced Pretrained Language Models: A Compreshensive Survey Xiaokai Wei Shen Wang Dejiao Zhang Parminder Bhatia Andrew O. Arnold KELM 93 46 0 16 Oct 2021
Good Examples Make A Faster Learner: Simple Demonstration-based Learning for Low-resource NER Dong-Ho Lee Akshen Kadakia Kangmin Tan Mahak Agarwal Xinyu Feng Takashi Shibuya Ryosuke Mitani Toshiyuki Sekiya Jay Pujara Xiang Ren 131 87 0 16 Oct 2021
Prix-LM: Pretraining for Multilingual Knowledge Base Construction Wenxuan Zhou Fangyu Liu Ivan Vulić Nigel Collier Muhao Chen KELM 133 19 0 16 Oct 2021
Open Domain Question Answering with A Unified Knowledge Interface Kaixin Ma Hao Cheng Xiaodong Liu Eric Nyberg Jianfeng Gao RALM 213 40 0 16 Oct 2021
Generated Knowledge Prompting for Commonsense Reasoning Jiacheng Liu Alisa Liu Ximing Lu Sean Welleck Peter West Ronan Le Bras Yejin Choi Hannaneh Hajishirzi KELM RALM ReLM LLMAG LRM 147 326 0 15 Oct 2021
Coherence boosting: When your pretrained language model is not paying enough attention Nikolay Malkin Zhen Wang Nebojsa Jojic RALM 76 37 0 15 Oct 2021
The World of an Octopus: How Reporting Bias Influences a Language Model's Perception of Color Cory Paik Stéphane Aroca-Ouellette Alessandro Roncone Katharina Kann 71 34 0 15 Oct 2021
Rewire-then-Probe: A Contrastive Recipe for Probing Biomedical Knowledge of Pre-trained Language Models Zaiqiao Meng Fangyu Liu Ehsan Shareghi Yixuan Su Charlotte Collins Nigel Collier 95 28 0 15 Oct 2021
mLUKE: The Power of Entity Representations in Multilingual Pretrained Language Models Ryokan Ri Ikuya Yamada Yoshimasa Tsuruoka 95 31 0 15 Oct 2021
Few-Shot Bot: Prompt-Based Learning for Dialogue Systems Andrea Madotto Zhaojiang Lin Genta Indra Winata Pascale Fung 101 85 0 15 Oct 2021
Exploring Universal Intrinsic Task Subspace via Prompt Tuning Yujia Qin Xiaozhi Wang Yusheng Su Yankai Lin Ning Ding ... Juanzi Li Lei Hou Peng Li Maosong Sun Jie Zhou VLM VPVLM 198 29 0 15 Oct 2021
Cross-Lingual Fine-Grained Entity Typing N. Selvaraj Yasumasa Onoe Greg Durrett 67 2 0 15 Oct 2021
Meta-learning via Language Model In-context Tuning Yanda Chen Ruiqi Zhong Sheng Zha George Karypis He He 334 163 0 15 Oct 2021
Towards More Effective and Economic Sparsely-Activated Model Hao Jiang Ke Zhan Jianwei Qu Yongkang Wu Zhaoye Fei ... Enrui Hu Yinxia Zhang Yantao Jia Fan Yu Bo Zhao MoE 229 13 0 14 Oct 2021
Solving Aspect Category Sentiment Analysis as a Text Generation Task Jian Liu Zhiyang Teng Leyang Cui Hanmeng Liu Yue Zhang 133 73 0 14 Oct 2021
Symbolic Knowledge Distillation: from General Language Models to Commonsense Models Peter West Chandrasekhar Bhagavatula Jack Hessel Jena D. Hwang Liwei Jiang Ronan Le Bras Ximing Lu Sean Welleck Yejin Choi SyDa 145 333 0 14 Oct 2021
ALL Dolphins Are Intelligent and SOME Are Friendly: Probing BERT for Nouns' Semantic Properties and their Prototypicality Marianna Apidianaki Aina Garí Soler 80 18 0 12 Oct 2021
Mention Memory: incorporating textual knowledge into Transformers through entity mention attention Michiel de Jong Yury Zemlyanskiy Nicholas FitzGerald Fei Sha William W. Cohen RALM 100 47 0 12 Oct 2021
Rome was built in 1776: A Case Study on Factual Correctness in Knowledge-Grounded Response Generation Sashank Santhanam Behnam Hedayatnia Spandana Gella Aishwarya Padmakumar Seokhwan Kim Yang Liu Dilek Z. Hakkani-Tür 88 35 0 11 Oct 2021
Pre-trained Language Models in Biomedical Domain: A Systematic Survey Benyou Wang Qianqian Xie Jiahuan Pei Zhihong Chen Prayag Tiwari Zhao Li Jie Fu LM&MA AI4CE 154 171 0 11 Oct 2021
Language Models As or For Knowledge Bases Simon Razniewski Andrew Yates Nora Kassner Gerhard Weikum KELM 80 1 0 10 Oct 2021
A Few More Examples May Be Worth Billions of Parameters Yuval Kirstain Patrick Lewis Sebastian Riedel Omer Levy 133 21 0 08 Oct 2021
Inferring Offensiveness In Images From Natural Language Supervision P. Schramowski Kristian Kersting 53 2 0 08 Oct 2021
Towards Continual Knowledge Learning of Language Models Joel Jang Seonghyeon Ye Sohee Yang Joongbo Shin Janghoon Han Gyeonghun Kim Stanley Jungkyu Choi Minjoon Seo CLL KELM 311 161 0 07 Oct 2021
GNN is a Counter? Revisiting GNN for Question Answering Kuan-Chieh Wang Yuyu Zhang Diyi Yang Le Song Tao Qin LMTD 79 31 0 07 Oct 2021
How BPE Affects Memorization in Transformers Eugene Kharitonov Marco Baroni Dieuwke Hupkes 247 33 0 06 Oct 2021
Leveraging the Inductive Bias of Large Language Models for Abstract Textual Reasoning Christopher Rytting David Wingate AI4CE LRM 92 27 0 05 Oct 2021
Perhaps PTLMs Should Go to School -- A Task to Assess Open Book and Closed Book QA Manuel R. Ciosici Joe Cecil Alex Hedges Dong-Ho Lee Marjorie Freedman R. Weischedel 58 10 0 04 Oct 2021
TopiOCQA: Open-domain Conversational Question Answering with Topic Switching Vaibhav Adlakha Shehzaad Dhuliawala Kaheer Suleman H. D. Vries Siva Reddy BDL 127 92 0 02 Oct 2021
A Survey of Knowledge Enhanced Pre-trained Models Jian Yang Xinyu Hu Gang Xiao Yulong Shen KELM 109 6 0 01 Oct 2021
BeliefBank: Adding Memory to a Pre-Trained Language Model for a Systematic Notion of Belief Nora Kassner Oyvind Tafjord Hinrich Schütze Peter Clark KELM LRM 315 65 0 29 Sep 2021
Text2Brain: Synthesis of Brain Activation Maps from Free-form Text Query G. Ngo Minh Le Nguyen Nancy F. Chen M. Sabuncu 57 6 0 28 Sep 2021
Classifying Dyads for Militarized Conflict Analysis Niklas Stoehr Lucas Torroba Hennigen Samin Ahbab Robert West Ryan Cotterell 76 10 0 27 Sep 2021
Extracting and Inferring Personal Attributes from Dialogue Zhilin Wang Xuhui Zhou Rik Koncel-Kedziorski Alex Marin Fei Xia 85 15 0 26 Sep 2021
XLM-K: Improving Cross-Lingual Language Model Pre-training with Multilingual Knowledge X. Jiang Yaobo Liang Weizhu Chen Nan Duan 96 24 0 26 Sep 2021
Sorting through the noise: Testing robustness of information processing in pre-trained language models Lalchand Pandia Allyson Ettinger 89 38 0 25 Sep 2021
RuleBert: Teaching Soft Rules to Pre-trained Language Models Mohammed Saeed N. Ahmadi Preslav Nakov Paolo Papotti LRM 352 33 0 24 Sep 2021
Separating Retention from Extraction in the Evaluation of End-to-end Relation Extraction Bruno Taillé Vincent Guigue Geoffrey Scoutheeten Patrick Gallinari 110 6 0 24 Sep 2021
CPT: Colorful Prompt Tuning for Pre-trained Vision-Language Models Yuan Yao Ao Zhang Zhengyan Zhang Zhiyuan Liu Tat-Seng Chua Maosong Sun MLLM VPVLM VLM 307 224 0 24 Sep 2021
Transferring Knowledge from Vision to Language: How to Achieve it and how to Measure it? Tobias Norlund Lovisa Hagström Richard Johansson 79 25 0 23 Sep 2021
Zero-Shot Information Extraction as a Unified Text-to-Triple Translation Chenguang Wang Xiao Liu Zui Chen Haoyun Hong Jie Tang Basel Alomair 242 36 0 23 Sep 2021