v1v2 (latest)

Language Models as Knowledge Bases?

3 September 2019

Patrick Lewis

ArXiv (abs)PDF HTML Github (1382★)

Papers citing "Language Models as Knowledge Bases?"

50 / 1,722 papers shown

Title
Combining pre-trained language models and structured knowledge Pedro Colon-Hernandez Catherine Havasi Jason B. Alonso Matthew Huggins C. Breazeal KELM 93 48 0 28 Jan 2021
English Machine Reading Comprehension Datasets: A Survey Daria Dzendzik Carl Vogel Jennifer Foster RALM AIMat 90 49 0 25 Jan 2021
Cross-lingual Visual Pre-training for Multimodal Machine Translation Ozan Caglayan Menekse Kuyu Mustafa Sercan Amac Pranava Madhyastha Erkut Erdem Aykut Erdem Lucia Specia VLM 82 46 0 25 Jan 2021
Fringe News Networks: Dynamics of US News Viewership following the 2020 Presidential Election Ashiqur R. KhudaBukhsh Rupak Sarkar M. Kamlet Tom Michael Mitchell 44 23 0 22 Jan 2021
Zero-shot Generalization in Dialog State Tracking through Generative Question Answering Shuyang Li Jin Cao Mukund Sridhar Henghui Zhu Shang-Wen Li Wael Hamza Julian McAuley BDL 74 46 0 20 Jan 2021
Training Data Leakage Analysis in Language Models Huseyin A. Inan Osman Ramadan Lukas Wutschitz Daniel Jones Victor Rühle James Withers Robert Sim MIACV PILM 98 9 0 14 Jan 2021
Dimensions of Commonsense Knowledge Filip Ilievski A. Oltramari Kaixin Ma Bin Zhang D. McGuinness Pedro A. Szekely 114 66 0 12 Jan 2021
Explain and Predict, and then Predict Again Zijian Zhang Koustav Rudra Avishek Anand FAtt 95 51 0 11 Jan 2021
Retrieving and Reading: A Comprehensive Survey on Open-domain Question Answering Fengbin Zhu Wenqiang Lei Chao Wang Jianming Zheng Soujanya Poria Tat-Seng Chua RALM 289 257 0 04 Jan 2021
DISCOS: Bridging the Gap between Discourse Knowledge and Commonsense Knowledge Tianqing Fang Hongming Zhang Weiqi Wang Yangqiu Song Bin He 120 48 0 01 Jan 2021
Multi-task Retrieval for Knowledge-Intensive Tasks Jean Maillard Vladimir Karpukhin Fabio Petroni Wen-tau Yih Barlas Oğuz Veselin Stoyanov Gargi Ghosh 268 67 0 01 Jan 2021
Studying Strategically: Learning to Mask for Closed-book QA Qinyuan Ye Belinda Z. Li Sinong Wang Benjamin Bolte Hao Ma Wen-tau Yih Xiang Ren Madian Khabsa OffRL 88 12 0 31 Dec 2020
Evidence-based Factual Error Correction James Thorne Andreas Vlachos KELM OffRL 96 58 0 31 Dec 2020
Making Pre-trained Language Models Better Few-shot Learners Tianyu Gao Adam Fisch Danqi Chen 463 1,987 0 31 Dec 2020
CoCoLM: COmplex COmmonsense Enhanced Language Model with Discourse Relations Changlong Yu Hongming Zhang Yangqiu Song Wilfred Ng 117 21 0 31 Dec 2020
Towards a Universal Continuous Knowledge Base Gang Chen Maosong Sun Yang Liu 64 3 0 25 Dec 2020
ProofWriter: Generating Implications, Proofs, and Abductive Statements over Natural Language Oyvind Tafjord Bhavana Dalvi Peter Clark 123 279 0 24 Dec 2020
Few-Shot Text Generation with Pattern-Exploiting Training Timo Schick Hinrich Schütze 131 148 0 22 Dec 2020
KRISP: Integrating Implicit and Symbolic Knowledge for Open-Domain Knowledge-Based VQA Kenneth Marino Xinlei Chen Devi Parikh Abhinav Gupta Marcus Rohrbach 138 188 0 20 Dec 2020
BERT Goes Shopping: Comparing Distributional Models for Product Representations Federico Bianchi Bingqing Yu Jacopo Tagliabue 60 15 0 17 Dec 2020
Learning to Rationalize for Nonmonotonic Reasoning with Distant Supervision Faeze Brahman Vered Shwartz Rachel Rudinger Yejin Choi LRM 98 42 0 14 Dec 2020
Extracting Training Data from Large Language Models Nicholas Carlini Florian Tramèr Eric Wallace Matthew Jagielski Ariel Herbert-Voss ... Tom B. Brown Basel Alomair Ulfar Erlingsson Alina Oprea Colin Raffel MLAU SILM 589 1,969 0 14 Dec 2020
Learning Contextual Causality from Time-consecutive Images Hongming Zhang Yintong Huo Xinran Zhao Yangqiu Song Dan Roth CML 61 6 0 13 Dec 2020
KgPLM: Knowledge-guided Language Model Pre-training via Generative and Discriminative Learning Bin He Xin Jiang Jinghui Xiao Qun Liu 104 18 0 07 Dec 2020
Pre-trained language models as knowledge bases for Automotive Complaint Analysis V. D. Viellieber Yi Men 18 2 0 04 Dec 2020
Circles are like Ellipses, or Ellipses are like Circles? Measuring the Degree of Asymmetry of Static and Contextual Embeddings and the Implications to Representation Learning Wei Zhang Murray Campbell Yang Yu Yara Rizk 44 0 0 03 Dec 2020
How Can We Know When Language Models Know? On the Calibration of Language Models for Question Answering Zhengbao Jiang Jun Araki Haibo Ding Graham Neubig UQCV 73 439 0 02 Dec 2020
Modifying Memories in Transformer Models Chen Zhu A. S. Rawat Manzil Zaheer Srinadh Bhojanapalli Daliang Li Felix X. Yu Sanjiv Kumar KELM 133 203 0 01 Dec 2020
Intrinsic Knowledge Evaluation on Chinese Language Models Zhiruo Wang Renfen Hu KELM ELM 38 1 0 29 Nov 2020
What do we expect from Multiple-choice QA Systems? Krunal Shah Nitish Gupta Dan Roth AAML 40 14 0 20 Nov 2020
Survey and Open Problems in Privacy Preserving Knowledge Graph: Merging, Query, Representation, Completion and Applications Chaochao Chen Jamie Cui Guanfeng Liu Hongzhi Zhang Li Wang 113 23 0 20 Nov 2020
Are Pre-trained Language Models Knowledgeable to Ground Open Domain Dialogues? Yufan Zhao Wei Wu Can Xu 67 9 0 19 Nov 2020
Exploring Neural Entity Representations for Semantic Information Andrew Runge Eduard H. Hovy 51 5 0 17 Nov 2020
Learning from Task Descriptions Orion Weller Nicholas Lourie Matt Gardner Matthew E. Peters 115 91 0 16 Nov 2020
NegatER: Unsupervised Discovery of Negatives in Commonsense Knowledge Bases Tara Safavi Jing Zhu Danai Koutra 114 13 0 15 Nov 2020
When Do You Need Billions of Words of Pretraining Data? Yian Zhang Alex Warstadt Haau-Sing Li Samuel R. Bowman 73 141 0 10 Nov 2020
Knowledge-driven Data Construction for Zero-shot Evaluation in Commonsense Question Answering Kaixin Ma Filip Ilievski Jonathan M Francis Yonatan Bisk Eric Nyberg A. Oltramari 72 6 0 07 Nov 2020
EXAMS: A Multi-Subject High School Examinations Dataset for Cross-Lingual and Multilingual Question Answering Momchil Hardalov Todor Mihaylov Dimitrina Zlatkova Yoan Dinkov Ivan Koychev Preslav Nakov AI4Ed ELM 290 54 0 05 Nov 2020
A Closer Look at Linguistic Knowledge in Masked Language Models: The Case of Relative Clauses in American English Marius Mosbach Stefania Degaetano-Ortlieb Marie-Pauline Krielke Badr M. Abdullah Dietrich Klakow 34 7 0 02 Nov 2020
CHIME: Cross-passage Hierarchical Memory Network for Generative Review Question Answering Junru Lu Gabriele Pergola Lin Gui Binyang Li Yulan He 50 8 0 01 Nov 2020
AutoPrompt: Eliciting Knowledge from Language Models with Automatically Generated Prompts Taylor Shin Yasaman Razeghi Robert L Logan IV Eric Wallace Sameer Singh KELM 144 409 0 29 Oct 2020
Automatically Identifying Words That Can Serve as Labels for Few-Shot Text Classification Timo Schick Helmut Schmid Hinrich Schütze VLM 100 209 0 26 Oct 2020
Learning Contextualized Knowledge Structures for Commonsense Reasoning Jun Yan Mrigank Raman Aaron Chan Tianyu Zhang Ryan Rossi Handong Zhao Sungchul Kim Nedim Lipka Xiang Ren 310 37 0 24 Oct 2020
Learning to Deceive Knowledge Graph Augmented Models via Targeted Perturbation Mrigank Raman Aaron Chan Siddhant Agarwal Peifeng Wang Hansen Wang Sungchul Kim Ryan Rossi Handong Zhao Nedim Lipka Xiang Ren 123 19 0 24 Oct 2020
Constructing Taxonomies from Pretrained Language Models Catherine Chen Kevin Lin Dan Klein 132 33 0 24 Oct 2020
Pre-training Text-to-Text Transformers for Concept-centric Common Sense Wangchunshu Zhou Dong-Ho Lee Ravi Kiran Selvam Seyeon Lee Bill Yuchen Lin Xiang Ren LRM VLM 57 72 0 24 Oct 2020
Knowledge Graph Based Synthetic Corpus Generation for Knowledge-Enhanced Language Model Pre-training Oshin Agarwal Heming Ge Siamak Shakeri Rami Al-Rfou 84 38 0 23 Oct 2020
Topic Modeling with Contextualized Word Representation Clusters Laure Thompson David M. Mimno 166 86 0 23 Oct 2020
Language Models are Open Knowledge Graphs Chenguang Wang Xiao Liu Basel Alomair SSL KELM 81 137 0 22 Oct 2020
Detecting and Exorcising Statistical Demons from Language Models with Anti-Models of Negative Data Michael L. Wick Kate Silverstein Jean-Baptiste Tristan Adam Craig Pocock Mark Johnson 40 3 0 22 Oct 2020