v1v2 (latest)

Language Models as Knowledge Bases?

3 September 2019

Patrick Lewis

ArXiv (abs)PDF HTML Github (1382★)

Papers citing "Language Models as Knowledge Bases?"

50 / 1,722 papers shown

Title
Parameter-Efficient Tuning by Manipulating Hidden States of Pretrained Language Models For Classification Tasks Haoran Yang Piji Li Wai Lam 77 4 0 10 Apr 2022
Knowledge Infused Decoding Ruibo Liu Guoqing Zheng Shashank Gupta Radhika Gaonkar Chongyang Gao Soroush Vosoughi Milad Shokouhi Ahmed Hassan Awadallah KELM 90 14 0 06 Apr 2022
Match-Prompt: Improving Multi-task Generalization Ability for Neural Text Matching via Prompt Learning Shicheng Xu Liang Pang Huawei Shen Xueqi Cheng VLM 87 17 0 06 Apr 2022
An Exploratory Study on Code Attention in BERT Rishab Sharma Fuxiang Chen Fatemeh H. Fard David Lo 77 27 0 05 Apr 2022
Socratic Models: Composing Zero-Shot Multimodal Reasoning with Language Andy Zeng Maria Attarian Brian Ichter K. Choromanski Adrian S. Wong ... Michael S. Ryoo Vikas Sindhwani Johnny Lee Vincent Vanhoucke Peter R. Florence ReLM LRM 218 589 0 01 Apr 2022
Effect and Analysis of Large-scale Language Model Rescoring on Competitive ASR Systems Takuma Udagawa Masayuki Suzuki Gakuto Kurata N. Itoh G. Saon 115 24 0 01 Apr 2022
How Pre-trained Language Models Capture Factual Knowledge? A Causal-Inspired Analysis Shaobo Li Xiaoguang Li Lifeng Shang Zhenhua Dong Chengjie Sun Bingquan Liu Zhenzhou Ji Xin Jiang Qun Liu KELM 96 55 0 31 Mar 2022
Position-based Prompting for Health Outcome Generation Micheal Abaho Danushka Bollegala P. Williamson S. Dodd 61 10 0 30 Mar 2022
LinkBERT: Pretraining Language Models with Document Links Michihiro Yasunaga J. Leskovec Percy Liang KELM 112 361 0 29 Mar 2022
Few-Shot Learning with Siamese Networks and Label Tuning Thomas Müller Guillermo Pérez-Torró Marc Franco-Salvador VLM 95 41 0 28 Mar 2022
Knowledge Mining with Scene Text for Fine-Grained Recognition Hao Wang Junchao Liao Tianheng Cheng Zewen Gao Hao Liu Bo Ren X. Bai Wenyu Liu 72 15 0 27 Mar 2022
Probing Pre-Trained Language Models for Cross-Cultural Differences in Values Arnav Arora Lucie-Aimée Kaffee Isabelle Augenstein VLM 95 136 0 25 Mar 2022
minicons: Enabling Flexible Behavioral and Representational Analyses of Transformer Language Models Kanishka Misra 95 63 0 24 Mar 2022
Can Prompt Probe Pretrained Language Models? Understanding the Invisible Risks from a Causal View Boxi Cao Hongyu Lin Xianpei Han Fangchao Liu Le Sun ELM AAML 59 43 0 23 Mar 2022
Factual Consistency of Multilingual Pretrained Language Models Constanza Fierro Anders Søgaard HILM 77 16 0 22 Mar 2022
Achieving Conversational Goals with Unsupervised Post-hoc Knowledge Injection Bodhisattwa Prasad Majumder Harsh Jhamtani Taylor Berg-Kirkpatrick Julian McAuley 69 8 0 22 Mar 2022
Automatic Detection of Entity-Manipulated Text using Factual Knowledge Ganesh Jawahar Muhammad Abdul-Mageed L. Lakshmanan DeLMO 71 11 0 19 Mar 2022
Sequence-to-Sequence Knowledge Graph Completion and Question Answering Apoorv Saxena Adrian Kochsiek Rainer Gemulla AIMat 135 129 0 19 Mar 2022
Do Multilingual Language Models Capture Differing Moral Norms? Katharina Hämmerl Bjorn Deiseroth P. Schramowski Jindrich Libovický Alexander Fraser Kristian Kersting 59 17 0 18 Mar 2022
Prototypical Verbalizer for Prompt-based Few-shot Tuning Ganqu Cui Shengding Hu Ning Ding Longtao Huang Zhiyuan Liu VLM 70 99 0 18 Mar 2022
DP-KB: Data Programming with Knowledge Bases Improves Transformer Fine Tuning for Answer Sentence Selection Nic Jedema Thuy Vu Manish Gupta Alessandro Moschitti 52 1 0 17 Mar 2022
EVA2.0: Investigating Open-Domain Chinese Dialogue Systems with Large-Scale Pre-Training Yuxian Gu Jiaxin Wen Hao Sun Yi Song Pei Ke ... Zheng Zhang Jianzhu Yao Lei Liu Xiaoyan Zhu Minlie Huang 93 55 0 17 Mar 2022
RelationPrompt: Leveraging Prompts to Generate Synthetic Data for Zero-Shot Relation Triplet Extraction Yew Ken Chia Lidong Bing Soujanya Poria Luo Si 90 112 0 17 Mar 2022
Multi-Stage Prompting for Knowledgeable Dialogue Generation Zihan Liu M. Patwary R. Prenger Shrimai Prabhumoye Ming-Yu Liu Mohammad Shoeybi Bryan Catanzaro 63 50 0 16 Mar 2022
Iteratively Prompt Pre-trained Language Models for Chain of Thought Boshi Wang Xiang Deng Huan Sun KELM ReLM LRM 136 103 0 16 Mar 2022
Things not Written in Text: Exploring Spatial Commonsense from Visual Signals Xiao Liu Da Yin Yansong Feng Dongyan Zhao LRM 80 46 0 15 Mar 2022
GrIPS: Gradient-free, Edit-based Instruction Search for Prompting Large Language Models Archiki Prasad Peter Hase Xiang Zhou Joey Tianyi Zhou 133 124 0 14 Mar 2022
CLIP Models are Few-shot Learners: Empirical Studies on VQA and Visual Entailment Haoyu Song Li Dong Weinan Zhang Ting Liu Furu Wei VLM CLIP 113 139 0 14 Mar 2022
Delta Tuning: A Comprehensive Study of Parameter Efficient Methods for Pre-trained Language Models Ning Ding Yujia Qin Guang Yang Fu Wei Zonghan Yang ... Jianfei Chen Yang Liu Jie Tang Juan Li Maosong Sun 136 205 0 14 Mar 2022
Improved Universal Sentence Embeddings with Prompt-based Contrastive Learning and Energy-based Learning Yuxin Jiang Linhan Zhang Wei Wang SSL 68 47 0 14 Mar 2022
Continual Prompt Tuning for Dialog State Tracking Qi Zhu Bing Li Fei Mi Xiaoyan Zhu Minlie Huang CLL KELM 94 60 0 13 Mar 2022
CoDA21: Evaluating Language Understanding Capabilities of NLP Models With Context-Definition Alignment Lutfi Kerem Senel Timo Schick Hinrich Schütze ELM ALM 62 5 0 11 Mar 2022
A Sentence is Worth 128 Pseudo Tokens: A Semantic-Aware Contrastive Learning Framework for Sentence Embeddings Haochen Tan Wei Shao Han Wu Ke Yang Linqi Song 52 19 0 11 Mar 2022
Conditional Prompt Learning for Vision-Language Models Kaiyang Zhou Jingkang Yang Chen Change Loy Ziwei Liu VLM CLIP VPVLM 165 1,367 0 10 Mar 2022
HealthPrompt: A Zero-shot Learning Paradigm for Clinical Natural Language Processing Sonish Sivarajkumar Yanshan Wang VLM LM&MA 103 58 0 09 Mar 2022
SimKGC: Simple Contrastive Knowledge Graph Completion with Pre-trained Language Models Liang Wang Wei Zhao Zhuoyu Wei Jingming Liu 109 187 0 04 Mar 2022
Do Prompts Solve NLP Tasks Using Natural Language? Sen Yang Yunchen Zhang Leyang Cui Yue Zhang LRM 80 4 0 02 Mar 2022
"Is Whole Word Masking Always Better for Chinese BERT?": Probing on Chinese Grammatical Error Correction Yong Dai Linyang Li Cong Zhou Zhangyin Feng Enbo Zhao Xipeng Qiu Pijian Li Duyu Tang 70 13 0 01 Mar 2022
KMIR: A Benchmark for Evaluating Knowledge Memorization, Identification and Reasoning Abilities of Language Models Daniel Gao Yantao Jia Lei Li Chengzhen Fu Zhicheng Dou Hao Jiang Xinyu Zhang Lei Chen Bo Zhao KELM 82 8 0 28 Feb 2022
A Simple but Effective Pluggable Entity Lookup Table for Pre-trained Language Models Deming Ye Yankai Lin Peng Li Maosong Sun Zhiyuan Liu KELM 55 11 0 27 Feb 2022
On the data requirements of probing Zining Zhu Jixuan Wang Bai Li Frank Rudzicz 71 5 0 25 Feb 2022
Prompt-Learning for Short Text Classification Yi Zhu Xinke Zhou Jipeng Qiang Yun Li Yunhao Yuan Xindong Wu VLM 79 36 0 23 Feb 2022
$$\mathcal{Y}$-Tuning: An Efficient Tuning Paradigm for Large-Scale Pre-Trained Models via Label Representation Learning$ $\mathcal{Y}$ -Tuning: An Efficient Tuning Paradigm for Large-Scale Pre-Trained Models via Label Representation Learning Yitao Liu Chen An Xipeng Qiu 93 18 0 20 Feb 2022
Contextual Semantic Embeddings for Ontology Subsumption Prediction Jiaoyan Chen Yuan He Yuxia Geng Ernesto Jiménez-Ruiz Hang Dong Ian Horrocks 106 55 0 20 Feb 2022
Synthetic Disinformation Attacks on Automated Fact Verification Systems Y. Du Antoine Bosselut Christopher D. Manning AAML OffRL 105 38 0 18 Feb 2022
'Beach' to 'Bitch': Inadvertent Unsafe Transcription of Kids' Content on YouTube Krithika Ramesh Ashiqur R. KhudaBukhsh Sumeet Kumar 57 5 0 17 Feb 2022
A Survey of Knowledge-Intensive NLP with Pre-Trained Language Models Da Yin Li Dong Hao Cheng Xiaodong Liu Kai-Wei Chang Furu Wei Jianfeng Gao KELM 86 34 0 17 Feb 2022
ZeroGen: Efficient Zero-shot Learning via Dataset Generation Jiacheng Ye Jiahui Gao Qintong Li Hang Xu Jiangtao Feng Zhiyong Wu Tao Yu Lingpeng Kong SyDa 148 222 0 16 Feb 2022
Impact of Pretraining Term Frequencies on Few-Shot Reasoning Yasaman Razeghi Robert L Logan IV Matt Gardner Sameer Singh ReLM LRM 126 157 0 15 Feb 2022
Transformer Memory as a Differentiable Search Index Yi Tay Vinh Q. Tran Mostafa Dehghani Jianmo Ni Dara Bahri ... Zhe Zhao Jai Gupta Tal Schuster William W. Cohen Donald Metzler 147 289 0 14 Feb 2022