v1v2 (latest)

Language Models as Knowledge Bases?

3 September 2019

Patrick Lewis

ArXiv (abs)PDF HTML Github (1382★)

Papers citing "Language Models as Knowledge Bases?"

50 / 1,722 papers shown

Title
Neural Knowledge Bank for Pretrained Transformers Damai Dai Wen-Jie Jiang Qingxiu Dong Yajuan Lyu Qiaoqiao She Zhifang Sui KELM 110 21 0 31 Jul 2022
Pro-tuning: Unified Prompt Tuning for Vision Tasks Xing Nie Bolin Ni Jianlong Chang Gaomeng Meng Chunlei Huo Zhaoxiang Zhang Shiming Xiang Qi Tian Chunhong Pan AAML VPVLM VLM 133 76 0 28 Jul 2022
Measuring Causal Effects of Data Statistics on Language Model's `Factual' Predictions Yanai Elazar Nora Kassner Shauli Ravfogel Amir Feder Abhilasha Ravichander Marius Mosbach Yonatan Belinkov Hinrich Schütze Yoav Goldberg CML SyDa MILM 110 55 0 28 Jul 2022
An Interpretability Evaluation Benchmark for Pre-trained Language Models Ya-Ming Shen Lijie Wang Ying-Cong Chen Xinyan Xiao Jing Liu Hua Wu 84 4 0 28 Jul 2022
HelixFold-Single: MSA-free Protein Structure Prediction by Using Protein Language Model as an Alternative Xiaomin Fang Fan Wang Lihang Liu Jingzhou He Dayong Lin Yingfei Xiang Xiaonan Zhang Hua Wu Hui Li Le Song 71 55 0 28 Jul 2022
LaKo: Knowledge-driven Visual Question Answering via Late Knowledge-to-Text Injection Zhuo Chen Yufen Huang Jiaoyan Chen Yuxia Geng Yin Fang Jeff Z. Pan Ningyu Zhang Wen Zhang 95 38 0 26 Jul 2022
Innovations in Neural Data-to-text Generation: A Survey Mandar Sharma Ajay K. Gogineni Naren Ramakrishnan 105 10 0 25 Jul 2022
A Transformer-based Neural Language Model that Synthesizes Brain Activation Maps from Free-Form Text Queries G. Ngo Minh Le Nguyen Nancy F. Chen M. Sabuncu MedIm 49 7 0 24 Jul 2022
No More Fine-Tuning? An Experimental Evaluation of Prompt Tuning in Code Intelligence Chaozheng Wang Yuanhang Yang Cuiyun Gao Yun Peng Hongyu Zhang Michael R. Lyu AAML 120 145 0 24 Jul 2022
Language models show human-like content effects on reasoning tasks Ishita Dasgupta Andrew Kyle Lampinen Stephanie C. Y. Chan Hannah R. Sheahan Antonia Creswell D. Kumaran James L. McClelland Felix Hill ReLM LRM 150 188 0 14 Jul 2022
Inner Monologue: Embodied Reasoning through Planning with Language Models Wenlong Huang F. Xia Ted Xiao Harris Chan Jacky Liang ... Tomas Jackson Linda Luu Sergey Levine Karol Hausman Brian Ichter LLMAG LM&Ro LRM 214 927 0 12 Jul 2022
CP3: Unifying Point Cloud Completion by Pretrain-Prompt-Predict Paradigm Mingye Xu Yali Wang Yihao Liu Tong He Yu Qiao 3DPC 95 17 0 12 Jul 2022
Improving the Faithfulness of Abstractive Summarization via Entity Coverage Control Haopeng Zhang Semih Yavuz Wojciech Kry'sciñski Kazuma Hashimoto Yingbo Zhou HILM 80 35 0 05 Jul 2022
Probing via Prompting Jiaoda Li Ryan Cotterell Mrinmaya Sachan 109 13 0 04 Jul 2022
VEM $^2$ L: A Plug-and-play Framework for Fusing Text and Structure Knowledge on Sparse Knowledge Graph Completion Tao He Ming Liu Haichao Zhu Tianwen Jiang Zihao Zheng Jingrun Zhang Sendong Zhao Bing Qin 80 1 0 04 Jul 2022
Memory-Based Label-Text Tuning for Few-Shot Class-Incremental Learning Jinze Li Yan Bai Yihang Lou Xiongkun Linghu Jianzhong He Shaoyun Xu Tao Bai VLM CLL 97 2 0 03 Jul 2022
FL-Tuning: Layer Tuning for Feed-Forward Network in Transformer Jingping Liu Yuqiu Song Kui Xue Hongli Sun Chao Wang Lihan Chen Haiyun Jiang Jiaqing Liang Tong Ruan 89 2 0 30 Jun 2022
BertNet: Harvesting Knowledge Graphs with Arbitrary Relations from Pretrained Language Models Shibo Hao Bowen Tan Kaiwen Tang Bin Ni Xiyan Shao Hengzhe Zhang Eric Xing Zhiting Hu 117 27 0 28 Jun 2022
Proton: Probing Schema Linking Information from Pre-trained Language Models for Text-to-SQL Parsing Lihan Wang Bowen Qin Binyuan Hui Bowen Li Min Yang Bailin Wang Binhua Li Fei Huang Luo Si Yongbin Li 135 44 0 28 Jun 2022
Few-Shot Fine-Grained Entity Typing with Automatic Label Interpretation and Instance Generation Jiaxin Huang Yu Meng Jiawei Han 78 20 0 28 Jun 2022
Few-Shot Stance Detection via Target-Aware Prompt Distillation Yan Jiang Jinhua Gao Huawei Shen Xueqi Cheng 87 27 0 27 Jun 2022
Endowing Language Models with Multimodal Knowledge Graph Representations Ningyuan Huang Y. Deshpande Yibo Liu Houda Alberts Kyunghyun Cho Clara Vania Iacer Calixto VLM 72 16 0 27 Jun 2022
OPERA: Harmonizing Task-Oriented Dialogs and Information Seeking Experience Miaoran Li Baolin Peng Jianfeng Gao Zhu Zhang 128 10 0 24 Jun 2022
TOKEN is a MASK: Few-shot Named Entity Recognition with Pre-trained Language Models A. Davody David Ifeoluwa Adelani Thomas Kleinbauer Dietrich Klakow 75 4 0 15 Jun 2022
CoSe-Co: Text Conditioned Generative CommonSense Contextualizer Rachit Bansal Milan Aggarwal S. Bhatia Jivat Neet Kaur Balaji Krishnamurthy 43 4 0 12 Jun 2022
Improving Pre-trained Language Model Fine-tuning with Noise Stability Regularization Hang Hua Xingjian Li Dejing Dou Chengzhong Xu Jiebo Luo 94 15 0 12 Jun 2022
DynaMaR: Dynamic Prompt with Mask Token Representation Xiaodi Sun Sunny Rajagopalan Priyank Nigam Weiyi Lu Yi Xu Belinda Zeng Trishul Chilimbi 47 1 0 07 Jun 2022
Instance-wise Prompt Tuning for Pretrained Language Models Yuezihan Jiang Hao Yang Junyang Lin Hanyu Zhao An Yang Chang Zhou Hongxia Yang Zhi-Xin Yang Tengjiao Wang VLM 65 7 0 04 Jun 2022
Acquiring and Modelling Abstract Commonsense Knowledge via Conceptualization Mutian He Tianqing Fang Weiqi Wang Yangqiu Song 94 30 0 03 Jun 2022
Prefix Conditioning Unifies Language and Label Supervision Kuniaki Saito Kihyuk Sohn Xinming Zhang Chun-Liang Li Chen-Yu Lee Kate Saenko Tomas Pfister VLM CLIP 99 16 0 02 Jun 2022
Neural Retriever and Go Beyond: A Thesis Proposal Man Luo 109 1 0 31 May 2022
kNN-Prompt: Nearest Neighbor Zero-Shot Inference Weijia Shi Julian Michael Suchin Gururangan Luke Zettlemoyer RALM VLM 90 32 0 27 May 2022
Detecting Label Errors by using Pre-Trained Language Models Derek Chong Jenny Hong Christopher D. Manning NoLa 122 22 0 25 May 2022
Eliciting and Understanding Cross-Task Skills with Task-Level Mixture-of-Experts Qinyuan Ye Juan Zha Xiang Ren MoE 90 14 0 25 May 2022
Language Anisotropic Cross-Lingual Model Editing Yang Xu Yutai Hou Wanxiang Che Min Zhang KELM 159 28 0 25 May 2022
Are Large Pre-Trained Language Models Leaking Your Personal Information? Jie Huang Hanyin Shao Kevin Chen-Chuan Chang PILM 139 204 0 25 May 2022
ORCA: Interpreting Prompted Language Models via Locating Supporting Data Evidence in the Ocean of Pretraining Data Xiaochuang Han Yulia Tsvetkov 99 31 0 25 May 2022
RLPrompt: Optimizing Discrete Text Prompts with Reinforcement Learning Mingkai Deng Jianyu Wang Cheng-Ping Hsieh Yihan Wang Han Guo Tianmin Shu Meng Song Eric Xing Zhiting Hu 99 345 0 25 May 2022
History Compression via Language Models in Reinforcement Learning Fabian Paischer Thomas Adler Vihang Patil Angela Bitto-Nemling Markus Holzleitner Sebastian Lehner Hamid Eghbalzadeh Sepp Hochreiter OffRL AI4TS 123 46 0 24 May 2022
GeoMLAMA: Geo-Diverse Commonsense Probing on Multilingual Pre-Trained Language Models Da Yin Hritik Bansal Masoud Monajatipoor Liunian Harold Li Kai-Wei Chang 99 31 0 24 May 2022
The Curious Case of Control Elias Stengel-Eskin Benjamin Van Durme 37 0 0 24 May 2022
On Advances in Text Generation from Images Beyond Captioning: A Case Study in Self-Rationalization Shruti Palaskar Akshita Bhagia Yonatan Bisk Florian Metze A. Black Ana Marasović 90 4 0 24 May 2022
Penguins Don't Fly: Reasoning about Generics through Instantiations and Exceptions Emily Allaway Jena D. Hwang Chandra Bhagavatula Kathleen McKeown Doug Downey Yejin Choi LRM 84 20 0 23 May 2022
Prompt-and-Rerank: A Method for Zero-Shot and Few-Shot Arbitrary Textual Style Transfer with Small Language Models Mirac Suzgun Luke Melas-Kyriazi Dan Jurafsky VLM 137 67 0 23 May 2022
Towards Tracing Factual Knowledge in Language Models Back to the Training Data Ekin Akyürek Tolga Bolukbasi Frederick Liu Binbin Xiong Ian Tenney Jacob Andreas Kelvin Guu HILM 67 12 0 23 May 2022
PEVL: Position-enhanced Pre-training and Prompt Tuning for Vision-language Models Yuan Yao Qi-An Chen Ao Zhang Wei Ji Zhiyuan Liu Tat-Seng Chua Maosong Sun VLM MLLM 100 38 0 23 May 2022
Prompt Tuning for Discriminative Pre-trained Language Models Yuan Yao Bowen Dong Ao Zhang Zhengyan Zhang Ruobing Xie Zhiyuan Liu Leyu Lin Maosong Sun Jianyong Wang VLM 85 34 0 23 May 2022
Commonsense Knowledge Salience Evaluation with a Benchmark Dataset in E-commerce Yincen Qu Ningyu Zhang Hui Chen Zelin Dai Zezhong Xu Chengming Wang Xiaoyu Wang Qianglin Chen Huajun Chen 90 7 0 22 May 2022
Instruction Induction: From Few Examples to Natural Language Task Descriptions Or Honovich Uri Shaham Samuel R. Bowman Omer Levy ELM LRM 286 146 0 22 May 2022
Memorization Without Overfitting: Analyzing the Training Dynamics of Large Language Models Kushal Tirumala Aram H. Markosyan Luke Zettlemoyer Armen Aghajanyan TDI 138 197 0 22 May 2022