How Can We Know What Language Models Know?

28 November 2019

Graham Neubig

Papers citing "How Can We Know What Language Models Know?"

50 / 301 papers shown

Title
Pre-training Language Models with Deterministic Factual Knowledge Shaobo Li Xiaoguang Li Lifeng Shang Chengjie Sun Bingquan Liu Zhenzhou Ji Xin Jiang Qun Liu KELM 47 11 0 20 Oct 2022
Transparency Helps Reveal When Language Models Learn Meaning Zhaofeng Wu William Merrill Hao Peng Iz Beltagy Noah A. Smith 19 9 0 14 Oct 2022
Mass-Editing Memory in a Transformer Kevin Meng Arnab Sen Sharma A. Andonian Yonatan Belinkov David Bau KELM VLM 59 531 0 13 Oct 2022
On the Explainability of Natural Language Processing Deep Models Julia El Zini M. Awad 29 82 0 13 Oct 2022
Language Models Are Poor Learners of Directional Inference Tianyi Li Mohammad Javad Hosseini Sabine Weber Mark Steedman 26 10 0 10 Oct 2022
Few-Shot Anaphora Resolution in Scientific Protocols via Mixtures of In-Context Experts Nghia T. Le Fan Bai Alan Ritter 40 12 0 07 Oct 2022
Understanding Transformer Memorization Recall Through Idioms Adi Haviv Ido Cohen Jacob Gidron R. Schuster Yoav Goldberg Mor Geva 28 48 0 07 Oct 2022
Calibrating Factual Knowledge in Pretrained Language Models Qingxiu Dong Damai Dai Yifan Song Jingjing Xu Zhifang Sui Lei Li KELM 249 83 0 07 Oct 2022
State-of-the-art generalisation research in NLP: A taxonomy and review Dieuwke Hupkes Mario Giulianelli Verna Dankers Mikel Artetxe Yanai Elazar ... Leila Khalatbari Maria Ryskina Rita Frieske Ryan Cotterell Zhijing Jin 129 95 0 06 Oct 2022
Ask Me Anything: A simple strategy for prompting language models Simran Arora A. Narayan Mayee F. Chen Laurel J. Orr Neel Guha Kush S. Bhatia Ines Chami Frederic Sala Christopher Ré ReLM LRM 235 208 0 05 Oct 2022
PLOT: Prompt Learning with Optimal Transport for Vision-Language Models Guangyi Chen Weiran Yao Xiangchen Song Xinyue Li Yongming Rao Kun Zhang VPVLM VLM 8 62 0 03 Oct 2022
Automatic Label Sequence Generation for Prompting Sequence-to-sequence Models Zichun Yu Tianyu Gao Zhengyan Zhang Yankai Lin Zhiyuan Liu Maosong Sun Jie Zhou VLM LRM 38 1 0 20 Sep 2022
VIPHY: Probing "Visible" Physical Commonsense Knowledge Shikhar Singh Ehsan Qasemi Muhao Chen 46 6 0 15 Sep 2022
Visual Prompting via Image Inpainting Amir Bar Yossi Gandelsman Trevor Darrell Amir Globerson Alexei A. Efros VLM VPVLM 29 203 0 01 Sep 2022
Why Do Neural Language Models Still Need Commonsense Knowledge to Handle Semantic Variations in Question Answering? Sunjae Kwon Cheongwoong Kang Jiyeon Han Jaesik Choi 29 0 0 01 Sep 2022
Continuous QA Learning with Structured Prompts Yinhe Zheng CLL 33 1 0 31 Aug 2022
Prompt Tuning with Soft Context Sharing for Vision-Language Models Kun Ding Ying Wang Pengzhang Liu Qiang Yu Hao Zhang Shiming Xiang Chunhong Pan VPVLM VLM 29 14 0 29 Aug 2022
Prompting as Probing: Using Language Models for Knowledge Base Construction Dimitrios Alivanistos Selene Báez Santamaría Michael Cochez Jan-Christoph Kalo Emile van Krieken Thiviyan Thanapalasingam KELM 25 45 0 23 Aug 2022
A Survey on Open Information Extraction from Rule-based Model to Large Language Model Pai Liu Wenya Gao Wenjie Dong Lin Ai Wen Dong Songfang Huang Zongsheng Li Ehsan Hoque Julia Hirschberg Yue Zhang 47 2 0 18 Aug 2022
ELECTRA is a Zero-Shot Learner, Too Shiwen Ni Hung-Yu kao 30 9 0 17 Jul 2022
Probing via Prompting Jiaoda Li Ryan Cotterell Mrinmaya Sachan 37 13 0 04 Jul 2022
Towards Unified Conversational Recommender Systems via Knowledge-Enhanced Prompt Learning Xiaolei Wang Kun Zhou Ji-Rong Wen Wayne Xin Zhao HAI AI4TS 41 131 0 19 Jun 2022
Bridging the Gap Between Training and Inference of Bayesian Controllable Language Models Han Liu Bingning Wang Ting Yao Haijin Liang Jianjin Xu Xiaolin Hu BDL 40 1 0 11 Jun 2022
Are Large Pre-Trained Language Models Leaking Your Personal Information? Jie Huang Hanyin Shao Kevin Chen-Chuan Chang PILM 22 178 0 25 May 2022
GeoMLAMA: Geo-Diverse Commonsense Probing on Multilingual Pre-Trained Language Models Da Yin Hritik Bansal Masoud Monajatipoor Liunian Harold Li Kai-Wei Chang 49 28 0 24 May 2022
The Curious Case of Control Elias Stengel-Eskin Benjamin Van Durme 27 0 0 24 May 2022
BBTv2: Towards a Gradient-Free Future with Large Language Models Tianxiang Sun Zhengfu He Hong Qian Yunhua Zhou Xuanjing Huang Xipeng Qiu 108 53 0 23 May 2022
Few-Shot Natural Language Inference Generation with PDD: Prompt and Dynamic Demonstration Kaijian Li Shansan Gong Kenny Q. Zhu 27 0 0 21 May 2022
Prototypical Calibration for Few-shot Learning of Language Models Zhixiong Han Y. Hao Li Dong Yutao Sun Furu Wei 178 54 0 20 May 2022
PromptDA: Label-guided Data Augmentation for Prompt-based Few-shot Learners Canyu Chen Kai Shu VLM 31 8 0 18 May 2022
LogicSolver: Towards Interpretable Math Word Problem Solving with Logical Prompt-enhanced Learning Zhicheng YANG Jinghui Qin Jiaqi Chen Liang Lin Xiaodan Liang ReLM LRM 35 31 0 17 May 2022
Adaptive Prompt Learning-based Few-Shot Sentiment Analysis Pengfei Zhang Tingting Chai Yongdong Xu VLM 21 13 0 15 May 2022
A Comprehensive Survey of Few-shot Learning: Evolution, Applications, Challenges, and Opportunities Yisheng Song Ting-Yuan Wang S. Mondal J. P. Sahoo SLR 54 345 0 13 May 2022
Odor Descriptor Understanding through Prompting Laura Sisson 8 1 0 07 May 2022
Language Models in the Loop: Incorporating Prompting into Weak Supervision Ryan Smith Jason Alan Fries Braden Hancock Stephen H. Bach 53 53 0 04 May 2022
Lexical Knowledge Internalization for Neural Dialog Generation Zhiyong Wu Wei Bi Xiang Li Lingpeng Kong B. Kao 21 2 0 04 May 2022
Prompt Consistency for Zero-Shot Task Generalization Chunting Zhou Junxian He Xuezhe Ma Taylor Berg-Kirkpatrick Graham Neubig VLM 26 74 0 29 Apr 2022
Probing Simile Knowledge from Pre-trained Language Models Weijie Chen Yongzhu Chang Rongsheng Zhang Jiashu Pu Guandan Chen Le Zhang Yadong Xi Yijiang Chen Chang Su 24 11 0 27 Apr 2022
Natural Language to Code Translation with Execution Freda Shi Daniel Fried Marjan Ghazvininejad Luke Zettlemoyer Sida I. Wang 38 124 0 25 Apr 2022
Decorate the Examples: A Simple Method of Prompt Design for Biomedical Relation Extraction Hui-Syuan Yeh Thomas Lavergne Pierre Zweigenbaum 21 10 0 21 Apr 2022
Polling Latent Opinions: A Method for Computational Sociolinguistics Using Transformer Language Models Philip G. Feldman Aaron Dant James R. Foulds Shimei Pan 20 3 0 15 Apr 2022
Incremental Prompting: Episodic Memory Prompt for Lifelong Event Detection Minqian Liu Shiyu Chang Lifu Huang KELM CLL 22 29 0 15 Apr 2022
Automatic Multi-Label Prompting: Simple and Interpretable Few-Shot Classification Han Wang Canwen Xu Julian McAuley VLM 26 12 0 13 Apr 2022
PSP: Pre-trained Soft Prompts for Few-Shot Abstractive Summarization Xiaochen Liu Yang Gao Yu Bai Jiawei Li Yinan Hu Yang Gao Boxing Chen 40 22 0 09 Apr 2022
Show, Don't Tell: Demonstrations Outperform Descriptions for Schema-Guided Task-Oriented Dialogue Raghav Gupta Harrison Lee Jeffrey Zhao Abhinav Rastogi Yuan Cao Yonghui Wu 35 24 0 08 Apr 2022
Unsupervised Prompt Learning for Vision-Language Models Hao Huang Jack Chu Fangyun Wei VPVLM MLLM VLM 38 132 0 07 Apr 2022
Match-Prompt: Improving Multi-task Generalization Ability for Neural Text Matching via Prompt Learning Shicheng Xu Liang Pang Huawei Shen Xueqi Cheng VLM 37 17 0 06 Apr 2022
PERFECT: Prompt-free and Efficient Few-shot Learning with Language Models Rabeeh Karimi Mahabadi Luke Zettlemoyer James Henderson Marzieh Saeidi Lambert Mathias Ves Stoyanov Majid Yazdani VLM 34 70 0 03 Apr 2022
Inverse is Better! Fast and Accurate Prompt for Few-shot Slot Tagging Yutai Hou Cheng Chen Xianzhen Luo Bo-wen Li Wanxiang Che BDL 24 21 0 02 Apr 2022
How Pre-trained Language Models Capture Factual Knowledge? A Causal-Inspired Analysis Shaobo Li Xiaoguang Li Lifeng Shang Zhenhua Dong Chengjie Sun Bingquan Liu Zhenzhou Ji Xin Jiang Qun Liu KELM 34 53 0 31 Mar 2022