How Can We Know What Language Models Know?

28 November 2019

Graham Neubig

Papers citing "How Can We Know What Language Models Know?"

50 / 301 papers shown

Title
CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Society Ge Li Hasan Hammoud Hani Itani Dmitrii Khizbullin Guohao Li SyDa ALM 50 413 0 31 Mar 2023
PromptORE -- A Novel Approach Towards Fully Unsupervised Relation Extraction Pierre-Yves Genest Pierre-Edouard Portier Elöd Egyed-Zsigmond L. Goix LRM 22 12 0 24 Mar 2023
Visually-Prompted Language Model for Fine-Grained Scene Graph Generation in an Open World Qifan Yu Juncheng Li Yuehua Wu Siliang Tang Wei Ji Yueting Zhuang 30 34 0 23 Mar 2023
Exploring Structured Semantic Prior for Multi Label Recognition with Incomplete Labels Zixuan Ding Ao Wang Hui Chen Qiaosheng Zhang Pengzhang Liu Yongjun Bao Weipeng P. Yan Jungong Han 24 27 0 23 Mar 2023
Language Model Behavior: A Comprehensive Survey Tyler A. Chang Benjamin Bergen VLM LRM LM&MA 27 103 0 20 Mar 2023
Diversity-Aware Meta Visual Prompting Qidong Huang Xiaoyi Dong Dongdong Chen Weiming Zhang Feifei Wang Gang Hua Neng H. Yu VLM VPVLM 41 52 0 14 Mar 2023
Rethinking Visual Prompt Learning as Masked Visual Token Modeling Ning Liao Bowen Shi Xiaopeng Zhang Min Cao Junchi Yan Qi Tian VLM 34 7 0 09 Mar 2023
Class Cardinality Comparison as a Fermi Problem Shrestha Ghosh Simon Razniewski Gerhard Weikum 47 2 0 08 Mar 2023
The Contribution of Knowledge in Visiolinguistic Learning: A Survey on Tasks and Challenges Maria Lymperaiou Giorgos Stamou VLM 32 4 0 04 Mar 2023
Dynamic Benchmarking of Masked Language Models on Temporal Concept Drift with Multiple Views Katerina Margatina Shuai Wang Yogarshi Vyas Neha Ann John Yassine Benajiba Miguel Ballesteros 17 15 0 23 Feb 2023
Active Prompting with Chain-of-Thought for Large Language Models Shizhe Diao Pengcheng Wang Yong Lin Tong Zhang ReLM KELM LLMAG LRM 31 122 0 23 Feb 2023
Can discrete information extraction prompts generalize across language models? Nathanaël Carraz Rakotonirina Roberto Dessì Fabio Petroni Sebastian Riedel Marco Baroni 31 7 0 20 Feb 2023
RePrompt: Automatic Prompt Editing to Refine AI-Generative Art Towards Precise Expressions Yunlong Wang Shuyuan Shen Brian Y. Lim 41 88 0 19 Feb 2023
LabelPrompt: Effective Prompt-based Learning for Relation Classification Wenbo Zhang Xiaoning Song Zhenhua Feng Tianyang Xu Xiaojun Wu VLM 35 4 0 16 Feb 2023
Toolformer: Language Models Can Teach Themselves to Use Tools Timo Schick Jane Dwivedi-Yu Roberto Dessì Roberta Raileanu Maria Lomeli Luke Zettlemoyer Nicola Cancedda Thomas Scialom SyDa RALM 43 1,608 0 09 Feb 2023
Controlling for Stereotypes in Multimodal Language Model Evaluation Manuj Malik Richard Johansson 23 1 0 03 Feb 2023
The Exploration of Knowledge-Preserving Prompts for Document Summarisation Cheng Chen Wei Emma Zhang A. Shakeri Makhmoor Fiza KELM 35 0 0 27 Jan 2023
Probing Out-of-Distribution Robustness of Language Models with Parameter-Efficient Transfer Learning Hyunsoo Cho Choonghyun Park Junyeop Kim Hyuhng Joon Kim Kang Min Yoo Sang-goo Lee OODD 35 3 0 27 Jan 2023
Understanding Finetuning for Factual Knowledge Extraction from Language Models Mehran Kazemi Sid Mittal Deepak Ramachandran KELM 34 10 0 26 Jan 2023
Batch Prompting: Efficient Inference with Large Language Model APIs Zhoujun Cheng Jungo Kasai Tao Yu LRM 19 72 0 19 Jan 2023
Multimodality Helps Unimodality: Cross-Modal Few-Shot Learning with Multimodal Models Zhiqiu Lin Samuel Yu Zhiyi Kuang Deepak Pathak Deva Ramana VLM 20 100 0 16 Jan 2023
Counteracts: Testing Stereotypical Representation in Pre-trained Language Models Damin Zhang Julia Taylor Rayz Romila Pradhan 42 2 0 11 Jan 2023
Self-Adaptive In-Context Learning: An Information Compression Perspective for In-Context Example Selection and Ordering Zhiyong Wu Yaoxiang Wang Jiacheng Ye Lingpeng Kong 41 119 0 20 Dec 2022
DSI++: Updating Transformer Memory with New Documents Sanket Vaibhav Mehta Jai Gupta Yi Tay Mostafa Dehghani Vinh Q. Tran J. Rao Marc Najork Emma Strubell Donald Metzler CLL 32 39 0 19 Dec 2022
Reasoning with Language Model Prompting: A Survey Shuofei Qiao Yixin Ou Ningyu Zhang Xiang Chen Yunzhi Yao Shumin Deng Chuanqi Tan Fei Huang Huajun Chen ReLM ELM LRM 71 311 0 19 Dec 2022
Evaluating Step-by-Step Reasoning through Symbolic Verification Yi-Fan Zhang Hanlin Zhang Li Erran Li Eric P. Xing ReLM LRM 19 8 0 16 Dec 2022
Technical Report -- Competition Solution for Prompt Tuning using Pretrained Language Model Jiang-Long Song Wuhe Zou Feng Li Xiaolei Qin Weidong Zhang 34 0 0 13 Dec 2022
Controllable Image Captioning via Prompting Ning Wang Jiahao Xie Jihao Wu Mingbo Jia Linlin Li 22 23 0 04 Dec 2022
Extensible Prompts for Language Models on Zero-shot Language Style Customization Tao Ge Jing Hu Li Dong Shaoguang Mao Yanqiu Xia Xun Wang Si-Qing Chen Furu Wei VLM 46 6 0 01 Dec 2022
Few-shot Query-Focused Summarization with Prefix-Merging Ruifeng Yuan Zili Wang Ziqiang Cao Wenjie Li 29 7 0 29 Nov 2022
TSGP: Two-Stage Generative Prompting for Unsupervised Commonsense Question Answering Yueqing Sun Yu Zhang Le Qi Qi Shi ReLM RALM LRM 21 5 0 24 Nov 2022
AutoReply: Detecting Nonsense in Dialogue Introspectively with Discriminative Replies Weiyan Shi Emily Dinan Adithya Renduchintala Daniel Fried Athul Paul Jacob Zhou Yu M. Lewis AAML 32 2 0 22 Nov 2022
TEMPERA: Test-Time Prompting via Reinforcement Learning Tianjun Zhang Xuezhi Wang Denny Zhou Dale Schuurmans Joseph E. Gonzalez VLM 28 36 0 21 Nov 2022
Validating Large Language Models with ReLM Michael Kuchnik Virginia Smith George Amvrosiadis 36 27 0 21 Nov 2022
TCBERT: A Technical Report for Chinese Topic Classification BERT Ting Han Kunhao Pan Xinyu Chen Dingjie Song Yuchen Fan Xinyu Gao Ruyi Gan Jiaxing Zhang VLM 25 1 0 21 Nov 2022
Language in a Bottle: Language Model Guided Concept Bottlenecks for Interpretable Image Classification Yue Yang Artemis Panagopoulou Shenghao Zhou Daniel Jin Chris Callison-Burch Mark Yatskar 54 214 0 21 Nov 2022
Knowledge Graph Generation From Text Igor Melnyk Pierre Dognin Payel Das 24 23 0 18 Nov 2022
Context Variance Evaluation of Pretrained Language Models for Prompt-based Biomedical Knowledge Probing Zonghai Yao Yi Cao Zhichao Yang Hong-ye Yu 27 17 0 18 Nov 2022
Finding Skill Neurons in Pre-trained Transformer-based Language Models Xiaozhi Wang Kaiyue Wen Zhengyan Zhang Lei Hou Zhiyuan Liu Juanzi Li MILM MoE 27 51 0 14 Nov 2022
SPE: Symmetrical Prompt Enhancement for Fact Probing Yiyuan Li Tong Che Yezhen Wang Zhengbao Jiang Caiming Xiong Snigdha Chaturvedi 34 6 0 14 Nov 2022
Measuring Reliability of Large Language Models through Semantic Consistency Harsh Raj Domenic Rosati S. Majumdar HILM 24 30 0 10 Nov 2022
COPEN: Probing Conceptual Knowledge in Pre-trained Language Models Hao Peng Xiaozhi Wang Shengding Hu Hailong Jin Lei Hou Juanzi Li Zhiyuan Liu Qun Liu 18 22 0 08 Nov 2022
Prompter: Utilizing Large Language Model Prompting for a Data Efficient Embodied Instruction Following Y. Inoue Hiroki Ohashi LM&Ro 30 44 0 07 Nov 2022
Large Language Models Are Human-Level Prompt Engineers Yongchao Zhou Andrei Ioan Muresanu Ziwen Han Keiran Paster Silviu Pitis Harris Chan Jimmy Ba ALM LLMAG 21 835 0 03 Nov 2022
STPrompt: Semantic-guided and Task-driven prompts for Effective Few-shot Classification Jinta Weng Yue Hu Jing Qiu Heyan Huan VLM 19 0 0 29 Oct 2022
Piloting Copilot and Codex: Hot Temperature, Cold Prompts, or Black Magic? Jean-Baptiste Döderlein M. Acher D. Khelladi B. Combemale 34 34 0 26 Oct 2022
Inducer-tuning: Connecting Prefix-tuning and Adapter-tuning Yifan Chen Devamanyu Hazarika Mahdi Namazifar Yang Liu Di Jin Dilek Z. Hakkani-Tür 29 3 0 26 Oct 2022
Do Language Models Understand Measurements? Sungjin Park Seung-kook Ryu Edward Choi ReLM LRM 57 4 0 23 Oct 2022
ProGen: Progressive Zero-shot Dataset Generation via In-context Feedback Jiacheng Ye Jiahui Gao Jiangtao Feng Zhiyong Wu Tao Yu Lingpeng Kong SyDa VLM 81 72 0 22 Oct 2022
Enhancing Tabular Reasoning with Pattern Exploiting Training Abhilash Shankarampeta Vivek Gupta Shuo Zhang LMTD RALM ReLM 68 6 0 21 Oct 2022