v1v2 (latest)

Factual Probing Is [MASK]: Learning vs. Learning to Recall

12 April 2021

Papers citing "Factual Probing Is [MASK]: Learning vs. Learning to Recall"

50 / 274 papers shown

Title
LISA: Layerwise Importance Sampling for Memory-Efficient Large Language Model Fine-Tuning Boyao Wang Xiang Liu Shizhe Diao Renjie Pi Jipeng Zhang Chi Han Tong Zhang 106 55 0 26 Mar 2024
Compositional Kronecker Context Optimization for Vision-Language Models Kun Ding Xiaohui Li Qiang Yu Ying Wang Haojian Zhang Shiming Xiang VLM 79 0 0 18 Mar 2024
Monotonic Representation of Numeric Properties in Language Models Benjamin Heinzerling Kentaro Inui KELM MILM 110 10 0 15 Mar 2024
Take Care of Your Prompt Bias! Investigating and Mitigating Prompt Bias in Factual Knowledge Extraction Ziyang Xu Keqin Peng Liang Ding Dacheng Tao Xiliang Lu 74 10 0 15 Mar 2024
PNeSM: Arbitrary 3D Scene Stylization via Prompt-Based Neural Style Mapping Jiafu Chen Wei Xing Jiakai Sun Tianyi Chu Yiling Huang Boyan Ji Lei Zhao Huaizhong Lin Haibo Chen Zhizhong Wang 87 1 0 13 Mar 2024
KnowledgeVIS: Interpreting Language Models by Comparing Fill-in-the-Blank Prompts Adam Joseph Coscia Alex Endert VLM 75 9 0 07 Mar 2024
FairBelief -- Assessing Harmful Beliefs in Language Models Mattia Setzu Marta Marchiori Manerba Pasquale Minervini Debora Nozza 62 0 0 27 Feb 2024
Parameter-efficient Prompt Learning for 3D Point Cloud Understanding Hongyu Sun Yongcai Wang Wang Chen Haoran Deng Deying Li VPVLM 105 7 0 24 Feb 2024
MemoryPrompt: A Light Wrapper to Improve Context Tracking in Pre-trained Language Models Nathanaël Carraz Rakotonirina Marco Baroni VLM KELM 37 1 0 23 Feb 2024
PromptKD: Distilling Student-Friendly Knowledge for Generative Language Models via Prompt Tuning Gyeongman Kim Doohyuk Jang Eunho Yang VLM 110 13 0 20 Feb 2024
FIPO: Free-form Instruction-oriented Prompt Optimization with Preference Dataset and Modular Fine-tuning Schema Junru Lu Siyu An Min Zhang Yulan He Di Yin Xing Sun 127 2 0 19 Feb 2024
TuneTables: Context Optimization for Scalable Prior-Data Fitted Networks Ben Feuer R. Schirrmeister Valeriia Cherepanova Chinmay Hegde Frank Hutter Micah Goldblum Niv Cohen Colin White 99 19 0 17 Feb 2024
Efficient Prompt Optimization Through the Lens of Best Arm Identification Chengshuai Shi Kun Yang Zihan Chen Jundong Li Jing Yang Cong Shen 93 10 0 15 Feb 2024
Summing Up the Facts: Additive Mechanisms Behind Factual Recall in LLMs Bilal Chughtai Alan Cooney Neel Nanda HILM KELM 72 20 0 11 Feb 2024
Exploring Low-Resource Medical Image Classification with Weakly Supervised Prompt Learning Fudan Zheng Jindong Cao Weijiang Yu Zhiguang Chen Nong Xiao Yutong Lu VLM MedIm 53 20 0 06 Feb 2024
PAP-REC: Personalized Automatic Prompt for Recommendation Language Model Zelong Li Jianchao Ji Yingqiang Ge Wenyue Hua Yongfeng Zhang 64 6 0 01 Feb 2024
Comparing Template-based and Template-free Language Model Probing Sagi Shaier Kevin Bennett Lawrence E Hunter Katharina von der Wense ELM 96 4 0 31 Jan 2024
Desiderata for the Context Use of Question Answering Systems Sagi Shaier Lawrence E Hunter Katharina von der Wense 123 5 0 31 Jan 2024
Learnable Prompt as Pseudo-Imputation: Rethinking the Necessity of Traditional EHR Data Imputation in Downstream Clinical Prediction Weibin Liao Yinghao Zhu Zixiang Wang Xu Chu Yasha Wang Liantao Ma Yasha Wang Liantao Ma 67 0 0 30 Jan 2024
How Proficient Are Large Language Models in Formal Languages? An In-Depth Insight for Knowledge Base Question Answering Jinxi Liu S. Cao Jiaxin Shi Tingjian Zhang Lunyiu Nie Linmei Hu Lei Hou Juanzi Li ELM 67 4 0 11 Jan 2024
Learning to Prompt Segment Anything Models Jiaxing Huang Kai Jiang Jingyi Zhang Han Qiu Lewei Lu Shijian Lu Eric Xing VLM LRM 98 7 0 09 Jan 2024
A Comprehensive Study of Knowledge Editing for Large Language Models Ningyu Zhang Yunzhi Yao Bo Tian Peng Wang Shumin Deng ... Lei Liang Qing Cui Xiao-Jun Zhu Jun Zhou Huajun Chen KELM 166 88 0 02 Jan 2024
Prompt Valuation Based on Shapley Values Hanxi Liu Xiaokai Mao Haocheng Xia Jian Lou Jinfei Liu 66 7 0 24 Dec 2023
A Closer Look at the Few-Shot Adaptation of Large Vision-Language Models Julio Silva-Rodríguez Sina Hajimiri Ismail Ben Ayed Jose Dolz VLM 71 34 0 20 Dec 2023
UniDCP: Unifying Multiple Medical Vision-language Tasks via Dynamic Cross-modal Learnable Prompts Chenlu Zhan Yufei Zhang Yu Lin Gaoang Wang Hongwei Wang VLM MedIm 87 5 0 18 Dec 2023
The Earth is Flat because...: Investigating LLMs' Belief towards Misinformation via Persuasive Conversation Rongwu Xu Brian S. Lin Shujian Yang Tianqi Zhang Weiyan Shi Tianwei Zhang Zhixuan Fang Wei Xu Han Qiu 162 61 0 14 Dec 2023
Helping Language Models Learn More: Multi-dimensional Task Prompt for Few-shot Tuning Jinta Weng Jiarui Zhang Yue Hu Daidong Fa Xiaofeng Xu Heyan Huang 52 1 0 13 Dec 2023
Beyond Sole Strength: Customized Ensembles for Generalized Vision-Language Models Zhihe Lu Jiawang Bai Xin Li Zeyu Xiao Xinchao Wang VLM 76 12 0 28 Nov 2023
BadCLIP: Trigger-Aware Prompt Learning for Backdoor Attacks on CLIP Jiawang Bai Kuofeng Gao Shaobo Min Shu-Tao Xia Zhifeng Li Wei Liu VLM 122 45 0 26 Nov 2023
Active Prompt Learning in Vision Language Models Jihwan Bang Sumyeong Ahn Jae-Gil Lee VLM 66 14 0 18 Nov 2023
Plum: Prompt Learning using Metaheuristic Boyao Wang Shuo Xing Shizhe Diao Wenhe Sun Xiang Liu Kashun Shum Renjie Pi Jipeng Zhang Tong Zhang VLM OffRL LRM 80 6 0 14 Nov 2023
Simple and Effective Input Reformulations for Translation Brian Yu Hansen Lillemark Kurt Keutzer 69 0 0 12 Nov 2023
A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questions Lei Huang Weijiang Yu Weitao Ma Weihong Zhong Zhangyin Feng ... Qianglong Chen Weihua Peng Xiaocheng Feng Bing Qin Ting Liu LRM HILM 142 939 0 09 Nov 2023
Test-time Augmentation for Factual Probing Go Kamoda Benjamin Heinzerling Keisuke Sakaguchi Kentaro Inui 25 1 0 26 Oct 2023
Give Me the Facts! A Survey on Factual Knowledge Probing in Pre-trained Language Models Paul Youssef Osman Alperen Koracs Meijie Li Jorg Schlotterer Christin Seifert KELM 81 19 0 25 Oct 2023
Unnatural language processing: How do language models handle machine-generated prompts? Corentin Kervadec Francesca Franzon Marco Baroni 61 5 0 24 Oct 2023
A Communication Theory Perspective on Prompting Engineering Methods for Large Language Models Yuanfeng Song Yuanqin He Xuefang Zhao Hanlin Gu Di Jiang Haijun Yang Lixin Fan Qiang Yang 76 6 0 24 Oct 2023
Document-Level In-Context Few-Shot Relation Extraction via Pre-Trained Language Models Yilmazcan Ozyurt Stefan Feuerriegel Ce Zhang 123 1 0 17 Oct 2023
Impact of Co-occurrence on Factual Knowledge of Large Language Models Cheongwoong Kang Jaesik Choi KELM 91 18 0 12 Oct 2023
GeoLLM: Extracting Geospatial Knowledge from Large Language Models Rohin Manvi Samar Khanna Gengchen Mai Marshall Burke David B. Lobell Stefano Ermon 70 55 0 10 Oct 2023
On the Evolution of Knowledge Graphs: A Survey and Perspective Xuhui Jiang Chengjin Xu Yinghan Shen Xun Sun Lumingyuan Tang Saizhuo Wang Zhongwu Chen Yuanzhuo Wang Jian Guo 152 9 0 07 Oct 2023
Efficient Federated Prompt Tuning for Black-box Large Pre-trained Models Zihao Lin Yan Sun Yifan Shi Xueqian Wang Lifu Huang Li Shen Dacheng Tao 98 12 0 04 Oct 2023
Discovering Knowledge-Critical Subnetworks in Pretrained Language Models Deniz Bayazit Negar Foroutan Zeming Chen Gail Weiss Antoine Bosselut KELM 105 16 0 04 Oct 2023
Think before you speak: Training Language Models With Pause Tokens Sachin Goyal Ziwei Ji A. S. Rawat A. Menon Sanjiv Kumar Vaishnavh Nagarajan LRM 111 122 0 03 Oct 2023
Zero-Shot Continuous Prompt Transfer: Generalizing Task Semantics Across Language Models Zijun Wu Yongkang Wu Lili Mou VLM 79 5 0 02 Oct 2023
FedBPT: Efficient Federated Black-box Prompt Tuning for Large Language Models Jingwei Sun Ziyue Xu Hongxu Yin Dong Yang Daguang Xu Yiran Chen Holger R. Roth VLM 144 26 0 02 Oct 2023
Use Your INSTINCT: INSTruction optimization for LLMs usIng Neural bandits Coupled with Transformers Xiaoqiang Lin Zhaoxuan Wu Zhongxiang Dai Wenyang Hu Yao Shu See-Kiong Ng Patrick Jaillet Bryan Kian Hsiang Low 99 11 0 02 Oct 2023
Natural Language based Context Modeling and Reasoning for Ubiquitous Computing with Large Language Models: A Tutorial Haoyi Xiong Jiang Bian Sijia Yang Xiaofei Zhang Linghe Kong Daqing Zhang LRM LLMAG 107 5 0 24 Sep 2023
Defending Pre-trained Language Models as Few-shot Learners against Backdoor Attacks Zhaohan Xi Tianyu Du Changjiang Li Ren Pang S. Ji Jinghui Chen Fenglong Ma Ting Wang AAML 68 34 0 23 Sep 2023
UniPCM: Universal Pre-trained Conversation Model with Task-aware Automatic Prompt Yucheng Cai Wentao Ma Yuchuan Wu Shuzheng Si Yuan Shao Zhijian Ou Yongbin Li 116 3 0 20 Sep 2023