How Context Affects Language Models' Factual Predictions

10 May 2020

Patrick Lewis

Papers citing "How Context Affects Language Models' Factual Predictions"

50 / 57 papers shown

Title
Reasoning Capabilities and Invariability of Large Language Models Alessandro Raganato Rafael Peñaloza Marco Viviani G. Pasi ReLM LRM 82 0 0 01 May 2025
Leveraging LLMs for Utility-Focused Annotation: Reducing Manual Effort for Retrieval and RAG Hengran Zhang Minghao Tang Keping Bi J. Guo Shihao Liu Daiting Shi Dawei Yin Xueqi Cheng 19 0 0 07 Apr 2025
StruEdit: Structured Outputs Enable the Fast and Accurate Knowledge Editing for Large Language Models Baolong Bi Shenghua Liu Yiwei Wang Lingrui Mei Hongcheng Gao Junfeng Fang Xueqi Cheng KELM 47 8 0 16 Sep 2024
Improving Retrieval Augmented Language Model with Self-Reasoning Yuan Xia Jingbo Zhou Zhenhui Shi Jun Chen Hai-ting Huang AIFin LRM ReLM KELM 53 8 0 29 Jul 2024
MFC-Bench: Benchmarking Multimodal Fact-Checking with Large Vision-Language Models Shengkang Wang Hongzhan Lin Ziyang Luo Zhen Ye Guang Chen Jing Ma 68 3 0 17 Jun 2024
A Survey on RAG Meeting LLMs: Towards Retrieval-Augmented Large Language Models Wenqi Fan Yujuan Ding Liang-bo Ning Shijie Wang Hengyun Li Dawei Yin Tat-Seng Chua Qing Li RALM 3DV 40 188 0 10 May 2024
Smurfs: Leveraging Multiple Proficiency Agents with Context-Efficiency for Tool Planning Junzhi Chen Juhao Liang Benyou Wang LLMAG 28 3 0 09 May 2024
Cracking Factual Knowledge: A Comprehensive Analysis of Degenerate Knowledge Neurons in Large Language Models Yuheng Chen Pengfei Cao Yubo Chen Yining Wang Shengping Liu Kang Liu Jun Zhao KELM 37 1 0 21 Feb 2024
Strings from the Library of Babel: Random Sampling as a Strong Baseline for Prompt Optimisation Yao Lu Jiayi Wang Raphael Tang Sebastian Riedel Pontus Stenetorp 32 2 0 16 Nov 2023
Lost in the Middle: How Language Models Use Long Contexts Nelson F. Liu Kevin Lin John Hewitt Ashwin Paranjape Michele Bevilacqua Fabio Petroni Percy Liang RALM 40 1,404 0 06 Jul 2023
Geotechnical Parrot Tales (GPT): Harnessing Large Language Models in geotechnical engineering Krishna Kumar LLMAG AI4CE 19 10 0 04 Apr 2023
An Overview on Language Models: Recent Developments and Outlook Chengwei Wei Yun Cheng Wang Bin Wang C.-C. Jay Kuo 25 42 0 10 Mar 2023
Dynamic Benchmarking of Masked Language Models on Temporal Concept Drift with Multiple Views Katerina Margatina Shuai Wang Yogarshi Vyas Neha Ann John Yassine Benajiba Miguel Ballesteros 17 15 0 23 Feb 2023
Learning to Initialize: Can Meta Learning Improve Cross-task Generalization in Prompt Tuning? Chengwei Qin Q. Li Ruochen Zhao Shafiq R. Joty VLM LRM 23 15 0 16 Feb 2023
You Truly Understand What I Need: Intellectual and Friendly Dialogue Agents grounding Knowledge and Persona J. Lim Myunghoon Kang Yuna Hur Seung-Ju Jung Jinsung Kim ... Dongyub Lee Hyesung Ji Donghoon Shin Seung Wook Kim Heu-Jeoung Lim HILM 25 8 0 06 Jan 2023
Context Variance Evaluation of Pretrained Language Models for Prompt-based Biomedical Knowledge Probing Zonghai Yao Yi Cao Zhichao Yang Hong-ye Yu 19 17 0 18 Nov 2022
Large Language Models Struggle to Learn Long-Tail Knowledge Nikhil Kandpal H. Deng Adam Roberts Eric Wallace Colin Raffel RALM KELM 41 382 0 15 Nov 2022
Large Language Models with Controllable Working Memory Daliang Li A. S. Rawat Manzil Zaheer Xin Wang Michal Lukasik Andreas Veit Felix X. Yu Surinder Kumar KELM 55 152 0 09 Nov 2022
Different Tunes Played with Equal Skill: Exploring a Unified Optimization Subspace for Delta Tuning Jing Yi Weize Chen Yujia Qin Yankai Lin Ning Ding Xu Han Zhiyuan Liu Maosong Sun Jie Zhou 20 2 0 24 Oct 2022
Revision Transformers: Instructing Language Models to Change their Values Felix Friedrich Wolfgang Stammer P. Schramowski Kristian Kersting KELM 33 6 0 19 Oct 2022
Mass-Editing Memory in a Transformer Kevin Meng Arnab Sen Sharma A. Andonian Yonatan Belinkov David Bau KELM VLM 38 525 0 13 Oct 2022
Mind's Eye: Grounded Language Model Reasoning through Simulation Ruibo Liu Jason W. Wei S. Gu Te-Yen Wu Soroush Vosoughi Claire Cui Denny Zhou Andrew M. Dai ReLM LRM 118 79 0 11 Oct 2022
Best Prompts for Text-to-Image Models and How to Find Them Nikita Pavlichenko Dmitry Ustalov DiffM 12 58 0 23 Sep 2022
A Survey on Open Information Extraction from Rule-based Model to Large Language Model Pai Liu Wenya Gao Wenjie Dong Lin Ai Wen Dong Songfang Huang Zongsheng Li Ehsan Hoque Julia Hirschberg Yue Zhang 37 2 0 18 Aug 2022
Few-shot Adaptation Works with UnpredicTable Data Jun Shern Chan Michael Pieler Jonathan Jao Jérémy Scheurer Ethan Perez 31 5 0 01 Aug 2022
Eliciting and Understanding Cross-Task Skills with Task-Level Mixture-of-Experts Qinyuan Ye Juan Zha Xiang Ren MoE 18 12 0 25 May 2022
Autoregressive Search Engines: Generating Substrings as Document Identifiers Michele Bevilacqua G. Ottaviano Patrick Lewis Wen-tau Yih Sebastian Riedel Fabio Petroni KELM RALM 30 155 0 22 Apr 2022
Probing Script Knowledge from Pre-Trained Models Zijian Jin Xingyu Zhang Mo Yu Lifu Huang 18 4 0 16 Apr 2022
Delta Tuning: A Comprehensive Study of Parameter Efficient Methods for Pre-trained Language Models Ning Ding Yujia Qin Guang Yang Fu Wei Zonghan Yang ... Jianfei Chen Yang Liu Jie Tang Juan Li Maosong Sun 32 196 0 14 Mar 2022
Read before Generate! Faithful Long Form Question Answering with Machine Reading Dan Su Xiaoguang Li Jindi Zhang Lifeng Shang Xin Jiang Qun Liu Pascale Fung HILM 16 59 0 01 Mar 2022
Locating and Editing Factual Associations in GPT Kevin Meng David Bau A. Andonian Yonatan Belinkov KELM 56 1,192 0 10 Feb 2022
Refined Commonsense Knowledge from Large-Scale Web Contents Tuan-Phong Nguyen Simon Razniewski Julien Romero G. Weikum 39 32 0 30 Nov 2021
Interpreting Language Models Through Knowledge Graph Extraction Vinitra Swamy Angelika Romanou Martin Jaggi 28 20 0 16 Nov 2021
Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Survey Bonan Min Hayley L Ross Elior Sulem Amir Pouran Ben Veyseh Thien Huu Nguyen Oscar Sainz Eneko Agirre Ilana Heinz Dan Roth LM&MA VLM AI4CE 83 1,030 0 01 Nov 2021
MetaICL: Learning to Learn In Context Sewon Min M. Lewis Luke Zettlemoyer Hannaneh Hajishirzi LRM 56 467 0 29 Oct 2021
Template-free Prompt Tuning for Few-shot NER Ruotian Ma Xin Zhou Tao Gui Y. Tan Linyang Li Qi Zhang Xuanjing Huang VLM 148 178 0 28 Sep 2021
Robust Retrieval Augmented Generation for Zero-shot Slot Filling Michael R. Glass Gaetano Rossiello Md. Faisal Mahbub Chowdhury A. Gliozzo RALM 36 32 0 31 Aug 2021
How to Query Language Models? Leonard Adolphs S. Dhuliawala Thomas Hofmann KELM 24 15 0 04 Aug 2021
Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing Pengfei Liu Weizhe Yuan Jinlan Fu Zhengbao Jiang Hiroaki Hayashi Graham Neubig VLM SyDa 37 3,831 0 28 Jul 2021
Scientific Language Models for Biomedical Knowledge Base Completion: An Empirical Study Rahul Nadkarni David Wadden Iz Beltagy Noah A. Smith Hannaneh Hajishirzi Tom Hope 35 27 0 17 Jun 2021
Prompting Contrastive Explanations for Commonsense Reasoning Tasks Bhargavi Paranjape Julian Michael Marjan Ghazvininejad Luke Zettlemoyer Hannaneh Hajishirzi ReLM LRM 22 66 0 12 Jun 2021
CrossFit: A Few-shot Learning Challenge for Cross-task Generalization in NLP Qinyuan Ye Bill Yuchen Lin Xiang Ren 214 180 0 18 Apr 2021
Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivity Yao Lu Max Bartolo Alastair Moore Sebastian Riedel Pontus Stenetorp AILaw LRM 279 1,124 0 18 Apr 2021
Relational World Knowledge Representation in Contextual Language Models: A Review Tara Safavi Danai Koutra KELM 35 51 0 12 Apr 2021
Thinking Aloud: Dynamic Context Generation Improves Zero-Shot Reasoning Performance of GPT-2 Gregor Betz Kyle Richardson Christian Voigt ReLM LRM 21 30 0 24 Mar 2021
GPT Understands, Too Xiao Liu Yanan Zheng Zhengxiao Du Ming Ding Yujie Qian Zhilin Yang Jie Tang VLM 48 1,144 0 18 Mar 2021
BERTese: Learning to Speak to BERT Adi Haviv Jonathan Berant Amir Globerson 22 122 0 09 Mar 2021
PAQ: 65 Million Probably-Asked Questions and What You Can Do With Them Patrick Lewis Yuxiang Wu Linqing Liu Pasquale Minervini Heinrich Küttler Aleksandra Piktus Pontus Stenetorp Sebastian Riedel RALM 40 228 0 13 Feb 2021
Measuring and Improving Consistency in Pretrained Language Models Yanai Elazar Nora Kassner Shauli Ravfogel Abhilasha Ravichander Eduard H. Hovy Hinrich Schütze Yoav Goldberg HILM 269 346 0 01 Feb 2021
Multilingual LAMA: Investigating Knowledge in Multilingual Pretrained Language Models Nora Kassner Philipp Dufter Hinrich Schütze 21 132 0 01 Feb 2021