Generalization through Memorization: Nearest Neighbor Language Models

1 November 2019

Urvashi Khandelwal

Omer Levy

Dan Jurafsky

Luke Zettlemoyer

M. Lewis

RALM

ArXiv PDF HTML

Papers citing "Generalization through Memorization: Nearest Neighbor Language Models"

50 / 582 papers shown

Title
Towards Retrieval-Augmented Architectures for Image Captioning Sara Sarto Marcella Cornia Lorenzo Baraldi Alessandro Nicolosi Rita Cucchiara VLM 32 10 0 21 May 2024
ARAIDA: Analogical Reasoning-Augmented Interactive Data Annotation Chen Huang Yiping Jin Ilija Ilievski Wenqiang Lei Jiancheng Lv 37 3 0 20 May 2024
Feature-Adaptive and Data-Scalable In-Context Learning Jiahao Li Quan Wang L. Zhang Guoqing Jin Zhendong Mao 73 2 0 17 May 2024
Beyond Scaling Laws: Understanding Transformer Performance with Associative Memory Xueyan Niu Bo Bai Lei Deng Wei Han 44 6 0 14 May 2024
FlashBack:Efficient Retrieval-Augmented Language Modeling for Long Context Inference Runheng Liu Xingchen Xiao Heyan Huang Zewen Chi Zhijing Wu RALM KELM 34 0 0 07 May 2024
R4: Reinforced Retriever-Reorder-Responder for Retrieval-Augmented Large Language Models Taolin Zhang Dongyang Li Qizhou Chen Chengyu Wang Longtao Huang Hui Xue Xiaofeng He Junyuan Huang RALM KELM 58 0 0 04 May 2024
BiomedRAG: A Retrieval Augmented Large Language Model for Biomedicine Mingchen Li H. Kilicoglu Hualei Xu Rui Zhang LM&MA RALM 40 13 0 01 May 2024
RAG and RAU: A Survey on Retrieval-Augmented Language Model in Natural Language Processing Yucheng Hu Yuxing Lu RALM 60 18 0 30 Apr 2024
HELPER-X: A Unified Instructable Embodied Agent to Tackle Four Interactive Vision-Language Domains with Memory-Augmented Language Models Gabriel H. Sarch Sahil Somani Raghav Kapoor Michael J. Tarr Katerina Fragkiadaki LM&Ro LLMAG 37 3 0 29 Apr 2024
Quality Estimation with $k$ -nearest Neighbors and Automatic Evaluation for Model-specific Quality Estimation Tu Anh Dinh Tobias Palzer Jan Niehues 46 0 0 27 Apr 2024
LLMs Know What They Need: Leveraging a Missing Information Guided Framework to Empower Retrieval-Augmented Generation Keheng Wang Feiyu Duan Peiguang Li Sirui Wang Xunliang Cai RALM 46 4 0 22 Apr 2024
FedMeS: Personalized Federated Continual Learning Leveraging Local Memory Jingru Xie Chenqi Zhu Songze Li FedML CLL 32 0 0 19 Apr 2024
From Language Models to Practical Self-Improving Computer Agents Alex Sheng LM&MA LLMAG 35 0 0 18 Apr 2024
A Survey on Retrieval-Augmented Text Generation for Large Language Models Yizheng Huang Jimmy X. Huang 3DV RALM 66 46 0 17 Apr 2024
kNN-CLIP: Retrieval Enables Training-Free Segmentation on Continually Expanding Large Vocabularies Zhongrui Gui Shuyang Sun Runjia Li Jianhao Yuan Zhaochong An Karsten Roth Ameya Prabhu Philip Torr VLM CLL 32 6 0 15 Apr 2024
Privacy Preserving Prompt Engineering: A Survey Kennedy Edemacu Xintao Wu 63 18 0 09 Apr 2024
Verifiable by Design: Aligning Language Models to Quote from Pre-Training Data Jingyu Zhang Marc Marone Tianjian Li Benjamin Van Durme Daniel Khashabi 93 9 0 05 Apr 2024
Improving Retrieval Augmented Open-Domain Question-Answering with Vectorized Contexts Zhuo Chen Xinyu Wang Yong-jia Jiang Pengjun Xie Fei Huang Kewei Tu RALM 29 2 0 02 Apr 2024
Learning to Plan for Language Modeling from Unlabeled Data Nathan Cornille Marie-Francine Moens Florian Mai 38 7 0 31 Mar 2024
Mind Your Neighbours: Leveraging Analogous Instances for Rhetorical Role Labeling for Legal Documents Santosh T.Y.S.S Hassan Sarwat Ahmed Abdou Matthias Grabmair AILaw 35 2 0 31 Mar 2024
CPR: Retrieval Augmented Generation for Copyright Protection Aditya Golatkar Alessandro Achille L. Zancato Yu-Xiang Wang Ashwin Swaminathan Stefano Soatto DiffM 32 16 0 27 Mar 2024
RAP: Retrieval-Augmented Planner for Adaptive Procedure Planning in Instructional Videos Ali Zare Yulei Niu Hammad A. Ayyubi Shih-Fu Chang 55 1 0 27 Mar 2024
Quantifying and Mitigating Unimodal Biases in Multimodal Large Language Models: A Causal Perspective Meiqi Chen Yixin Cao Yan Zhang Chaochao Lu 37 13 0 27 Mar 2024
Efficient Test-Time Adaptation of Vision-Language Models Adilbek Karmanov Dayan Guan Shijian Lu Abdulmotaleb El Saddik Eric Xing TTA VLM 19 41 0 27 Mar 2024
DANCER: Entity Description Augmented Named Entity Corrector for Automatic Speech Recognition Yi-Cheng Wang Hsin-Wei Wang Bi-Cheng Yan Chi-Han Lin Berlin Chen 37 1 0 26 Mar 2024
Differentially Private Next-Token Prediction of Large Language Models James Flemings Meisam Razaviyayn Murali Annavaram 36 6 0 22 Mar 2024
FIT-RAG: Black-Box RAG with Factual Information and Token Reduction Yuren Mao Xuemei Dong Wenyi Xu Yunjun Gao Bin Wei Ying Zhang 41 9 0 21 Mar 2024
Larimar: Large Language Models with Episodic Memory Control Payel Das Subhajit Chaudhury Elliot Nelson Igor Melnyk Sarath Swaminathan ... Vijil Chenthamarakshan Jiří Jirí Navrátil Soham Dan Pin-Yu Chen CLL KELM 37 18 0 18 Mar 2024
JORA: JAX Tensor-Parallel LoRA Library for Retrieval Augmented Fine-Tuning Anique Tahir Lu Cheng Huan Liu 38 1 0 17 Mar 2024
RAFT: Adapting Language Model to Domain Specific RAG Tianjun Zhang Shishir G. Patil Naman Jain Sheng Shen Matei A. Zaharia Ion Stoica Joseph E. Gonzalez RALM 37 181 0 15 Mar 2024
DRAGIN: Dynamic Retrieval Augmented Generation based on the Information Needs of Large Language Models Weihang Su Yichen Tang Qingyao Ai Zhijing Wu Yiqun Liu 3DV RALM AI4TS SyDa 61 19 0 15 Mar 2024
Semiparametric Token-Sequence Co-Supervision Hyunji Lee Doyoung Kim Jihoon Jun Se June Joo Joel Jang Kyoung-Woon On Minjoon Seo 35 0 0 14 Mar 2024
Unsupervised Real-Time Hallucination Detection based on the Internal States of Large Language Models Weihang Su Changyue Wang Qingyao Ai Hu Yiran Zhijing Wu Yujia Zhou Yiqun Liu HILM 52 28 0 11 Mar 2024
PipeRAG: Fast Retrieval-Augmented Generation via Algorithm-System Co-design Wenqi Jiang Shuai Zhang Boran Han Jie Wang Bernie Wang Tim Kraska 3DV 98 24 0 08 Mar 2024
RATSF: Empowering Customer Service Volume Management through Retrieval-Augmented Time-Series Forecasting Tianfeng Wang Gaojie Cui AI4TS 50 0 0 07 Mar 2024
From One to Many: Expanding the Scope of Toxicity Mitigation in Language Models Luiza Amador Pozzobon Patrick Lewis Sara Hooker Beyza Ermis 45 7 0 06 Mar 2024
MeaCap: Memory-Augmented Zero-shot Image Captioning Zequn Zeng Yan Xie Hao Zhang Chiyu Chen Zhengjue Wang Boli Chen VLM 39 14 0 06 Mar 2024
Reliable, Adaptable, and Attributable Language Models with Retrieval Akari Asai Zexuan Zhong Danqi Chen Pang Wei Koh Luke Zettlemoyer Hanna Hajishirzi Wen-tau Yih KELM RALM 49 55 0 05 Mar 2024
Retrieval-Augmented Generation for AI-Generated Content: A Survey Penghao Zhao Hailin Zhang Qinhan Yu Zhengren Wang Yunteng Geng Fangcheng Fu Ling Yang Wentao Zhang Jie Jiang Bin Cui 3DV 132 235 0 29 Feb 2024
Memory-Augmented Generative Adversarial Transformers Stephan Raaijmakers Roos Bakker Anita Cremers R. D. Kleijn Tom Kouwenhoven Tessa Verhoef 41 0 0 29 Feb 2024
Follow My Instruction and Spill the Beans: Scalable Data Extraction from Retrieval-Augmented Generation Systems Zhenting Qi Hanlin Zhang Eric Xing Sham Kakade Hima Lakkaraju SILM 49 19 0 27 Feb 2024
Retrieval is Accurate Generation Bowen Cao Deng Cai Leyang Cui Xuxin Cheng Wei Bi Yuexian Zou Shuming Shi 40 6 0 27 Feb 2024
The Good and The Bad: Exploring Privacy Issues in Retrieval-Augmented Generation (RAG) Shenglai Zeng Jiankun Zhang Pengfei He Yue Xing Yiding Liu ... Jie Ren Shuaiqiang Wang Dawei Yin Yi Chang Jiliang Tang SILM 44 69 0 23 Feb 2024
Transformer-based Causal Language Models Perform Clustering Xinbo Wu L. Varshney 24 6 0 19 Feb 2024
Unveiling the Magic: Investigating Attention Distillation in Retrieval-augmented Generation Zizhong Li Haopeng Zhang Jiawei Zhang RALM 56 1 0 19 Feb 2024
Metacognitive Retrieval-Augmented Large Language Models Yujia Zhou Zheng Liu Jiajie Jin Jian-yun Nie Zhicheng Dou RALM KELM AIFin LRM 37 16 0 18 Feb 2024
EVEDIT: Event-based Knowledge Editing with Deductive Editing Boundaries Jiateng Liu Pengfei Yu Yuji Zhang Sha Li Zixuan Zhang Heng Ji KELM 26 16 0 17 Feb 2024
In Search of Needles in a 11M Haystack: Recurrent Memory Finds What LLMs Miss Yuri Kuratov Aydar Bulatov Petr Anokhin Dmitry Sorokin Artyom Sorokin Andrey Kravchenko RALM 119 33 0 16 Feb 2024
Grounding Language Model with Chunking-Free In-Context Retrieval Hongjin Qian Zheng Liu Kelong Mao Yujia Zhou Zhicheng Dou 50 14 0 15 Feb 2024
Nearest Neighbour Score Estimators for Diffusion Generative Models Matthew Niedoba Dylan Green Saeid Naderiparizi Vasileios Lioutas J. Lavington ... Ke Zhang Setareh Dabiri Adam Scibior Berend Zwartsenberg Frank Wood DiffM 35 0 0 12 Feb 2024