Why do Nearest Neighbor Language Models Work?

7 January 2023

Graham Neubig

Papers citing "Why do Nearest Neighbor Language Models Work?"

22 / 22 papers shown

Title
Long-Tail Crisis in Nearest Neighbor Language Models Yuto Nishida Makoto Morishita Hiroyuki Deguchi Hidetaka Kamigaito Taro Watanabe RALM 63 0 0 28 Mar 2025
M2R-Whisper: Multi-stage and Multi-scale Retrieval Augmentation for Enhancing Whisper Jiaming Zhou Songtao Zhao Jiabei He Hui Wang Wenjia Zeng Yong Chen Haoqin Sun Aobo Kong Yong Qin 57 1 0 13 Mar 2025
Incorporating Precedents for Legal Judgement Prediction on European Court of Human Rights Cases T. Y. S. S. Santosh Mohamed Hesham Elganayni Stanisław Sójka Matthias Grabmair AILaw 29 1 0 27 Sep 2024
Local Topology Measures of Contextual Language Model Latent Spaces With Applications to Dialogue Term Extraction Benjamin Matthias Ruppik Michael Heck Carel van Niekerk Renato Vukovic Hsien-chin Lin Shutong Feng Marcus Zibrowius Milica Gašić 45 2 0 07 Aug 2024
Retrieval-Augmented Generation for Natural Language Processing: A Survey Shangyu Wu Ying Xiong Yufei Cui Haolun Wu Can Chen ... Lianming Huang Xue Liu Tei-Wei Kuo Nan Guan Chun Jason Xue 3DV RALM 38 26 0 18 Jul 2024
Efficient Nearest Neighbor based Uncertainty Estimation for Natural Language Processing Tasks Wataru Hashimoto Hidetaka Kamigaito Taro Watanabe 60 0 0 02 Jul 2024
Memorizing Documents with Guidance in Large Language Models Bumjin Park Jaesik Choi KELM RALM 36 1 0 23 Jun 2024
Languages Transferred Within the Encoder: On Representation Transfer in Zero-Shot Multilingual Translation Zhi Qu Chenchen Ding Taro Watanabe 85 1 0 12 Jun 2024
Non-Exchangeable Conformal Language Generation with Nearest Neighbors Dennis Ulmer Chrysoula Zerva André F. T. Martins 33 11 0 01 Feb 2024
NNOSE: Nearest Neighbor Occupational Skill Extraction Mike Zhang Rob van der Goot Min-Yen Kan Barbara Plank 37 3 0 30 Jan 2024
On Retrieval Augmentation and the Limitations of Language Model Training Ting-Rui Chiang Xinyan Velocity Yu Joshua Robinson Ollie Liu Isabelle G. Lee Dani Yogatama RALM 28 0 0 16 Nov 2023
Chameleon: a Heterogeneous and Disaggregated Accelerator System for Retrieval-Augmented Language Models Wenqi Jiang Marco Zeller R. Waleffe Torsten Hoefler Gustavo Alonso 54 16 0 15 Oct 2023
CAGRA: Highly Parallel Graph Construction and Approximate Nearest Neighbor Search for GPUs Hiroyuki Ootomo Akira Naruse Corey J. Nolet Ray Wang Tamas B. Fehér Y. Wang GNN 33 20 0 29 Aug 2023
Surface-Based Retrieval Reduces Perplexity of Retrieval-Augmented Language Models Ehsan Doostmohammadi Tobias Norlund Marco Kuhlmann Richard Johansson RALM 32 7 0 25 May 2023
Privacy Implications of Retrieval-Based Language Models Yangsibo Huang Samyak Gupta Zexuan Zhong Keqin Li Danqi Chen RALM 33 29 0 24 May 2023
KNN-LM Does Not Improve Open-ended Text Generation Shufan Wang Yixiao Song Andrew Drozdov Aparna Garimella Varun Manjunatha Mohit Iyyer RALM 32 8 0 24 May 2023
Nearest Neighbor Machine Translation is Meta-Optimizer on Output Projection Layer R. Gao Zhirui Zhang Yichao Du Lemao Liu Rui Wang 26 2 0 22 May 2023
On the Generalization Ability of Retrieval-Enhanced Transformers Tobias Norlund Ehsan Doostmohammadi Richard Johansson Marco Kuhlmann RALM 32 6 0 23 Feb 2023
You can't pick your neighbors, or can you? When and how to rely on retrieval in the $k$ NN-LM Andrew Drozdov Shufan Wang Razieh Rahimi Andrew McCallum Hamed Zamani Mohit Iyyer RALM 122 17 0 28 Oct 2022
Training Language Models with Memory Augmentation Zexuan Zhong Tao Lei Danqi Chen RALM 239 128 0 25 May 2022
Neuro-Symbolic Language Modeling with Automaton-augmented Retrieval Uri Alon Frank F. Xu Junxian He Sudipta Sengupta Dan Roth Graham Neubig RALM 77 62 0 28 Jan 2022
Efficient Nearest Neighbor Language Models Junxian He Graham Neubig Taylor Berg-Kirkpatrick RALM 195 103 0 09 Sep 2021