v1v2 (latest)

Generalization through Memorization: Nearest Neighbor Language Models

1 November 2019

Urvashi Khandelwal

Omer Levy

Dan Jurafsky

Luke Zettlemoyer

M. Lewis

RALM

ArXiv (abs)PDF HTML

Papers citing "Generalization through Memorization: Nearest Neighbor Language Models"

50 / 597 papers shown

Title
Great Memory, Shallow Reasoning: Limits of $k$ NN-LMs Shangyi Geng Wenting Zhao Alexander M. Rush RALM ReLM LRM 93 2 0 21 Aug 2024
Epistemic Injustice in Generative AI Jackie Kay Atoosa Kasirzadeh Shakir Mohamed AILaw 79 12 0 21 Aug 2024
CommunityKG-RAG: Leveraging Community Structures in Knowledge Graphs for Advanced Retrieval-Augmented Generation in Fact-Checking Rong-Ching Chang Jiawei Zhang 81 2 0 16 Aug 2024
Towards flexible perception with visual memory Robert Geirhos P. Jaini Austin Stone Sourabh Medapati Xi Yi G. Toderici Abhijit Ogale Jonathon Shlens 91 1 0 15 Aug 2024
A Hybrid RAG System with Comprehensive Enhancement on Complex Reasoning Ye Yuan Chengwu Liu Jingyang Yuan Gongbo Sun Siqi Li Ming Zhang LRM 130 5 0 09 Aug 2024
Retrieval-augmented code completion for local projects using large language models Marko Hostnik Marko Robnik-Sikonja RALM 83 1 0 09 Aug 2024
Local Topology Measures of Contextual Language Model Latent Spaces With Applications to Dialogue Term Extraction Benjamin Matthias Ruppik Michael Heck Carel van Niekerk Renato Vukovic Hsien-chin Lin Shutong Feng Marcus Zibrowius Milica Gašić 89 3 0 07 Aug 2024
A Debiased Nearest Neighbors Framework for Multi-Label Text Classification Zifeng Cheng Zhiwei Jiang Yafeng Yin Zhaoling Chen Cong Wang Shiping Ge Qiguo Huang Qing Gu 73 0 0 06 Aug 2024
Understanding Memorisation in LLMs: Dynamics, Influencing Factors, and Implications Till Speicher Mohammad Aflah Khan Qinyuan Wu Vedant Nanda Soumi Das Bishwamittra Ghosh Krishna P. Gummadi Evimaria Terzi 111 3 0 27 Jul 2024
Retrieval Augmented Generation or Long-Context LLMs? A Comprehensive Study and Hybrid Approach Zhuowan Li Cheng-rong Li Mingyang Zhang Qiaozhu Mei Michael Bendersky 3DV RALM 124 51 0 23 Jul 2024
An Empirical Study of Retrieval Augmented Generation with Chain-of-Thought Yuetong Zhao Hongyu Cao Xianyu Zhao Zhijian Ou RALM LRM 69 4 0 22 Jul 2024
Exploiting Pre-trained Models for Drug Target Affinity Prediction with Nearest Neighbors Qizhi Pei Lijun Wu Zhenyu He Jinhua Zhu Yingce Xia Shufang Xie Rui Yan 64 1 0 21 Jul 2024
ChatQA 2: Bridging the Gap to Proprietary LLMs in Long Context and RAG Capabilities Peng Xu Ming-Yu Liu Xianchao Wu Zihan Liu Mohammad Shoeybi Mohammad Shoeybi Bryan Catanzaro RALM 167 21 0 19 Jul 2024
Nearest Neighbor Future Captioning: Generating Descriptions for Possible Collisions in Object Placement Tasks Takumi Komatsu Motonari Kambara Shumpei Hatanaka Haruka Matsuo Tsubasa Hirakawa Takayoshi Yamashita H. Fujiyoshi Komei Sugiura 73 0 0 18 Jul 2024
Retrieve, Summarize, Plan: Advancing Multi-hop Question Answering with an Iterative Approach Zhouyu Jiang Mengshu Sun Lei Liang Qing Cui RALM 155 14 0 18 Jul 2024
Visual Haystacks: A Vision-Centric Needle-In-A-Haystack Benchmark Tsung-Han Wu Giscard Biamby Jerome Quenum Ritwik Gupta Joseph E. Gonzalez Trevor Darrell David M. Chan VLM 100 0 0 18 Jul 2024
Retrieval-Enhanced Machine Learning: Synthesis and Opportunities To Eun Kim Alireza Salemi Andrew Drozdov Fernando Diaz Hamed Zamani 126 8 0 17 Jul 2024
Goldfish: Vision-Language Understanding of Arbitrarily Long Videos Kirolos Ataallah Xiaoqian Shen Eslam Abdelrahman Essam Sleiman Mingchen Zhuge Jian Ding Deyao Zhu Jürgen Schmidhuber Mohamed Elhoseiny VLM 75 20 0 17 Jul 2024
Mitigating Entity-Level Hallucination in Large Language Models Weihang Su Yichen Tang Qingyao Ai Changyue Wang Zhijing Wu Yiqun Liu HILM 91 8 0 12 Jul 2024
CompAct: Compressing Retrieved Documents Actively for Question Answering Chanwoong Yoon Taewhoo Lee Hyeon Hwang Minbyul Jeong Jaewoo Kang KELM RALM MQ 118 18 0 12 Jul 2024
Detect, Investigate, Judge and Determine: A Knowledge-guided Framework for Few-shot Fake News Detection Ye Liu Jiajun Zhu Kai Zhang Haoyu Tang Yanghai Zhang Xukai Liu Qi Liu Enhong Chen 146 0 0 12 Jul 2024
Operationalizing the Blueprint for an AI Bill of Rights: Recommendations for Practitioners, Researchers, and Policy Makers Alex Oesterling Usha Bhalla Suresh Venkatasubramanian Himabindu Lakkaraju 85 3 0 11 Jul 2024
Speculative RAG: Enhancing Retrieval Augmented Generation through Drafting Zilong Wang Zifeng Wang Long Le Huaixiu Steven Zheng Swaroop Mishra ... Anush Mattapalli Ankur Taly Jingbo Shang Chen-Yu Lee Tomas Pfister RALM 140 46 0 11 Jul 2024
Scaling Retrieval-Based Language Models with a Trillion-Token Datastore Rulin Shao Jacqueline He Akari Asai Weijia Shi Tim Dettmers Sewon Min Luke Zettlemoyer Pang Wei Koh RALM 102 26 0 09 Jul 2024
VRSD: Rethinking Similarity and Diversity for Retrieval in Large Language Models Hang Gao Yongfeng Zhang 99 2 0 05 Jul 2024
Mixture of A Million Experts Xu Owen He MoE 105 33 0 04 Jul 2024
Do Generalised Classifiers really work on Human Drawn Sketches? Hmrishav Bandyopadhyay Pinaki Nath Chowdhury Aneeshan Sain Subhadeep Koley Tao Xiang A. Bhunia Yi-Zhe Song VLM 81 2 0 04 Jul 2024
DSLR: Document Refinement with Sentence-Level Re-ranking and Reconstruction to Enhance Retrieval-Augmented Generation Taeho Hwang Soyeong Jeong Sukmin Cho SeungYoon Han Jong C. Park RALM 126 1 0 04 Jul 2024
Contrast then Memorize: Semantic Neighbor Retrieval-Enhanced Inductive Multimodal Knowledge Graph Completion Yu Zhao Ying Zhang Baohang Zhou Xinying Qian Kehui Song Xiangrui Cai 66 2 0 03 Jul 2024
Efficient Nearest Neighbor based Uncertainty Estimation for Natural Language Processing Tasks Wataru Hashimoto Hidetaka Kamigaito Taro Watanabe 145 0 0 02 Jul 2024
SeaKR: Self-aware Knowledge Retrieval for Adaptive Retrieval Augmented Generation Zijun Yao Weijian Qi Liangming Pan S. Cao Linmei Hu Weichuan Liu Lei Hou Juanzi Li RALM 78 6 0 27 Jun 2024
RAVEN: Multitask Retrieval Augmented Vision-Language Learning Varun Nagaraj Rao Siddharth Choudhary Aditya Deshpande R. Satzoda Srikar Appalaraju RALM VLM 92 5 0 27 Jun 2024
Banishing LLM Hallucinations Requires Rethinking Generalization Johnny Li Saksham Consul Eda Zhou James Wong Naila Farooqui ... Zhuxiaona Wei Tian Wu Ben Echols Sharon Zhou Gregory Diamos LRM 68 13 0 25 Jun 2024
Mitigating Hallucination in Fictional Character Role-Play Nafis Sadeq Zhouhang Xie Byungkyu Kang Prarit Lamba Xiang Gao Julian McAuley HILM 113 11 0 25 Jun 2024
Ragnarök: A Reusable RAG Framework and Baselines for TREC 2024 Retrieval-Augmented Generation Track Ronak Pradeep Nandan Thakur Sahel Sharifymoghaddam Eric Zhang Ryan Nguyen Daniel Campos Nick Craswell Jimmy Lin 129 16 0 24 Jun 2024
Found in the Middle: Calibrating Positional Attention Bias Improves Long Context Utilization Cheng-Yu Hsieh Yung-Sung Chuang Chun-Liang Li Zifeng Wang Long T. Le ... James R. Glass Alexander Ratner Chen-Yu Lee Ranjay Krishna Tomas Pfister 140 41 0 23 Jun 2024
Memorizing Documents with Guidance in Large Language Models Bumjin Park Jaesik Choi KELM RALM 71 1 0 23 Jun 2024
GraphReader: Building Graph-based Agent to Enhance Long-Context Abilities of Large Language Models Shilong Li Yancheng He Hangyu Guo Xingyuan Bu Ge Bai ... Xingwei Qu Yangguang Li Wanli Ouyang Wenbo Su Bo Zheng RALM LLMAG 96 9 0 20 Jun 2024
InstructRAG: Instructing Retrieval-Augmented Generation via Self-Synthesized Rationales Zhepei Wei Wei-Lin Chen Yu Meng RALM 169 12 0 19 Jun 2024
Evaluating $n$ -Gram Novelty of Language Models Using Rusty-DAWG William Merrill Noah A. Smith Yanai Elazar ELM TDI 116 12 0 18 Jun 2024
Think-then-Act: A Dual-Angle Evaluated Retrieval-Augmented Generation Yige Shen Hao Jiang Hua Qu Jihong Zhao RALM LRM 82 1 0 18 Jun 2024
PlanRAG: A Plan-then-Retrieval Augmented Generation for Generative Large Language Models as Decision Makers Myeonghwa Lee Seonho An Min-Soo Kim 3DV RALM 83 22 0 18 Jun 2024
Iterative Utility Judgment Framework via LLMs Inspired by Relevance in Philosophy Hengran Zhang Keping Bi Jiafeng Guo Xueqi Cheng 101 1 0 17 Jun 2024
Refiner: Restructure Retrieval Content Efficiently to Advance Question-Answering Capabilities Zhonghao Li Xuming Hu Aiwei Liu Kening Zheng Shijie Huang Hui Xiong RALM 199 8 0 17 Jun 2024
BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystack Yuri Kuratov Aydar Bulatov Petr Anokhin Ivan Rodkin Dmitry Sorokin Artyom Sorokin Andrey Kravchenko RALM ALM LRM ReLM ELM 104 82 0 14 Jun 2024
Integrating Large Language Models with Graph-based Reasoning for Conversational Question Answering Parag Jain Mirella Lapata 83 1 0 14 Jun 2024
Multi-Modal Retrieval For Large Language Model Based Speech Recognition J. Kolehmainen Aditya Gourav Prashanth Gurunath Shivakumar Yile Gu Ankur Gandhe Ariya Rastrow Grant P. Strimel I. Bulyko 90 5 0 13 Jun 2024
Action2Sound: Ambient-Aware Generation of Action Sounds from Egocentric Videos Changan Chen Puyuan Peng Ami Baid Zihui Xue Wei-Ning Hsu David Harwath Kristen Grauman VGen 101 8 0 13 Jun 2024
Supportiveness-based Knowledge Rewriting for Retrieval-augmented Language Modeling Zile Qiao Wei Ye Yong Jiang Tong Mo Pengjun Xie Weiping Li Fei Huang Shikun Zhang KELM 58 4 0 12 Jun 2024
QuickLLaMA: Query-aware Inference Acceleration for Large Language Models Jingyao Li Han Shi Xin Jiang Zhenguo Li Hong Xu Jiaya Jia LRM 70 2 0 11 Jun 2024