A Survey on RAG Meeting LLMs: Towards Retrieval-Augmented Large Language Models

10 May 2024

Papers citing "A Survey on RAG Meeting LLMs: Towards Retrieval-Augmented Large Language Models"

50 / 152 papers shown

Title
Knowledge-enhanced Black-box Attacks for Recommendations Jingfan Chen Wenqi Fan Guanghui Zhu Xiangyu Zhao Chun Yuan Qing Li Jiaming Ji MLAU AAML 44 51 0 21 Jul 2022
DocPrompting: Generating Code by Retrieving the Docs Shuyan Zhou Uri Alon Frank F. Xu Zhiruo Wang Zhengbao Jiang Graham Neubig LLMAG 55 136 0 13 Jul 2022
Language Models (Mostly) Know What They Know Saurav Kadavath Tom Conerly Amanda Askell T. Henighan Dawn Drain ... Nicholas Joseph Benjamin Mann Sam McCandlish C. Olah Jared Kaplan ELM 97 787 0 11 Jul 2022
Self-Generated In-Context Learning: Leveraging Auto-regressive Language Models as a Demonstration Generator Sungmin Cho Hyunsoo Cho Junyeob Kim Taeuk Kim Kang Min Yoo Sang-goo Lee 55 63 0 16 Jun 2022
Training Language Models with Memory Augmentation Zexuan Zhong Tao Lei Danqi Chen RALM 267 131 0 25 May 2022
KNN-Diffusion: Image Generation via Large-Scale Retrieval Shelly Sheynin Oron Ashual Adam Polyak Uriel Singer Oran Gafni Eliya Nachmani Yaniv Taigman VLM SyDa DiffM 51 115 0 06 Apr 2022
PaLM: Scaling Language Modeling with Pathways Aakanksha Chowdhery Sharan Narang Jacob Devlin Maarten Bosma Gaurav Mishra ... Kathy Meier-Hellstern Douglas Eck J. Dean Slav Petrov Noah Fiedel PILM LRM 335 6,132 0 05 Apr 2022
Teaching language models to support answers with verified quotes Jacob Menick Maja Trebacz Vladimir Mikulik John Aslanides Francis Song ... Mia Glaese Susannah Young Lucy Campbell-Gillingham G. Irving Nat McAleese ELM RALM 270 262 0 21 Mar 2022
Internet-augmented language models through few-shot prompting for open-domain question answering Angeliki Lazaridou E. Gribovskaya Wojciech Stokowiec N. Grigorev KELM LRM 30 134 0 10 Mar 2022
Rethinking the Role of Demonstrations: What Makes In-Context Learning Work? Sewon Min Xinxi Lyu Ari Holtzman Mikel Artetxe M. Lewis Hannaneh Hajishirzi Luke Zettlemoyer LLMAG LRM 120 1,438 0 25 Feb 2022
Learning To Retrieve Prompts for In-Context Learning Ohad Rubin Jonathan Herzig Jonathan Berant VPVLM RALM 45 679 0 16 Dec 2021
Learning to Retrieve Passages without Supervision Ori Ram Gal Shachaf Omer Levy Jonathan Berant Amir Globerson RALM 33 61 0 14 Dec 2021
SPoT: Better Frozen Model Adaptation through Soft Prompt Transfer Tu Vu Brian Lester Noah Constant Rami Al-Rfou Daniel Cer VLM LRM 178 284 0 15 Oct 2021
Efficient Nearest Neighbor Language Models Junxian He Graham Neubig Taylor Berg-Kirkpatrick RALM 207 104 0 09 Sep 2021
Retrieval Augmented Code Generation and Summarization Md. Rizwan Parvez W. Ahmad Saikat Chakraborty Baishakhi Ray Kai-Wei Chang 53 186 0 26 Aug 2021
Graph Trend Filtering Networks for Recommendations Wenqi Fan Xiaorui Liu Wei Jin Xiangyu Zhao Jiliang Tang Qing Li 92 103 0 12 Aug 2021
Beyond Goldfish Memory: Long-Term Open-Domain Conversation Jing Xu Arthur Szlam Jason Weston RALM 33 250 0 15 Jul 2021
Internet-Augmented Dialogue Generation M. Komeili Kurt Shuster Jason Weston RALM 281 286 0 15 Jul 2021
Trustworthy AI: A Computational Perspective Haochen Liu Yiqi Wang Wenqi Fan Xiaorui Liu Yaxin Li Shaili Jain Yunhao Liu Anil K. Jain Jiliang Tang FaML 123 202 0 12 Jul 2021
Evaluating Large Language Models Trained on Code Mark Chen Jerry Tworek Heewoo Jun Qiming Yuan Henrique Pondé ... Bob McGrew Dario Amodei Sam McCandlish Ilya Sutskever Wojciech Zaremba ELM ALM 155 5,328 0 07 Jul 2021
End-to-End Training of Multi-Document Reader and Retriever for Open-Domain Question Answering Devendra Singh Sachan Siva Reddy William L. Hamilton Chris Dyer Dani Yogatama OOD RALM 60 163 0 09 Jun 2021
Template-Based Named Entity Recognition Using BART Leyang Cui Yu Wu Jian Liu Sen Yang Yue Zhang 55 350 0 03 Jun 2021
RevCore: Review-augmented Conversational Recommendation Yu Lu Junwei Bao Yan Song Zichen Ma Shuguang Cui Youzheng Wu Xiaodong He 84 76 0 02 Jun 2021
Retrieval Augmentation Reduces Hallucination in Conversation Kurt Shuster Spencer Poff Moya Chen Douwe Kiela Jason Weston HILM 72 721 0 15 Apr 2021
Adaptive Semiparametric Language Models Dani Yogatama Cyprien de Masson dÁutume Lingpeng Kong KELM RALM 60 100 0 04 Feb 2021
What Makes Good In-Context Examples for GPT- $3$ ? Jiachang Liu Dinghan Shen Yizhe Zhang Bill Dolan Lawrence Carin Weizhu Chen AAML RALM 324 1,343 0 17 Jan 2021
Prefix-Tuning: Optimizing Continuous Prompts for Generation Xiang Lisa Li Percy Liang 174 4,209 0 01 Jan 2021
Distilling Knowledge from Reader to Retriever for Question Answering Gautier Izacard Edouard Grave RALM 223 262 0 08 Dec 2020
Leveraging Passage Retrieval with Generative Models for Open Domain Question Answering Gautier Izacard Edouard Grave RALM 102 1,141 0 02 Jul 2020
Pre-training via Paraphrasing M. Lewis Marjan Ghazvininejad Gargi Ghosh Armen Aghajanyan Sida I. Wang Luke Zettlemoyer AIMat 76 160 0 26 Jun 2020
Language Models are Few-Shot Learners Tom B. Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared Kaplan ... Christopher Berner Sam McCandlish Alec Radford Ilya Sutskever Dario Amodei BDL 500 41,106 0 28 May 2020
Attacking Black-box Recommendations via Copying Cross-domain User Profiles Wenqi Fan Hanyu Wang Xiangyu Zhao Yao Ma Hui Liu Jianping Wang Jiliang Tang Qing Li MLAU AAML 34 77 0 17 May 2020
How Context Affects Language Models' Factual Predictions Fabio Petroni Patrick Lewis Aleksandra Piktus Tim Rocktaschel Yuxiang Wu Alexander H. Miller Sebastian Riedel KELM 36 237 0 10 May 2020
ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERT Omar Khattab Matei A. Zaharia 97 1,337 0 27 Apr 2020
AmbigQA: Answering Ambiguous Open-domain Questions Sewon Min Julian Michael Hannaneh Hajishirzi Luke Zettlemoyer 75 302 0 22 Apr 2020
Entities as Experts: Sparse Memory Access with Entity Supervision Thibault Févry Livio Baldini Soares Nicholas FitzGerald Eunsol Choi Tom Kwiatkowski RALM 63 153 0 15 Apr 2020
Dense Passage Retrieval for Open-Domain Question Answering Vladimir Karpukhin Barlas Oğuz Sewon Min Patrick Lewis Ledell Yu Wu Sergey Edunov Danqi Chen Wen-tau Yih RALM 134 3,676 0 10 Apr 2020
REALM: Retrieval-Augmented Language Model Pre-Training Kelvin Guu Kenton Lee Zora Tung Panupong Pasupat Ming-Wei Chang RALM 93 2,050 0 10 Feb 2020
Grounded Conversation Generation as Guided Traverses in Commonsense Knowledge Graphs Houyu Zhang Zhenghao Liu Chenyan Xiong Zhiyuan Liu 68 148 0 07 Nov 2019
BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension M. Lewis Yinhan Liu Naman Goyal Marjan Ghazvininejad Abdel-rahman Mohamed Omer Levy Veselin Stoyanov Luke Zettlemoyer AIMat VLM 141 10,720 0 29 Oct 2019
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer Colin Raffel Noam M. Shazeer Adam Roberts Katherine Lee Sharan Narang Michael Matena Yanqi Zhou Wei Li Peter J. Liu AIMat 270 19,824 0 23 Oct 2019
Does Gender Matter? Towards Fairness in Dialogue Systems Haochen Liu Jamell Dacon Wenqi Fan Hui Liu Zitao Liu Jiliang Tang 107 144 0 16 Oct 2019
Language Models as Knowledge Bases? Fabio Petroni Tim Rocktaschel Patrick Lewis A. Bakhtin Yuxiang Wu Alexander H. Miller Sebastian Riedel KELM AI4MH 531 2,639 0 03 Sep 2019
Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks Nils Reimers Iryna Gurevych 641 11,979 0 27 Aug 2019
Real-Time Open-Domain Question Answering with Dense-Sparse Phrase Index Minjoon Seo Jinhyuk Lee Tom Kwiatkowski Ankur P. Parikh Ali Farhadi Hannaneh Hajishirzi RALM 45 156 0 13 Jun 2019
BERT Post-Training for Review Reading Comprehension and Aspect-based Sentiment Analysis Hu Xu Bing-Quan Liu Lei Shu Philip S. Yu 35 690 0 03 Apr 2019
Graph Neural Networks for Social Recommendation Wenqi Fan Yao Ma Qing Li Yuan He Yue Zhao Jiliang Tang Dawei Yin 172 1,873 0 19 Feb 2019
Bilinear Supervised Hashing Based on 2D Image Features Yujuan Ding Wai Keung Wong Zhihui Lai Zheng Zhang 81 13 0 05 Jan 2019
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 961 93,936 0 11 Oct 2018
Reading Wikipedia to Answer Open-Domain Questions Danqi Chen Adam Fisch Jason Weston Antoine Bordes RALM 98 2,003 0 31 Mar 2017