STaRK: Benchmarking LLM Retrieval on Textual and Relational Knowledge Bases

19 April 2024

Papers citing "STaRK: Benchmarking LLM Retrieval on Textual and Relational Knowledge Bases"

23 / 23 papers shown

Title
Multi-Field Adaptive Retrieval Millicent Li Tongfei Chen Benjamin Van Durme Patrick Xia 379 1 0 26 Oct 2024
Knowledge-Aware Query Expansion with Large Language Models for Textual and Relational Retrieval Yu Xia Junda Wu Sungchul Kim Tong Yu Ryan A. Rossi Haoliang Wang Julian McAuley 66 4 0 17 Oct 2024
Head-to-Tail: How Knowledgeable are Large Language Models (LLMs)? A.K.A. Will LLMs Replace Knowledge Graphs? Kai Sun Yongjun Xu Hanwen Zha Yue Liu Xinhsuai Dong AI4MH 77 147 0 20 Aug 2023
REPLUG: Retrieval-Augmented Black-Box Language Models Weijia Shi Sewon Min Michihiro Yasunaga Minjoon Seo Rich James M. Lewis Luke Zettlemoyer Wen-tau Yih RALM VLM KELM 125 634 0 30 Jan 2023
ColBERTv2: Effective and Efficient Retrieval via Lightweight Late Interaction Keshav Santhanam Omar Khattab Jon Saad-Falcon Christopher Potts Matei A. Zaharia 83 407 0 02 Dec 2021
QA-GNN: Reasoning with Language Models and Knowledge Graphs for Question Answering Michihiro Yasunaga Hongyu Ren Antoine Bosselut Percy Liang J. Leskovec RALM LMTD AI4MH LRM 55 593 0 13 Apr 2021
KQA Pro: A Dataset with Explicit Compositional Programs for Complex Question Answering over Knowledge Base S. Cao Jiaxin Shi Liangming Pan L. Nie Yutong Xiang Lei Hou Juanzi Li Bin He Hanwang Zhang LMTD CoGe 63 101 0 08 Jul 2020
Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrieval Lee Xiong Chenyan Xiong Ye Li Kwok-Fung Tang Jialin Liu Paul N. Bennett Junaid Ahmed Arnold Overwijk 114 1,224 0 01 Jul 2020
Open Graph Benchmark: Datasets for Machine Learning on Graphs Weihua Hu Matthias Fey Marinka Zitnik Yuxiao Dong Hongyu Ren Bowen Liu Michele Catasta J. Leskovec 303 2,730 0 02 May 2020
HybridQA: A Dataset of Multi-Hop Question Answering over Tabular and Textual Data Wenhu Chen Hanwen Zha Zhiyu Zoey Chen Wenhan Xiong Hong Wang Wenjie Wang 61 302 0 15 Apr 2020
REALM: Retrieval-Augmented Language Model Pre-Training Kelvin Guu Kenton Lee Zora Tung Panupong Pasupat Ming-Wei Chang RALM 122 2,095 0 10 Feb 2020
Learning to Retrieve Reasoning Paths over Wikipedia Graph for Question Answering Akari Asai Kazuma Hashimoto Hannaneh Hajishirzi R. Socher Caiming Xiong RALM KELM LRM 90 289 0 24 Nov 2019
TabFact: A Large-scale Dataset for Table-based Fact Verification Wenhu Chen Hongmin Wang Jianshu Chen Yunkai Zhang Hong Wang Shiyang Li Xiyou Zhou William Yang Wang LMTD 97 506 0 05 Sep 2019
End-to-End Open-Domain Question Answering with BERTserini Wei Yang Yuqing Xie Aileen Lin Xingyu Li Luchen Tan Kun Xiong Ming Li Jimmy J. Lin RALM 102 495 0 05 Feb 2019
HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answering Zhilin Yang Peng Qi Saizheng Zhang Yoshua Bengio William W. Cohen Ruslan Salakhutdinov Christopher D. Manning RALM 166 2,647 0 25 Sep 2018
Spider: A Large-Scale Human-Labeled Dataset for Complex and Cross-Domain Semantic Parsing and Text-to-SQL Task Tao Yu Rui Zhang Kai-Chou Yang Michihiro Yasunaga Dongxu Wang ... Irene Li Qingning Yao Shanelle Roman Zilin Zhang Dragomir R. Radev RALM 92 1,231 0 24 Sep 2018
The Web as a Knowledge-base for Answering Complex Questions Alon Talmor Jonathan Berant 85 582 0 18 Mar 2018
Constructing Datasets for Multi-hop Reading Comprehension Across Documents Johannes Welbl Pontus Stenetorp Sebastian Riedel SyDa RALM 93 511 0 17 Oct 2017
TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehension Mandar Joshi Eunsol Choi Daniel S. Weld Luke Zettlemoyer RALM 204 2,646 0 09 May 2017
SearchQA: A New Q&A Dataset Augmented with Context from a Search Engine Matthew Dunn Levent Sagun Mike Higgins V. U. Güney Volkan Cirik Kyunghyun Cho RALM 92 456 0 18 Apr 2017
NewsQA: A Machine Comprehension Dataset Adam Trischler Tong Wang Xingdi Yuan Justin Harris Alessandro Sordoni Philip Bachman Kaheer Suleman 98 893 0 29 Nov 2016
MS MARCO: A Human Generated MAchine Reading COmprehension Dataset Payal Bajaj Daniel Fernando Campos Nick Craswell Li Deng Jianfeng Gao ... Mir Rosenberg Xia Song Alina Stoica Saurabh Tiwary Tong Wang RALM 139 2,724 0 28 Nov 2016
SQuAD: 100,000+ Questions for Machine Comprehension of Text Pranav Rajpurkar Jian Zhang Konstantin Lopyrev Percy Liang RALM 274 8,127 0 16 Jun 2016