NeedleBench: Can LLMs Do Retrieval and Reasoning in Information-Dense Context?

v1v2 (latest)

NeedleBench: Can LLMs Do Retrieval and Reasoning in Information-Dense Context?

16 July 2024

ArXiv (abs)PDF HTML

Papers citing "NeedleBench: Can LLMs Do Retrieval and Reasoning in Information-Dense Context?"

6 / 6 papers shown

Title
InftyThink: Breaking the Length Limits of Long-Context Reasoning in Large Language Models Yuchen Yan Yongliang Shen Yuhang Liu Jin Jiang Hao Fei Jian Shao Yueting Zhuang LRM ReLM 129 9 0 09 Mar 2025
Needle Threading: Can LLMs Follow Threads through Near-Million-Scale Haystacks? Jonathan Roberts Kai Han Samuel Albanie LLMAG 441 1 0 07 Nov 2024
Understanding Synthetic Context Extension via Retrieval Heads Xinyu Zhao Fangcong Yin Greg Durrett 113 2 0 29 Oct 2024
Scaling Laws for Neural Language Models Jared Kaplan Sam McCandlish T. Henighan Tom B. Brown B. Chess R. Child Scott Gray Alec Radford Jeff Wu Dario Amodei 608 4,893 0 23 Jan 2020
R4C: A Benchmark for Evaluating RC Systems to Get the Right Answer for the Right Reason Naoya Inoue Pontus Stenetorp Kentaro Inui 138 59 0 10 Oct 2019
HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answering Zhilin Yang Peng Qi Saizheng Zhang Yoshua Bengio William W. Cohen Ruslan Salakhutdinov Christopher D. Manning RALM 188 2,689 0 25 Sep 2018