BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Models

17 April 2021

Papers citing "BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Models"

50 / 570 papers shown

Title
LDIR: Low-Dimensional Dense and Interpretable Text Embeddings with Relative Representations Yile Wang Zhanyu Shen Hui Huang 26 0 0 15 May 2025
POISONCRAFT: Practical Poisoning of Retrieval-Augmented Generation for Large Language Models Yangguang Shao Xinjie Lin Haozheng Luo Chengshang Hou G. Xiong Jiahao Yu Junzheng Shi SILM 52 0 0 10 May 2025
QBR: A Question-Bank-Based Approach to Fine-Grained Legal Knowledge Retrieval for the General Public Mingruo Yuan Ben Kao Tien-Hsuan Wu AILaw 76 0 0 08 May 2025
QBD-RankedDataGen: Generating Custom Ranked Datasets for Improving Query-By-Document Search Using LLM-Reranking with Reduced Human Effort Sriram Gopalakrishnan Sunandita Patra 29 0 0 07 May 2025
A Reasoning-Focused Legal Retrieval Benchmark Lucia Zheng Neel Guha Javokhir Arifov Sarah Zhang Michal Skreta Christopher D. Manning Peter Henderson Daniel E. Ho AILaw RALM ELM 94 3 0 06 May 2025
Rational Retrieval Acts: Leveraging Pragmatic Reasoning to Improve Sparse Retrieval Arthur Satouf Gabriel Ben Zenou Benjamin Piwowarski Habiboulaye Amadou Boubacar Pablo Piantanida 27 0 0 06 May 2025
Tevatron 2.0: Unified Document Retrieval Toolkit across Scale, Language, and Modality Xueguang Ma Luyu Gao Shengyao Zhuang Jiaqi Samantha Zhan Jamie Callan Jimmy Lin 142 0 0 05 May 2025
Investigating Task Arithmetic for Zero-Shot Information Retrieval Marco Braga Pranav Kasela Alessandro Raganato G. Pasi RALM 66 0 0 01 May 2025
TartuNLP at SemEval-2025 Task 5: Subject Tagging as Two-Stage Information Retrieval Aleksei Dorkin Kairit Sirts 53 1 0 30 Apr 2025
TurboQuant: Online Vector Quantization with Near-optimal Distortion Rate A. Zandieh Majid Daliri Majid Hadian Vahab Mirrokni MQ 74 0 0 28 Apr 2025
Efficient Domain-adaptive Continual Pretraining for the Process Industry in the German Language Anastasia Zhukova Christian E. Matt Terry Ruas Bela Gipp CLL VLM 98 0 0 28 Apr 2025
Toward Generalizable Evaluation in the LLM Era: A Survey Beyond Benchmarks Yixin Cao Shibo Hong Xuzhao Li Jiahao Ying Yubo Ma ... Juanzi Li Aixin Sun Xuanjing Huang Tat-Seng Chua Tianwei Zhang ALM ELM 86 2 0 26 Apr 2025
Generative Product Recommendations for Implicit Superlative Queries Kaustubh D. Dhole Nikhita Vedula Saar Kuzi Giuseppe Castellucci Eugene Agichtein S. Malmasi 52 0 0 26 Apr 2025
Unsupervised Corpus Poisoning Attacks in Continuous Space for Dense Retrieval Yongkang Li Panagiotis Eustratiadis Simon Lupart Evangelos Kanoulas AAML 48 0 0 24 Apr 2025
CLIRudit: Cross-Lingual Information Retrieval of Scientific Documents Francisco Valentini Diego Kozlowski Vincent Larivière 25 0 0 22 Apr 2025
ColBERT-serve: Efficient Multi-Stage Memory-Mapped Scoring Kaili Huang Thejas Venkatesh Uma Dingankar Antonio Mallia Daniel Campos ... Matei A. Zaharia Kwabena Boahen Omar Khattab Saarthak Sarup Keshav Santhanam 37 0 0 21 Apr 2025
$Exploring $\ell_0$ Sparsification for Inference-free Sparse Retrievers$ Exploring $\ell_0$ Sparsification for Inference-free Sparse Retrievers Xinjie Shen Zhichao Geng Yang Yang 19 0 0 21 Apr 2025
Don't Retrieve, Generate: Prompting LLMs for Synthetic Training Data in Dense Retrieval Aarush Sinha RALM 73 0 0 20 Apr 2025
Hypothetical Documents or Knowledge Leakage? Rethinking LLM-based Query Expansion Yejun Yoon Jaeyoon Jung Seunghyun Yoon Kunwoo Park 27 0 0 19 Apr 2025
Towards Lossless Token Pruning in Late-Interaction Retrieval Models Yuxuan Zong Benjamin Piwowarski 39 0 0 17 Apr 2025
Building Russian Benchmark for Evaluation of Information Retrieval Models Grigory Kovalev M. Tikhomirov Evgeny Kozhevnikov Max Kornilov Natalia Loukachevitch 29 0 0 17 Apr 2025
FreshStack: Building Realistic Benchmarks for Evaluating Retrieval on Technical Documents Nandan Thakur Jimmy J. Lin Sam Havens Michael Carbin Omar Khattab Andrew Drozdov 44 2 0 17 Apr 2025
CSPLADE: Learned Sparse Retrieval with Causal Language Models Zhichao Xu Aosong Feng Yijun Tian Haibo Ding Lin Leee Cheong RALM 40 0 0 15 Apr 2025
MIEB: Massive Image Embedding Benchmark Chenghao Xiao Isaac Chung Imene Kerboua Jamie Stirling Xin Zhang Márton Kardos Roman Solomatin Noura Al Moubayed K. Enevoldsen Niklas Muennighoff VLM 37 0 0 14 Apr 2025
Enhancing Document Retrieval for Curating N-ary Relations in Knowledge Bases Xing David Wang Ulf Leser 26 0 0 14 Apr 2025
Constrained Auto-Regressive Decoding Constrains Generative Retrieval Shiguang Wu Z. Z. Ren Xin Xin Jiyuan Yang M. Zhang Z. Chen Maarten de Rijke Pengjie Ren RALM 36 0 0 14 Apr 2025
MURR: Model Updating with Regularized Replay for Searching a Document Stream Eugene Yang Nicola Tonellotto Dawn J Lawrie Sean MacAvaney James Mayfield Douglas W. Oard Scott Miller KELM 33 0 0 14 Apr 2025
SynthTRIPs: A Knowledge-Grounded Framework for Benchmark Query Generation for Personalized Tourism Recommenders Ashmi Banerjee Adithi Satish Fitri Nur Aisyah Wolfgang Wörndl Yashar Deldjoo AI4TS 33 0 0 12 Apr 2025
Efficient and Asymptotically Unbiased Constrained Decoding for Large Language Models Haotian Ye Himanshu Jain Chong You A. Suresh Haowei Lin James Zou Felix X. Yu 33 0 0 12 Apr 2025
HeteRAG: A Heterogeneous Retrieval-augmented Generation Framework with Decoupled Knowledge Representations Peiru Yang Xintian Li Zhiyang Hu Jiapeng Wang Jinhua Yin ... Lizhi He Shuai Yang Shangguang Wang Yongfeng Huang Tao Qi 23 0 0 12 Apr 2025
Cat, Rat, Meow: On the Alignment of Language Model and Human Term-Similarity Judgments Lorenz Linhardt Tom Neuhäuser Lenka Tětková Oliver Eberle ALM AI4TS 42 0 0 10 Apr 2025
LLM4Ranking: An Easy-to-use Framework of Utilizing Large Language Models for Document Reranking Qi Liu Haozhe Duan Yiqun Chen Quanfeng Lu Weiwei Sun Jiaxin Mao 32 0 0 10 Apr 2025
ConceptCarve: Dynamic Realization of Evidence Eylon Caplan Dan Goldwasser 32 0 0 09 Apr 2025
Leveraging LLMs for Utility-Focused Annotation: Reducing Manual Effort for Retrieval and RAG Hengran Zhang Minghao Tang Keping Bi J. Guo Shihao Liu Daiting Shi Dawei Yin Xueqi Cheng 19 0 0 07 Apr 2025
Unleashing the Power of LLMs in Dense Retrieval with Query Likelihood Modeling Hengran Zhang Keping Bi J. Guo Xiaojie Sun Shihao Liu Daiting Shi Dawei Yin Xueqi Cheng RALM 141 0 0 07 Apr 2025
Practical Poisoning Attacks against Retrieval-Augmented Generation Baolei Zhang Y. Chen Minghong Fang Zhuqing Liu Lihai Nie Tong Li Zheli Liu SILM AAML 64 0 0 04 Apr 2025
Adapting Large Language Models for Multi-Domain Retrieval-Augmented-Generation Alexandre Misrahi Nadezhda Chirkova Maxime Louis Vassilina Nikoulina RALM 85 0 0 03 Apr 2025
LLM-VPRF: Large Language Model Based Vector Pseudo Relevance Feedback Hang Li Shengyao Zhuang Bevan Koopman Guido Zuccon VLM 46 0 0 02 Apr 2025
Efficient Constant-Space Multi-Vector Retrieval Sean MacAvaney Antonio Mallia Nicola Tonellotto 30 1 0 02 Apr 2025
Training a Utility-based Retriever Through Shared Context Attribution for Retrieval-Augmented Language Models Yilong Xu Jinhua Gao Xiaoming Yu Yuanhai Xue Baolong Bi Huawei Shen Xueqi Cheng RALM 64 0 0 01 Apr 2025
Information Retrieval for Climate Impact Maarten de Rijke Bart van den Hurk Flora Salim Alaa Al Khourdajie Nan Bai ... Edmund Totin Andrew Trotman Ramamurthy Valavandan Dereje Workneh Yangxinyu Xie SyDa 59 1 0 01 Apr 2025
CoRanking: Collaborative Ranking with Small and Large Ranking Agents Wenhan Liu Xinyu Ma Bo Li Lixin Su S. Wang Dawei Yin Zhicheng Dou ALM 44 0 0 30 Mar 2025
Imagine All The Relevance: Scenario-Profiled Indexing with Knowledge Expansion for Dense Retrieval Sangam Lee Ryang Heo SeongKu Kang Dongha Lee RALM 56 1 0 29 Mar 2025
Beyond Contrastive Learning: Synthetic Data Enables List-wise Training with Multiple Levels of Relevance Reza Esfandiarpoor George Zerveas Ruochen Zhang Macton Mgonzo Carsten Eickhoff Stephen H. Bach SyDa 50 0 0 29 Mar 2025
Robust-IR @ SIGIR 2025: The First Workshop on Robust Information Retrieval Y. Liu Haya Nachimovsky Ruqing Zhang Oren Kurland J. Guo Moshe Tennenholtz OffRL 48 0 0 24 Mar 2025
Enhancing Retrieval Systems with Inference-Time Logical Reasoning Felix Faltings Wei Wei Yujia Bao LRM 41 0 0 22 Mar 2025
EqualizeIR: Mitigating Linguistic Biases in Retrieval Models Jiali Cheng Hadi Amiri 36 1 0 22 Mar 2025
Model Risk Management for Generative AI In Financial Institutions Anwesha Bhattacharyya Ye Yu Hanyu Yang Rahul Singh Tarun Joshi Jie Chen Kiran Yalavarthy AIFin MedIm 44 0 0 19 Mar 2025
Pseudo-Relevance Feedback Can Improve Zero-Shot LLM-Based Dense Retrieval Hang Li Xiao Wang Bevan Koopman Guido Zuccon 46 0 0 19 Mar 2025
Graph-Based Re-ranking: Emerging Techniques, Limitations, and Opportunities Md Shahir Zaoad Niamat Zawad Priyanka Ranade Richard Krogman Latifur Khan James Holt 61 1 0 19 Mar 2025