BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Models

17 April 2021

Papers citing "BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Models"

50 / 572 papers shown

Title
Graph-Based Re-ranking: Emerging Techniques, Limitations, and Opportunities Md Shahir Zaoad Niamat Zawad Priyanka Ranade Richard Krogman Latifur Khan James Holt 66 1 0 19 Mar 2025
Pseudo-Relevance Feedback Can Improve Zero-Shot LLM-Based Dense Retrieval Hang Li Xiao Wang Bevan Koopman Guido Zuccon 49 0 0 19 Mar 2025
OSCAR: Online Soft Compression And Reranking Maxime Louis Thibault Formal Hervé Déjean S. Clinchant 33 0 0 17 Mar 2025
Agent-Enhanced Large Language Models for Researching Political Institutions Joseph R. Loffredo Suyeol Yun LLMAG 77 0 0 14 Mar 2025
Collaborative Speculative Inference for Efficient LLM Inference Serving Luyao Gao Jianchun Liu Hongli Xu Xichong Zhang Yunming Liao Liusheng Huang 46 0 0 13 Mar 2025
Domain Adaptation for Japanese Sentence Embeddings with Contrastive Learning based on Synthetic Sentence Generation Zihao Chen H. Handa Miho Ohsaki Kimiaki Shirahama 59 0 0 12 Mar 2025
Exploiting Instruction-Following Retrievers for Malicious Information Retrieval Parishad BehnamGhader Nicholas Meade Siva Reddy 67 0 0 11 Mar 2025
GRITHopper: Decomposition-Free Multi-Hop Dense Retrieval Justus-Jonas Erker Nils Reimers Iryna Gurevych 63 0 0 10 Mar 2025
CtrlRAG: Black-box Adversarial Attacks Based on Masked Language Models in Retrieval-Augmented Language Generation Runqi Sui AAML 44 0 0 10 Mar 2025
Advancing Vietnamese Information Retrieval with Learning Objective and Benchmark Phu-Vinh Nguyen Minh-Nam Tran Long H. B. Nguyen D. Dinh 66 0 0 10 Mar 2025
Collapse of Dense Retrievers: Short, Early, and Literal Biases Outranking Factual Evidence Mohsen Fayyaz Ali Modarressi Hinrich Schuetze Nanyun Peng 62 0 0 06 Mar 2025
IFIR: A Comprehensive Benchmark for Evaluating Instruction-Following in Expert-Domain Information Retrieval Tingyu Song Guo Gan Mingsheng Shang Yilun Zhao VLM 67 0 0 06 Mar 2025
LLaVE: Large Language and Vision Embedding Models with Hardness-Weighted Contrastive Learning Zhibin Lan Liqiang Niu Fandong Meng Jie Zhou Jinsong Su VLM 69 2 0 04 Mar 2025
OrdRankBen: A Novel Ranking Benchmark for Ordinal Relevance in NLP Yan Wang Lingfei Qian Xueqing Peng J. Huang Dongji Feng 42 0 0 02 Mar 2025
The RAG Paradox: A Black-Box Attack Exploiting Unintentional Vulnerabilities in Retrieval-Augmented Generation Systems Chanwoo Choi Jinsoo Kim Sukmin Cho Soyeong Jeong Buru Chang 61 0 0 28 Feb 2025
Granite Embedding Models Parul Awasthy Aashka Trivedi Yulong Li Mihaela A. Bornea David D. Cox ... Sukriti Sharma Avirup Sil Kate Soule Arafat Sultan Radu Florian RALM 70 1 0 27 Feb 2025
From Retrieval to Generation: Comparing Different Approaches Abdelrahman Abdallah Jamshid Mozafari Bhawna Piryani Mohammed Ali Adam Jatowt RALM 62 0 0 27 Feb 2025
Teaching Dense Retrieval Models to Specialize with Listwise Distillation and LLM Data Augmentation Manveer Singh Tamber Suleman Kazi Vivek Sourabh Jimmy J. Lin 71 1 0 27 Feb 2025
Hierarchical corpus encoder: Fusing generative retrieval and dense indices Tongfei Chen Ankita Sharma Adam Pauls Benjamin Van Durme RALM 52 1 0 26 Feb 2025
DRAMA: Diverse Augmentation from Large Language Models to Smaller Dense Retrievers Xueguang Ma Xi Lin Barlas Oğuz Jimmy Lin Wen-tau Yih Xilun Chen RALM 88 3 0 25 Feb 2025
Rank1: Test-Time Compute for Reranking in Information Retrieval Orion Weller Kathryn Ricci Eugene Yang Andrew Yates Dawn J Lawrie Benjamin Van Durme ReLM AI4TS LRM 128 4 0 25 Feb 2025
ATEB: Evaluating and Improving Advanced NLP Tasks for Text Embedding Models Simeng Han Frank Palma Gomez Tu Vu Zefei Li Daniel Cer Hansi Zeng Chris Tar Arman Cohan Gustavo Hernández Ábrego 59 1 0 24 Feb 2025
Language Model Re-rankers are Steered by Lexical Similarities Lovisa Hagström Ercong Nie Ruben Halifa Helmut Schmid Richard Johansson Alexander Junge 48 0 0 24 Feb 2025
Mitigating Bias in RAG: Controlling the Embedder Taeyoun Kim Jacob Mitchell Springer Aditi Raghunathan Maarten Sap 58 1 0 24 Feb 2025
Scaling Sparse and Dense Retrieval in Decoder-Only LLMs Hansi Zeng Julian Killingback Hamed Zamani RALM 78 1 0 24 Feb 2025
LLM-QE: Improving Query Expansion by Aligning Large Language Models with Ranking Preferences Sijia Yao Pengcheng Huang Zhenghao Liu Yu Gu Yukun Yan S. Yu Ge Yu RALM 41 0 0 24 Feb 2025
A Survey of Model Architectures in Information Retrieval Zhichao Xu Fengran Mo Zhiqi Huang Crystina Zhang Puxuan Yu Bei Wang Jimmy J. Lin Vivek Srikumar KELM 3DV 61 2 0 21 Feb 2025
Vector-ICL: In-context Learning with Continuous Vector Representations Yufan Zhuang Chandan Singh Liyuan Liu Jingbo Shang Jianfeng Gao 54 3 0 21 Feb 2025
Learning More Effective Representations for Dense Retrieval through Deliberate Thinking Before Search Yifan Ji Zhipeng Xu Zhenghao Liu Yukun Yan S. Yu Yong Li Zhiyuan Liu Yu Gu Ge Yu Maosong Sun RALM 63 0 0 18 Feb 2025
Vendi-RAG: Adaptively Trading-Off Diversity And Quality Significantly Improves Retrieval Augmented Generation With LLMs Mohammad Reza Rezaei Adji Bousso Dieng VLM 51 2 0 16 Feb 2025
Improving Scientific Document Retrieval with Concept Coverage-based Query Set Generation SeongKu Kang Bowen Jin Wonbin Kweon Yu Zhang Dongha Lee J. Han Hwanjo Yu 61 0 0 16 Feb 2025
FinMTEB: Finance Massive Text Embedding Benchmark Yixuan Tang Yi Yang AIFin 66 0 0 16 Feb 2025
Can We Trust AI Benchmarks? An Interdisciplinary Review of Current Issues in AI Evaluation Maria Eriksson Erasmo Purificato Arman Noroozian Joao Vinagre Guillaume Chaslot Emilia Gomez David Fernandez Llorca ELM 139 1 0 10 Feb 2025
FactIR: A Real-World Zero-shot Open-Domain Retrieval Benchmark for Fact-Checking Venktesh V Vinay Setty HILM 54 0 0 09 Feb 2025
Hypencoder: Hypernetworks for Information Retrieval Julian Killingback Hansi Zeng Hamed Zamani 109 1 0 07 Feb 2025
Can Cross Encoders Produce Useful Sentence Embeddings? Haritha Ananthakrishnan Julian T Dolby Harsha Kokel Horst Samulowitz Kavitha Srinivas 66 0 0 05 Feb 2025
RankFlow: A Multi-Role Collaborative Reranking Workflow Utilizing Large Language Models Can Jin Hongwu Peng Anxiang Zhang Nuo Chen Jiahui Zhao ... Keqin Li Shuya Feng Kai Zhong Caiwen Ding Dimitris N. Metaxas 103 2 0 02 Feb 2025
Riddle Me This! Stealthy Membership Inference for Retrieval-Augmented Generation A. Naseh Yuefeng Peng Anshuman Suri Harsh Chaudhari Alina Oprea Amir Houmansadr SILM AAML RALM 54 0 0 01 Feb 2025
WARP: An Efficient Engine for Multi-Vector Retrieval Jan Luca Scheerer Matei A. Zaharia Christopher Potts Gustavo Alonso Omar Khattab 62 0 0 29 Jan 2025
ASRank: Zero-Shot Re-Ranking with Answer Scent for Document Retrieval Abdelrahman Abdallah Jamshid Mozafari Bhawna Piryani Adam Jatowt 34 2 0 28 Jan 2025
SynDL: A Large-Scale Synthetic Test Collection for Passage Retrieval Hossein A. Rahmani Xi Wang Emine Yilmaz Nick Craswell Bhaskar Mitra Paul Thomas 79 4 0 28 Jan 2025
Multi-stage Training of Bilingual Islamic LLM for Neural Passage Retrieval Vera Pavlova 52 2 0 20 Jan 2025
ACORD: An Expert-Annotated Retrieval Dataset for Legal Contract Drafting Steven H. Wang Maksim Zubkov Kexin Fan Sarah Harrell Yuyang Sun Wei Chen Andreas Plesner Roger Wattenhofer AILaw 54 1 0 11 Jan 2025
Are LLMs effective psychological assessors? Leveraging adaptive RAG for interpretable mental health screening through psychometric practice Federico Ravenda Seyed Ali Bahrainian Andrea Raballo Antonietta Mira Noriko Kando AI4MH 34 0 0 03 Jan 2025
VLM2Vec: Training Vision-Language Models for Massive Multimodal Embedding Tasks Ziyan Jiang Rui Meng Xinyi Yang Semih Yavuz Yingbo Zhou Wenhu Chen MLLM VLM 51 20 0 03 Jan 2025
Is ChatGPT Good at Search? Investigating Large Language Models as Re-Ranking Agents Weiwei Sun Lingyong Yan Xinyu Ma Shuaiqiang Wang Pengjie Ren Zhumin Chen Dawei Yin Z. Ren RALM ALM ELM LRM LM&MA 76 285 0 31 Dec 2024
GME: Improving Universal Multimodal Retrieval by Multimodal LLMs Xin Zhang Yanzhao Zhang Wen Xie Mingxin Li Ziqi Dai Dingkun Long Pengjun Xie Meishan Zhang Wenjie Li Hao Fei 116 8 0 22 Dec 2024
Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inference Benjamin Warner Antoine Chaffin Benjamin Clavié Orion Weller Oskar Hallström ... Tom Aarsen Nathan Cooper Griffin Adams Jeremy Howard Iacopo Poli 90 79 0 18 Dec 2024
Investigating Mixture of Experts in Dense Retrieval Effrosyni Sokli Pranav Kasela Georgios Peikos G. Pasi MoE 77 1 0 16 Dec 2024
Bilingual BSARD: Extending Statutory Article Retrieval to Dutch Ehsan Lotfi Nikolay Banar Nerses Yuzbashyan Walter Daelemans AILaw 71 0 0 10 Dec 2024