BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Models

17 April 2021

Papers citing "BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Models"

50 / 572 papers shown

Title
Adaptive Two-Phase Finetuning LLMs for Japanese Legal Text Retrieval Quang Hoang Trung Nguyen Van Hoang Phuc Le Trung Hoang Quang Huu Hieu Vo Nguyen Le Duy AILaw RALM 81 0 0 03 Dec 2024
DynRank: Improving Passage Retrieval with Dynamic Zero-Shot Prompting Based on Question Classification Abdelrahman Abdallah Jamshid Mozafari Bhawna Piryani Mohammed M. Abdelgwad Adam Jatowt 74 1 0 30 Nov 2024
ChemTEB: Chemical Text Embedding Benchmark, an Overview of Embedding Models Performance & Efficiency on a Specific Domain Ali Shiraee Kasmaee Mohammad Khodadad Mohammad Arshi Saloot Nick Sherck Stephen Dokas H. Mahyar Soheila Samiee ELM 204 0 0 30 Nov 2024
CodeXEmbed: A Generalist Embedding Model Family for Multiligual and Multi-task Code Retrieval Y. Liu Rui Meng Chenyu You Silvio Savarese Caiming Xiong Yingbo Zhou Semih Yavuz 94 3 0 19 Nov 2024
BoolQuestions: Does Dense Retrieval Understand Boolean Logic in Language? Zongmeng Zhang Jinhua Zhu Wengang Zhou Xiang Qi Peng Zhang Yiming Li 70 1 0 19 Nov 2024
Drowning in Documents: Consequences of Scaling Reranker Inference Mathew Jacob Erik Lindgren Matei A. Zaharia Michael Carbin Omar Khattab Andrew Drozdov OffRL 76 4 0 18 Nov 2024
LLM-Assisted Relevance Assessments: When Should We Ask LLMs for Help? Rikiya Takehi E. Voorhees Tetsuya Sakai I. Soboroff 135 3 0 11 Nov 2024
Self-Calibrated Listwise Reranking with Large Language Models Ruiyang Ren Yuhao Wang K. Zhou Wayne Xin Zhao Luu Anh Tuan Jing Liu Zhicheng Dou Tat-Seng Chua LRM KELM 43 0 0 07 Nov 2024
A Natural Language Processing Approach to Support Biomedical Data Harmonization: Leveraging Large Language Models Zexu Li Suraj P. Prabhu Zachary T. Popp Shubhi S. Jain Vijetha Balakundi T. F. Ang R. Au Jinying Chen 27 0 0 05 Nov 2024
MM-Embed: Universal Multimodal Retrieval with Multimodal LLMs Sheng-Chieh Lin Chankyu Lee M. Shoeybi Jimmy J. Lin Bryan Catanzaro Ming-Yu Liu 70 12 0 04 Nov 2024
Matchmaker: Self-Improving Large Language Model Programs for Schema Matching Nabeel Seedat M. Schaar 39 2 0 31 Oct 2024
Zero-Shot Dense Retrieval with Embeddings from Relevance Feedback Nour Jedidi Yung-Sung Chuang Leslie Shing James R. Glass RALM 31 0 0 28 Oct 2024
Large Language Model Benchmarks in Medical Tasks Lawrence K. Q. Yan Ming Li Yuyao Zhang Caitlyn Heqi Yin Cheng Fei ... Ziqian Bi Pohsun Feng Keyu Chen Junyu Liu Qian Niu LM&MA AI4MH 53 6 0 28 Oct 2024
Deep Learning Based Dense Retrieval: A Comparative Study Ming Zhong Zhizhi Wu Nanako Honda AAML 16 0 0 27 Oct 2024
RARe: Retrieval Augmented Retrieval with In-Context Examples Atula Tejaswi Yoonsang Lee Sujay Sanghavi Eunsol Choi RALM LRM 25 1 0 26 Oct 2024
AutoMIR: Effective Zero-Shot Medical Information Retrieval without Relevance Labels Lei Li Xiangxu Zhang Xiao Zhou Z. Liu VLM RALM 48 2 0 26 Oct 2024
UniHGKR: Unified Instruction-aware Heterogeneous Knowledge Retrievers Dehai Min Zhiyang Xu Guilin Qi Lifu Huang Chenyu You RALM 75 1 0 26 Oct 2024
Taxonomy-guided Semantic Indexing for Academic Paper Search SeongKu Kang Yunyi Zhang Pengcheng Jiang Dongha Lee J. Han Hwanjo Yu 36 4 0 25 Oct 2024
Dialog2Flow: Pre-training Soft-Contrastive Action-Driven Sentence Embeddings for Automatic Dialog Flow Extraction Sergio Burdisso S. Madikeri P. Motlícek 39 1 0 24 Oct 2024
Link, Synthesize, Retrieve: Universal Document Linking for Zero-Shot Information Retrieval Dae Yon Hwang Bilal Taha Harshit Pande Yaroslav Nechaev SyDa 33 0 0 24 Oct 2024
HyQE: Ranking Contexts with Hypothetical Query Embeddings Weichao Zhou Jiaxin Zhang Hilaf Hasson Anu Singh Wenchao Li RALM 30 1 0 20 Oct 2024
Backdoored Retrievers for Prompt Injection Attacks on Retrieval Augmented Generation of Large Language Models Cody Clop Yannick Teglia AAML SILM RALM 47 2 0 18 Oct 2024
MIRAGE-Bench: Automatic Multilingual Benchmark Arena for Retrieval-Augmented Generation Systems Nandan Thakur Suleman Kazi Ge Luo Jimmy J. Lin Amin Ahmad VLM RALM 28 7 0 17 Oct 2024
Exploiting LLMs' Reasoning Capability to Infer Implicit Concepts in Legal Information Retrieval Hai-Long Nguyen Tan-Minh Nguyen Duc-Minh Nguyen Thi-Hai-Yen Vuong Ha-Thanh Nguyen X. Phan AILaw LRM 29 1 0 16 Oct 2024
On Debiasing Text Embeddings Through Context Injection Thomas Uriot 37 0 0 14 Oct 2024
VisRAG: Vision-based Retrieval-augmented Generation on Multi-modality Documents S. Yu C. Tang Bokai Xu Junbo Cui Junhao Ran ... Zhenghao Liu Shuo Wang Xu Han Zhiyuan Liu Maosong Sun VLM 39 23 0 14 Oct 2024
Astute RAG: Overcoming Imperfect Retrieval Augmentation and Knowledge Conflicts for Large Language Models Fei Wang Xingchen Wan Ruoxi Sun Jiefeng Chen Sercan Ö. Arık RALM 34 7 0 09 Oct 2024
ReasoningRank: Teaching Student Models to Rank through Reasoning-Based Knowledge Distillation Yuelyu Ji Zhuochun Li Rui Meng Daqing He LRM 31 3 0 07 Oct 2024
Passage Retrieval of Polish Texts Using OKAPI BM25 and an Ensemble of Cross Encoders Jakub Pokrywka 21 1 0 06 Oct 2024
Streamlining Conformal Information Retrieval via Score Refinement Yotam Intrator Ori Kelner Regev Cohen Roman Goldenberg Ehud Rivlin Daniel Freedman 29 0 0 03 Oct 2024
Contextual Document Embeddings John X. Morris Alexander M. Rush 29 7 0 03 Oct 2024
Attention in Large Language Models Yields Efficient Zero-Shot Re-Rankers Shijie Chen Bernal Jiménez Gutiérrez Yu Su 31 4 0 03 Oct 2024
PairDistill: Pairwise Relevance Distillation for Dense Retrieval Chao-Wei Huang Yun-Nung Chen 35 1 0 02 Oct 2024
Do We Need Domain-Specific Embedding Models? An Empirical Investigation Yixuan Tang Yi Yang AIFin 50 3 0 27 Sep 2024
Few-shot Prompting for Pairwise Ranking: An Effective Non-Parametric Retrieval Model Nilanjan Sinhababu Andrew Parry Debasis Ganguly D. Samanta Pabitra Mitra 36 3 0 26 Sep 2024
Open-World Evaluation for Retrieving Diverse Perspectives Hung-Ting Chen Eunsol Choi 35 0 0 26 Sep 2024
Disentangling Questions from Query Generation for Task-Adaptive Retrieval Yoonsang Lee Minsoo Kim Seung-won Hwang RALM 28 0 0 25 Sep 2024
IRSC: A Zero-shot Evaluation Benchmark for Information Retrieval through Semantic Comprehension in Retrieval-Augmented Generation Scenarios Hai Lin Shaoxiong Zhan Junyou Su Haitao Zheng Hui Wang RALM 34 1 0 24 Sep 2024
Making Text Embedders Few-Shot Learners Chaofan Li Minghao Qin Shitao Xiao Jianlyu Chen Kun Luo Yingxia Shao Defu Lian Zheng Liu 35 23 0 24 Sep 2024
Reducing the Footprint of Multi-Vector Retrieval with Minimal Performance Impact via Token Pooling Benjamin Clavié Antoine Chaffin Griffin Adams 36 2 0 23 Sep 2024
The Ability of Large Language Models to Evaluate Constraint-satisfaction in Agent Responses to Open-ended Requests Lior Madmoni Amir Zait Ilia Labzovsky Danny Karmon ELM 33 0 0 22 Sep 2024
Time Awareness in Large Language Models: Benchmarking Fact Recall Across Time David Herel Vojtech Bartek Jiri Jirak Tomáš Mikolov 50 3 0 20 Sep 2024
Enhancing Unsupervised Sentence Embeddings via Knowledge-Driven Data Augmentation and Gaussian-Decayed Contrastive Learning Peichao Lai Zhengfeng Zhang Wentao Zhang Fangcheng Fu Bin Cui 33 0 0 19 Sep 2024
Promptriever: Instruction-Trained Retrievers Can Be Prompted Like Language Models Orion Weller Benjamin Van Durme Dawn J Lawrie Ashwin Paranjape Yuhao Zhang Jack Hessel LRM RALM 57 17 0 17 Sep 2024
GenCRF: Generative Clustering and Reformulation Framework for Enhanced Intent-Driven Information Retrieval Wonduk Seo Haojie Zhang Yueyang Zhang Changhao Zhang Songyao Duan Lixin Su Daiting Shi Jiashu Zhao Dawei Yin 42 1 0 17 Sep 2024
A Compressive Memory-based Retrieval Approach for Event Argument Extraction Wanlong Liu Enqi Zhang Li Zhou DingYi Zeng Shaohuan Cheng Chen Zhang Malu Zhang Wenyu Chen RALM 45 0 0 14 Sep 2024
Enhancing Q&A Text Retrieval with Ranking Models: Benchmarking, fine-tuning and deploying Rerankers for RAG Gabriel de Souza P. Moreira Ronay Ak Benedikt Schifferer Mengyao Xu Radek Osmulski Even Oldridge 29 4 0 12 Sep 2024
Extracting Paragraphs from LLM Token Activations Nicholas Pochinkov Angelo Benoit Lovkush Agarwal Zainab Ali Majid Lucile Ter-Minassian 32 1 0 10 Sep 2024
MessIRve: A Large-Scale Spanish Information Retrieval Dataset Francisco Valentini Viviana Cotik D. Furman Ivan Bercovich Edgar Altszyler Juan Manuel Pérez 53 1 0 09 Sep 2024
Late Chunking: Contextual Chunk Embeddings Using Long-Context Embedding Models Michael Gunther Isabelle Mohr Daniel James Williams Bo Wang Han Xiao 30 9 0 07 Sep 2024