BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Models

17 April 2021

Papers citing "BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Models"

50 / 572 papers shown

Title
Query-driven Relevant Paragraph Extraction from Legal Judgments Santosh T.Y.S.S Elvin Quero Hernandez Matthias Grabmair AILaw 47 2 0 31 Mar 2024
Beyond One-Size-Fits-All: Multi-Domain, Multi-Task Framework for Embedding Model Selection Vivek Khetan 31 0 0 30 Mar 2024
Gecko: Versatile Text Embeddings Distilled from Large Language Models Jinhyuk Lee Zhuyun Dai Xiaoqi Ren Blair Chen Daniel Cer ... Aditya Kusupati Prateek Jain Siddhartha Reddy Jonnalagadda Ming-Wei Chang Iftekhar Naim RALM VLM SyDa 48 41 0 29 Mar 2024
Shallow Cross-Encoders for Low-Latency Retrieval Aleksandr V. Petrov Sean MacAvaney Craig Macdonald 16 3 0 29 Mar 2024
Beyond Borders: Investigating Cross-Jurisdiction Transfer in Legal Case Summarization Santosh T.Y.S.S Vatsal Venkatkrishna Saptarshi Ghosh Matthias Grabmair ELM 42 4 0 28 Mar 2024
Towards a Zero-Data, Controllable, Adaptive Dialog System Dirk Vath Lindsey Vanderlyn Ngoc Thang Vu 50 2 0 26 Mar 2024
InstUPR : Instruction-based Unsupervised Passage Reranking with Large Language Models Chao-Wei Huang Yun-Nung Chen LRM 52 0 0 25 Mar 2024
FollowIR: Evaluating and Teaching Information Retrieval Models to Follow Instructions Orion Weller Benjamin Chang Sean MacAvaney Kyle Lo Arman Cohan Benjamin Van Durme Dawn J Lawrie Luca Soldaini 63 29 0 22 Mar 2024
SPLADE-v3: New baselines for SPLADE Carlos Lassance Hervé Déjean Thibault Formal S. Clinchant 27 25 0 11 Mar 2024
Can Your Model Tell a Negation from an Implicature? Unravelling Challenges With Intent Encoders Yuwei Zhang Siffi Singh Sailik Sengupta Igor Shalyminov Hang Su Hwanjun Song Saab Mansour 37 2 0 07 Mar 2024
Improving Retrieval in Theme-specific Applications using a Corpus Topical Taxonomy SeongKu Kang Shivam Agarwal Bowen Jin Dongha Lee Hwanjo Yu Jiawei Han 65 6 0 07 Mar 2024
Backtracing: Retrieving the Cause of the Query Rose E. Wang Pawan Wirawarn Omar Khattab Noah D. Goodman Dorottya Demszky 50 1 0 06 Mar 2024
LLM-Oriented Retrieval Tuner Si Sun Hanqing Zhang Zhiyuan Liu Jie Bao Dawei Song RALM 44 0 0 04 Mar 2024
GuardT2I: Defending Text-to-Image Models from Adversarial Prompts Yijun Yang Ruiyuan Gao Xiao Yang Qiang Xu Qiang Xu 32 15 0 03 Mar 2024
Fine Tuning vs. Retrieval Augmented Generation for Less Popular Knowledge Heydar Soudani Evangelos Kanoulas Faegheh Hasibi 34 29 0 03 Mar 2024
LocalRQA: From Generating Data to Locally Training, Testing, and Deploying Retrieval-Augmented QA Systems Xiao Yu Yunan Lu Zhou Yu RALM 34 6 0 01 Mar 2024
Unsupervised Information Refinement Training of Large Language Models for Retrieval-Augmented Generation Shicheng Xu Liang Pang Mo Yu Fandong Meng Huawei Shen Xueqi Cheng Jie Zhou RALM 41 10 0 28 Feb 2024
Corpus-Steered Query Expansion with Large Language Models Yibin Lei Yu Cao Dinesh Manocha Tao Shen Andrew Yates 34 2 0 28 Feb 2024
JMLR: Joint Medical LLM and Retrieval Training for Enhancing Reasoning and Professional Question Answering Capability Junda Wang Zhichao Yang Zonghai Yao Hong-ye Yu BDL AI4MH LRM 40 31 0 27 Feb 2024
IR2: Information Regularization for Information Retrieval Jianyou Wang Kaicheng Wang Xiaoyue Wang Weili Cao R. Paturi Leon Bergen 46 1 0 25 Feb 2024
MultiContrievers: Analysis of Dense Retrieval Representations Seraphina Goldfarb-Tarrant Pedro Rodriguez Jane Dwivedi-Yu Patrick Lewis 30 1 0 24 Feb 2024
Query Augmentation by Decoding Semantics from Brain Signals Ziyi Ye Jingtao Zhan Qingyao Ai Yiqun Liu Maarten de Rijke Christina Lioma Tuukka Ruotsalo 52 0 0 24 Feb 2024
INSTRUCTIR: A Benchmark for Instruction Following of Information Retrieval Models Hanseok Oh Hyunji Lee Seonghyeon Ye Haebin Shin Hansol Jang Changwook Jun Minjoon Seo 46 19 0 22 Feb 2024
Assessing generalization capability of text ranking models in Polish Slawomir Dadas Malgorzata Grkebowiec 42 2 0 22 Feb 2024
BIRCO: A Benchmark of Information Retrieval Tasks with Complex Objectives Xiaoyue Wang Jianyou Wang Weili Cao Kaicheng Wang R. Paturi Leon Bergen 37 6 0 21 Feb 2024
Retrieval-Augmented Data Augmentation for Low-Resource Domain Tasks Minju Seo Jinheon Baek James Thorne Sung Ju Hwang RALM 37 9 0 21 Feb 2024
PIRB: A Comprehensive Benchmark of Polish Dense and Hybrid Text Retrieval Methods Slawomir Dadas Michal Perelkiewicz Rafal Poswiata 49 3 0 20 Feb 2024
Benchmarking Retrieval-Augmented Generation for Medicine Guangzhi Xiong Qiao Jin Zhiyong Lu Aidong Zhang RALM 83 151 0 20 Feb 2024
Effective and Efficient Conversation Retrieval for Dialogue State Tracking with Implicit Text Summaries Seanie Lee Jianpeng Cheng Joris Driesen Alexandru Coca Anders Johannsen RALM 48 1 0 20 Feb 2024
Towards Trustworthy Reranking: A Simple yet Effective Abstention Mechanism Hippolyte Gisserot-Boukhlef Manuel Faysse Emmanuel Malherbe C´eline Hudelot Pierre Colombo 34 2 0 20 Feb 2024
Understanding and Mitigating the Threat of Vec2Text to Dense Retrieval Systems Shengyao Zhuang Bevan Koopman Xiaoran Chu Guido Zuccon 28 1 0 20 Feb 2024
SoftQE: Learned Representations of Queries Expanded by LLMs Varad Pimpalkhute John Heyer Xusen Yin Sameer Gupta RALM 34 1 0 20 Feb 2024
Mafin: Enhancing Black-Box Embeddings with Model Augmented Fine-Tuning Mingtian Zhang Shawn Lan Peter Hayes David Barber 38 2 0 19 Feb 2024
FeB4RAG: Evaluating Federated Search in the Context of Retrieval Augmented Generation Shuai Wang Ekaterina Khramtsova Shengyao Zhuang Guido Zuccon 34 11 0 19 Feb 2024
Retrieval-Augmented Generation: Is Dense Passage Retrieval Retrieving? Benjamin Z. Reichman Larry Heck 24 2 0 16 Feb 2024
Multi-Query Focused Disaster Summarization via Instruction-Based Prompting Philipp Seeberger Korbinian Riedhammer HILM 19 1 0 14 Feb 2024
Pixel Sentence Representation Learning Chenghao Xiao Zhuoxu Huang Danlu Chen G. Hudson Yizhi Li Haoran Duan Chenghua Lin Jie Fu Jungong Han Noura Al Moubayed SSL 17 2 0 13 Feb 2024
PoisonedRAG: Knowledge Poisoning Attacks to Retrieval-Augmented Generation of Large Language Models Wei Zou Runpeng Geng Binghui Wang Jinyuan Jia SILM 39 45 1 12 Feb 2024
Benchmarking and Building Long-Context Retrieval Models with LoCo and M2-BERT Jon Saad-Falcon Daniel Y. Fu Simran Arora Neel Guha Christopher Ré RALM 40 16 0 12 Feb 2024
ExaRanker-Open: Synthetic Explanation for IR using Open-Source LLMs Fernando Ferraretto Thiago Laitz R. Lotufo Rodrigo Nogueira LRM 29 1 0 09 Feb 2024
Large Language Model Augmented Exercise Retrieval for Personalized Language Learning Austin Xu Will Monroe K. Bicknell RALM AI4Ed 35 4 0 08 Feb 2024
BGE M3-Embedding: Multi-Lingual, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillation Jianlv Chen Shitao Xiao Peitian Zhang Kun Luo Defu Lian Zheng Liu 115 333 0 05 Feb 2024
Domain Adaptation of Multilingual Semantic Search -- Literature Review Anna Bringmann Anastasia Zhukova VLM 41 0 0 05 Feb 2024
Approximate Attributions for Off-the-Shelf Siamese Transformers Lucas Moller Dmitry Nikolaev Sebastian Padó 29 4 0 05 Feb 2024
Nomic Embed: Training a Reproducible Long Context Text Embedder Zach Nussbaum John X. Morris Brandon Duderstadt Andriy Mulyar 27 96 0 02 Feb 2024
When Large Language Models Meet Vector Databases: A Survey Zhi Jing Yongye Su Yikun Han Bo Yuan Haiyun Xu Chunjiang Liu Kehai Chen Min Zhang 58 35 0 30 Jan 2024
ConFit: Improving Resume-Job Matching using Data Augmentation and Contrastive Learning Xiao Yu Jinzhong Zhang Zhou Yu 43 1 0 29 Jan 2024
DenoSent: A Denoising Objective for Self-Supervised Sentence Representation Learning Xinghao Wang Junliang He Pengyu Wang Yunhua Zhou Tianxiang Sun Xipeng Qiu AI4TS 30 3 0 24 Jan 2024
SciMMIR: Benchmarking Scientific Multi-modal Information Retrieval Siwei Wu Yizhi Li Kang Zhu Ge Zhang Yiming Liang ... Wenhu Chen Wenhao Huang Noura Al Moubayed Jie Fu Chenghua Lin 46 12 0 24 Jan 2024
DREditor: An Time-efficient Approach for Building a Domain-specific Dense Retrieval Model Chen Huang Duanyu Feng Wenqiang Lei Jiancheng Lv 59 1 0 23 Jan 2024