BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Models

17 April 2021

Papers citing "BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Models"

50 / 572 papers shown

Title
A Setwise Approach for Effective and Highly Efficient Zero-shot Ranking with Large Language Models Shengyao Zhuang Honglei Zhuang Bevan Koopman Guido Zuccon 38 22 0 14 Oct 2023
Unsupervised Domain Adaption for Neural Information Retrieval Carlos Dominguez Jon Ander Campos Eneko Agirre Gorka Azkune 27 0 0 13 Oct 2023
EHI: End-to-end Learning of Hierarchical Index for Efficient Dense Retrieval Ramnath Kumar Anshul Mittal Nilesh Gupta Aditya Kusupati Inderjit Dhillon Prateek Jain 41 0 0 13 Oct 2023
Search-Adaptor: Embedding Customization for Information Retrieval Jinsung Yoon Sercan Ö. Arik Yanfei Chen Tomas Pfister 25 2 0 12 Oct 2023
Text Embeddings Reveal (Almost) As Much As Text John X. Morris Volodymyr Kuleshov Vitaly Shmatikov Alexander M. Rush RALM 28 96 0 10 Oct 2023
An Attribution Method for Siamese Encoders Lucas Moller Dmitry Nikolaev Sebastian Padó 27 4 0 09 Oct 2023
Augmented Embeddings for Custom Retrievals Anirudh Khatry Yasharth Bajpai Priyanshu Gupta Sumit Gulwani Ashish Tiwari RALM 20 1 0 09 Oct 2023
DORIS-MAE: Scientific Document Retrieval using Multi-level Aspect-based Queries Jianyou Wang Kaicheng Wang Xiaoyue Wang Prudhviraj Naidu Leon Bergen R. Paturi 45 11 0 07 Oct 2023
Policy-Gradient Training of Language Models for Ranking Ge Gao Jonathan D. Chang Claire Cardie Kianté Brantley Thorsten Joachims 32 2 0 06 Oct 2023
Exploring the evolution of research topics during the COVID-19 pandemic Francesco Invernici Anna Bernasconi S. Ceri 28 5 0 05 Oct 2023
Retrieval meets Long Context Large Language Models Peng Xu Ming-Yu Liu Xianchao Wu Lawrence C. McAfee Chen Zhu Zihan Liu Sandeep Subramanian Evelina Bakhturina M. Shoeybi Bryan Catanzaro RALM LRM 14 82 0 04 Oct 2023
Selecting which Dense Retriever to use for Zero-Shot Search Ekaterina Khramtsova Shengyao Zhuang Mahsa Baktashmotlagh Xi Wang Guido Zuccon 35 6 0 18 Sep 2023
When do Generative Query and Document Expansions Fail? A Comprehensive Study Across Methods, Retrievers, and Datasets Orion Weller Kyle Lo David Wadden Dawn J Lawrie Benjamin Van Durme Arman Cohan Luca Soldaini 49 19 0 15 Sep 2023
Annotating Data for Fine-Tuning a Neural Ranker? Current Active Learning Strategies are not Better than Random Selection Sophia Althammer Guido Zuccon Sebastian Hofstatter Suzan Verberne Allan Hanbury 39 4 0 12 Sep 2023
How Can Context Help? Exploring Joint Retrieval of Passage and Personalized Context H. Wan Hongkang Li Songtao Lu Xiao-Ping Cui Marina Danilevsky 16 1 0 26 Aug 2023
I3: Intent-Introspective Retrieval Conditioned on Instructions Kaihang Pan Juncheng Li Wenjie Wang Hao Fei Hongye Song Wei Ji Jun Lin Xiaozhong Liu Tat-Seng Chua Siliang Tang 46 5 0 19 Aug 2023
Black-box Adversarial Attacks against Dense Retrieval Models: A Multi-view Contrastive Learning Method Yuansan Liu Ruqing Zhang J. Guo Maarten de Rijke Wei Chen Yixing Fan Xueqi Cheng AAML 29 23 0 19 Aug 2023
Taken by Surprise: Contrast effect for Similarity Scores Thomas C. Bachlechner M. Martone M. Schillo 33 0 0 18 Aug 2023
Pre-training with Large Language Model-based Document Expansion for Dense Passage Retrieval Guangyuan Ma Xing Wu Peng Wang Zijia Lin Songlin Hu RALM 41 10 0 16 Aug 2023
Large Language Models for Information Retrieval: A Survey Yutao Zhu Huaying Yuan Shuting Wang Jiongnan Liu Wenhan Liu Chenlong Deng Haonan Chen Zhicheng Dou Ji-Rong Wen KELM 57 288 0 14 Aug 2023
Towards General Text Embeddings with Multi-stage Contrastive Learning Zehan Li Xin Zhang Yanzhao Zhang Dingkun Long Pengjun Xie Meishan Zhang 71 351 0 07 Aug 2023
Improving Domain-Specific Retrieval by NLI Fine-Tuning Roman Dusek A. Wawer Christopher Galias Lidia Wojciechowska 33 1 0 06 Aug 2023
Teaching Smaller Language Models To Generalise To Unseen Compositional Questions Tim Hartill N. Tan Michael Witbrock Patricia J. Riddle ReLM KELM LRM 34 2 0 02 Aug 2023
Lexically-Accelerated Dense Retrieval Hrishikesh Kulkarni Sean MacAvaney Nazli Goharian O. Frieder 11 11 0 31 Jul 2023
Retrieval-based Text Selection for Addressing Class-Imbalanced Data in Classification Sareh Ahmadi Aditya Shah Edward A. Fox 13 0 0 27 Jul 2023
Jina Embeddings: A Novel Set of High-Performance Sentence Embedding Models Michael Gunther Louis Milliken Jonathan Geuter Georgios Mastrapas Bo Wang Han Xiao RALM 50 30 0 20 Jul 2023
SPRINT: A Unified Toolkit for Evaluating and Demystifying Zero-shot Neural Sparse Retrieval Nandan Thakur Kexin Wang Iryna Gurevych Jimmy J. Lin 32 3 0 19 Jul 2023
Soft Prompt Tuning for Augmenting Dense Retrieval with Large Language Models Zhiyuan Peng Xuyang Wu Qifan Wang Yihan Fang VLM RALM 54 11 0 17 Jul 2023
A Survey on Evaluation of Large Language Models Yu-Chu Chang Xu Wang Jindong Wang Yuanyi Wu Linyi Yang ... Yue Zhang Yi-Ju Chang Philip S. Yu Qian Yang Xingxu Xie ELM LM&MA ALM 75 1,529 0 06 Jul 2023
Dense Retrieval Adaptation using Target Domain Description Helia Hashemi Yong Zhuang Sachith Sri Ram Kothur Srivas Prasad Edgar Meij W. Bruce Croft VLM 16 9 0 06 Jul 2023
MedCPT: Contrastive Pre-trained Transformers with Large-scale PubMed Search Logs for Zero-shot Biomedical Information Retrieval Qiao Jin Won Kim Qingyu Chen Donald C. Comeau Lana Yeganova John Wilbur Zhiyong Lu LM&MA MedIm 17 101 0 02 Jul 2023
Improving Multitask Retrieval by Promoting Task Specialization Wenzheng Zhang Chenyan Xiong K. Stratos Arnold Overwijk LRM 29 2 0 01 Jul 2023
Large Language Models are Effective Text Rankers with Pairwise Ranking Prompting Zhen Qin R. Jagerman Kai Hui Honglei Zhuang Junru Wu ... Tianqi Liu Jialu Liu Donald Metzler Xuanhui Wang Michael Bendersky ALM RALM 42 222 0 30 Jun 2023
Generative User-Experience Research for Developing Domain-specific Natural Language Processing Applications Anastasia Zhukova Lukas von Sperl Christian E. Matt Bela Gipp 21 1 0 28 Jun 2023
On the Robustness of Generative Retrieval Models: An Out-of-Distribution Perspective Yuansan Liu Ruqing Zhang J. Guo Wei Chen Xueqi Cheng 36 11 0 22 Jun 2023
Resources and Evaluations for Multi-Distribution Dense Information Retrieval Soumya Chatterjee Omar Khattab Simran Arora 30 0 0 21 Jun 2023
Resources for Brewing BEIR: Reproducible Reference Models and an Official Leaderboard Ehsan Kamalloo Nandan Thakur Carlos Lassance Xueguang Ma Jheng-Hong Yang Jimmy J. Lin 28 15 0 13 Jun 2023
Unsupervised Dense Retrieval with Relevance-Aware Contrastive Pre-Training Yibin Lei Liang Ding Yu Cao Changtong Zan Andrew Yates Dacheng Tao SSL 8 19 0 05 Jun 2023
Query Encoder Distillation via Embedding Alignment is a Strong Baseline Method to Boost Dense Retriever Online Efficiency Yuxuan Wang Hong Lyu 29 2 0 05 Jun 2023
SamToNe: Improving Contrastive Loss for Dual Encoder Retrieval Models with Same Tower Negatives Fedor Moiseev Gustavo Hernández Ábrego Peter Dornbach I. Zitouni Enrique Alfonseca Zhe Dong 37 6 0 05 Jun 2023
BEIR-PL: Zero Shot Information Retrieval Benchmark for the Polish Language Konrad Wojtasik Vadim Shishkin Kacper Wolowiec Arkadiusz Janz Maciej Piasecki 26 10 0 31 May 2023
Referral Augmentation for Zero-Shot Information Retrieval Michael Tang Shunyu Yao John Yang Karthik R. Narasimhan 30 3 0 24 May 2023
Contrastive Learning of Sentence Embeddings from Scratch Junlei Zhang Zhenzhong Lan Junxian He SSL 25 21 0 24 May 2023
Ranger: A Toolkit for Effect-Size Based Multi-Task Evaluation Mete Sertkan Sophia Althammer Sebastian Hofstatter 11 5 0 24 May 2023
Bridging Continuous and Discrete Spaces: Interpretable Sentence Representation Learning via Compositional Operations James Y. Huang Wenlin Yao Kaiqiang Song Hongming Zhang Muhao Chen Dong Yu 31 4 0 24 May 2023
NAIL: Lexical Retrieval Indices with Efficient Non-Autoregressive Decoders Livio Baldini Soares D. Gillick Jeremy R. Cole Tom Kwiatkowski 36 1 0 23 May 2023
Pre-training Multi-task Contrastive Learning Models for Scientific Literature Understanding Yu Zhang Hao Cheng Zhihong Shen Xiaodong Liu Yejiang Wang Jianfeng Gao 32 14 0 23 May 2023
BM25 Query Augmentation Learned End-to-End Xiaoyin Chen Sam Wiseman 33 1 0 23 May 2023
DAPR: A Benchmark on Document-Aware Passage Retrieval Kexin Wang Nils Reimers Iryna Gurevych 23 5 0 23 May 2023
Discrete Prompt Optimization via Constrained Generation for Zero-shot Re-ranker Sukmin Cho Soyeong Jeong Jeongyeon Seo Jong C. Park OffRL 65 23 0 23 May 2023