BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Models

17 April 2021

Papers citing "BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Models"

50 / 572 papers shown

Title
Text Embedding Inversion Security for Multilingual Language Models Yiyi Chen Heather Lent Johannes Bjerva 27 14 0 22 Jan 2024
Detecting Multimedia Generated by Large AI Models: A Survey Li Lin Neeraj Gupta Yue Zhang Hainan Ren Chun-Hao Liu Feng Ding Xin Wang Xin Li Luisa Verdoliva Shu Hu 88 58 0 22 Jan 2024
Drop your Decoder: Pre-training with Bag-of-Word Prediction for Dense Passage Retrieval Guangyuan Ma Xing Wu Zijia Lin Songlin Hu 31 4 0 20 Jan 2024
JustiLM: Few-shot Justification Generation for Explainable Fact-Checking of Real-world Claims Fengzhu Zeng Wei Gao 41 15 0 16 Jan 2024
The Faiss library Matthijs Douze Alexandr Guzhva Chengqi Deng Jeff Johnson Gergely Szilvasy Pierre-Emmanuel Mazaré Maria Lomeli Lucas Hosseini Hervé Jégou 44 147 0 16 Jan 2024
INTERS: Unlocking the Power of Large Language Models in Search with Instruction Tuning Yutao Zhu Peitian Zhang Chenghao Zhang Yifei Chen Binyu Xie Zheng Liu Ji-Rong Wen Zhicheng Dou 21 15 0 12 Jan 2024
NeRFmentation: NeRF-based Augmentation for Monocular Depth Estimation Casimir Feldmann Niall Siegenheim Nikolas Hars Lovro Rabuzin Mert Ertugrul Luca Wolfart Marc Pollefeys Z. Bauer Martin R. Oswald 37 4 0 08 Jan 2024
A Joint-Reasoning based Disease Q&A System Prakash Chandra Sukhwal Vaibhav Rajan A. Kankanhalli LM&MA AI4MH 18 0 0 06 Jan 2024
Improving Text Embeddings with Large Language Models Liang Wang Nan Yang Xiaolong Huang Linjun Yang Rangan Majumder Furu Wei SyDa 40 162 0 31 Dec 2023
Structured Packing in LLM Training Improves Long Context Utilization Konrad Staniszewski Szymon Tworkowski Sebastian Jaszczur Yu Zhao Henryk Michalewski Lukasz Kuciñski Piotr Milo's 41 13 0 28 Dec 2023
AHAM: Adapt, Help, Ask, Model -- Harvesting LLMs for literature mining Boshko Koloski Nada Lavrac B. Cestnik Senja Pollak Blaž Škrlj Andrej Kastrin 32 6 0 25 Dec 2023
Making Large Language Models A Better Foundation For Dense Retrieval Chaofan Li Zheng Liu Shitao Xiao Yingxia Shao RALM 40 35 0 24 Dec 2023
Learning Human-like Representations to Enable Learning Human Values Andrea Wynn Ilia Sucholutsky Thomas Griffiths 24 4 0 21 Dec 2023
Pipeline and Dataset Generation for Automated Fact-checking in Almost Any Language Jan Drchal Herbert Ullrich Tomás Mlynár Václav Moravec HILM 29 1 0 15 Dec 2023
IndicIRSuite: Multilingual Dataset and Neural Information Models for Indian Languages Saiful Haq Ashutosh Sharma Pushpak Bhattacharyya 26 2 0 15 Dec 2023
Dense X Retrieval: What Retrieval Granularity Should We Use? Tong Chen Hongwei Wang Sihao Chen Wenhao Yu Kaixin Ma Xinran Zhao Hongming Zhang Dong Yu 30 30 0 11 Dec 2023
Rank-without-GPT: Building GPT-Independent Listwise Rerankers on Open-Source Large Language Models Xinyu Crystina Zhang Sebastian Hofstatter Patrick Lewis Raphael Tang Jimmy J. Lin LRM KELM ELM RALM ALM 40 6 0 05 Dec 2023
Leveraging Domain Adaptation and Data Augmentation to Improve Quránic IR in English and Arabic Vera Pavlova 23 2 0 05 Dec 2023
Event-driven Real-time Retrieval in Web Search Nan Yang Shusen Zhang Yannan Zhang Xiaoling Bai Hualong Deng Tianhua Zhou Jin Ma 21 1 0 01 Dec 2023
UniIR: Training and Benchmarking Universal Multimodal Information Retrievers Cong Wei Yang Chen Haonan Chen Hexiang Hu Ge Zhang Jie Fu Alan Ritter Wenhu Chen 47 53 0 28 Nov 2023
Boot and Switch: Alternating Distillation for Zero-Shot Dense Retrieval Fan Jiang Qiongkai Xu Tom Drummond Trevor Cohn 21 2 0 27 Nov 2023
Noisy Self-Training with Synthetic Queries for Dense Retrieval Fan Jiang Tom Drummond Trevor Cohn 38 1 0 27 Nov 2023
Drilling Down into the Discourse Structure with LLMs for Long Document Question Answering Inderjeet Nair Shwetha Somasundaram Apoorv Saxena Koustava Goswami RALM 29 8 0 22 Nov 2023
CSMeD: Bridging the Dataset Gap in Automated Citation Screening for Systematic Literature Reviews Wojciech Kusa Óscar E. Mendoza Matthias Samwald Petr Knoth Allan Hanbury 47 4 0 21 Nov 2023
A Self-enhancement Approach for Domain-specific Chatbot Training via Knowledge Mining and Digest Ruohong Zhang Luyu Gao Chen Zheng Zhen Fan Guokun Lai Zheng Zhang Fangzhou Ai Yiming Yang Hongxia Yang 51 2 0 17 Nov 2023
PEARL: Personalizing Large Language Model Writing Assistants with Generation-Calibrated Retrievers Sheshera Mysore Zhuoran Lu Mengting Wan Longqi Yang Steve Menezes Tina Baghaee Emmanuel Barajas Gonzalez Jennifer Neville Tara Safavi RALM 32 35 0 15 Nov 2023
How Well Do Text Embedding Models Understand Syntax? Yan Zhang Zhaopeng Feng Zhiyang Teng Zuozhu Liu Haizhou Li 42 3 0 14 Nov 2023
It's All Relative! -- A Synthetic Query Generation Approach for Improving Zero-Shot Relevance Prediction Aditi Chaudhary K. Raman Michael Bendersky 31 7 0 14 Nov 2023
Mitigating Pooling Bias in E-commerce Search via False Negative Estimation Xiaochen Wang Xiao Xiao Ruhan Zhang Xuan Zhang Taesik Na Tejaswi Tenneti Haixun Wang Fenglong Ma 26 0 0 11 Nov 2023
Leveraging LLMs for Synthesizing Training Data Across Many Languages in Multilingual Dense Retrieval Nandan Thakur Jianmo Ni Gustavo Hernández Ábrego John Wieting Jimmy J. Lin Daniel Cer RALM 31 12 0 10 Nov 2023
A Survey of Large Language Models in Medicine: Progress, Application, and Challenge Hongjian Zhou Fenglin Liu Boyang Gu Xinyu Zou Jinfa Huang ... Yefeng Zheng Lei A. Clifton Zheng Li Fenglin Liu David A. Clifton LM&MA 41 107 0 09 Nov 2023
Plot Retrieval as an Assessment of Abstract Semantic Association Shicheng Xu Liang Pang JiangNan Li Mo Yu Fandong Meng Huawei Shen Xueqi Cheng Jie Zhou 32 3 0 03 Nov 2023
Instruction Distillation Makes Large Language Models Efficient Zero-shot Rankers Weiwei Sun Zheng Chen Xinyu Ma Lingyong Yan Shuaiqiang Wang Pengjie Ren Zhumin Chen Dawei Yin Zhaochun Ren ALM 37 19 0 02 Nov 2023
Zero-Shot Medical Information Retrieval via Knowledge Graph Embedding Yuqi Wang Zeqiang Wang Wei Wang Qi Chen Kaizhu Huang Anh Nguyen Suparna De MedIm 30 2 0 31 Oct 2023
LLMs may Dominate Information Access: Neural Retrievers are Biased Towards LLM-Generated Texts Sunhao Dai Yuqi Zhou Liang Pang Weihao Liu Xiaolin Hu Yong Liu Xiao Zhang Gang Wang Jun Xu 49 27 0 31 Oct 2023
Jina Embeddings 2: 8192-Token General-Purpose Text Embeddings for Long Documents Michael Gunther Jackmin Ong Isabelle Mohr Alaeddine Abdessalem Tanguy Abel ... Saba Sturua Bo Wang Maximilian Werk Nan Wang Han Xiao RALM 27 58 0 30 Oct 2023
Poisoning Retrieval Corpora by Injecting Adversarial Passages Zexuan Zhong Ziqing Huang Alexander Wettig Danqi Chen AAML 13 60 0 29 Oct 2023
MILL: Mutual Verification with Large Language Models for Zero-Shot Query Expansion Pengyue Jia Yiding Liu Xiangyu Zhao Xiaopeng Li Changying Hao Shuaiqiang Wang Dawei Yin 29 16 0 29 Oct 2023
Detrimental Contexts in Open-Domain Question Answering Philhoon Oh James Thorne 22 1 0 27 Oct 2023
Non-contrastive sentence representations via self-supervision M. Farina D. Pappadopulo SSL 23 1 0 26 Oct 2023
Improving Zero-shot Reader by Reducing Distractions from Irrelevant Documents in Open-Domain Question Answering Sukmin Cho Jeongyeon Seo Soyeong Jeong Jong C. Park RALM 29 2 0 26 Oct 2023
CAD -- Contextual Multi-modal Alignment for Dynamic AVQA Asmar Nadeem Adrian Hilton R. Dawes Graham A. Thomas A. Mustafa 33 9 0 25 Oct 2023
Length is a Curse and a Blessing for Document-level Semantics Chenghao Xiao Yizhi Li ♣. G. Thomas Hudson ♠ Chenghua Al Moubayed 38 6 0 24 Oct 2023
KITAB: Evaluating LLMs on Constraint Satisfaction for Information Retrieval Marah Abdin Suriya Gunasekar Varun Chandrasekaran Jerry Li Mert Yuksekgonul Rahee Peshawaria Ranjita Naik Besmira Nushi 64 12 0 24 Oct 2023
On the Dimensionality of Sentence Embeddings Hongwei Wang Hongming Zhang Dong Yu AI4TS DML 33 3 0 23 Oct 2023
Large Search Model: Redefining Search Stack in the Era of LLMs Liang Wang Nan Yang Xiaolong Huang Linjun Yang Rangan Majumder Furu Wei LRM KELM 45 13 0 23 Oct 2023
On the Language Encoder of Contrastive Cross-modal Models Mengjie Zhao Junya Ono Zhi-Wei Zhong Chieh-Hsin Lai Yuhta Takida Naoki Murata Wei-Hsiang Liao Takashi Shibuya Hiromi Wakaki Yuki Mitsufuji VLM 28 0 0 20 Oct 2023
Open-source Large Language Models are Strong Zero-shot Query Likelihood Models for Document Ranking Shengyao Zhuang Bing Liu Bevan Koopman Guido Zuccon RALM 32 46 0 20 Oct 2023
Investigating semantic subspaces of Transformer sentence embeddings through linear structural probing Dmitry Nikolaev Sebastian Padó 46 5 0 18 Oct 2023
Large Language Models can Contrastively Refine their Generation for Better Sentence Representation Learning Huiming Wang Zhaodonghui Li Liying Cheng De Wen Soh Lidong Bing 34 2 0 17 Oct 2023