BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Models

17 April 2021

Papers citing "BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Models"

50 / 572 papers shown

Title
An Efficiency Study for SPLADE Models Carlos Lassance S. Clinchant 48 70 0 08 Jul 2022
Multi-Task Retrieval-Augmented Text Generation with Relevance Sampling Sebastian Hofstatter Jiecao Chen K. Raman Hamed Zamani RALM 39 11 0 07 Jul 2022
Understanding Performance of Long-Document Ranking Models through Comprehensive Evaluation and Leaderboarding Leonid Boytsov David Akinpelu Tianyi Lin Fangwei Gao Yutian Zhao Jeffrey Huang Nipun Katyal Eric Nyberg 47 9 0 04 Jul 2022
Forecasting Future World Events with Neural Networks Andy Zou Tristan Xiao Ryan Jia Joe Kwon Mantas Mazeika Richard Li Dawn Song Jacob Steinhardt Owain Evans Dan Hendrycks 30 22 0 30 Jun 2022
Are We There Yet? A Decision Framework for Replacing Term Based Retrieval with Dense Retrieval Systems Sebastian Hofstatter Nick Craswell Bhaskar Mitra Hamed Zamani Allan Hanbury 43 5 0 26 Jun 2022
Questions Are All You Need to Train a Dense Passage Retriever Devendra Singh Sachan M. Lewis Dani Yogatama Luke Zettlemoyer J. Pineau Manzil Zaheer RALM 32 53 0 21 Jun 2022
No Parameter Left Behind: How Distillation and Model Size Affect Zero-Shot Retrieval G. Rosa L. Bonifacio Vitor Jeronymo Hugo Queiroz Abonizio Marzieh Fadaee R. Lotufo Rodrigo Nogueira 27 26 0 06 Jun 2022
Neural Retriever and Go Beyond: A Thesis Proposal Man Luo 35 1 0 31 May 2022
Optimizing Test-Time Query Representations for Dense Retrieval Mujeen Sung Jungsoo Park Jaewoo Kang Danqi Chen Jinhyuk Lee 33 5 0 25 May 2022
QAMPARI: An Open-domain Question Answering Benchmark for Questions with Many Answers from Multiple Paragraphs S. Amouyal Tomer Wolfson Ohad Rubin Ori Yoran Jonathan Herzig Jonathan Berant RALM VLM 33 21 0 25 May 2022
RetroMAE: Pre-Training Retrieval-oriented Language Models Via Masked Auto-Encoder Shitao Xiao Zheng Liu Yingxia Shao Bo Zhao RALM 123 110 0 24 May 2022
Injecting Domain Adaptation with Learning-to-hash for Effective and Efficient Zero-shot Dense Retrieval Nandan Thakur Nils Reimers Jimmy J. Lin VLM 28 4 0 23 May 2022
Towards Tracing Factual Knowledge in Language Models Back to the Training Data Ekin Akyürek Tolga Bolukbasi Frederick Liu Binbin Xiong Ian Tenney Jacob Andreas Kelvin Guu HILM 27 11 0 23 May 2022
UnifieR: A Unified Retriever for Large-Scale Retrieval Tao Shen Xiubo Geng Chongyang Tao Can Xu Guodong Long Kai Zhang Daxin Jiang RALM 29 28 0 23 May 2022
RankGen: Improving Text Generation with Large Ranking Models Kalpesh Krishna Yapei Chang John Wieting Mohit Iyyer AIMat 24 68 0 19 May 2022
PLAID: An Efficient Engine for Late Interaction Retrieval Keshav Santhanam Omar Khattab Christopher Potts Matei A. Zaharia VLM 58 73 0 19 May 2022
Certified Error Control of Candidate Set Pruning for Two-Stage Relevance Ranking Minghan Li Xinyu Crystina Zhang Ji Xin Hongyang R. Zhang Jimmy J. Lin 38 6 0 19 May 2022
From Distillation to Hard Negative Sampling: Making Sparse Neural IR Models More Effective Thibault Formal Carlos Lassance Benjamin Piwowarski S. Clinchant VLM 31 139 0 10 May 2022
Entity-aware Transformers for Entity Search E. Gerritse Faegheh Hasibi A. D. Vries 36 22 0 02 May 2022
User Experience Design for Automatic Credibility Assessment of News Content About COVID-19 K. Schulz Jens Rauenbusch Jan Fillies Lisa Rutenburg Dimitrios Karvelas Georg Rehm 25 2 0 29 Apr 2022
A Thorough Examination on Zero-shot Dense Retrieval Ruiyang Ren Yingqi Qu Qingbin Liu Wayne Xin Zhao Qifei Wu Yuchen Ding Hua Wu Haifeng Wang Ji-Rong Wen 37 41 0 27 Apr 2022
Sparse and Dense Approaches for the Full-rank Retrieval of Responses for Dialogues Gustavo Penha C. Hauff RALM 35 0 0 22 Apr 2022
Improving Passage Retrieval with Zero-Shot Question Generation Devendra Singh Sachan M. Lewis Mandar Joshi Armen Aghajanyan Wen-tau Yih J. Pineau Luke Zettlemoyer OOD LRM 33 157 0 15 Apr 2022
Augmenting Pre-trained Language Models with QA-Memory for Open-Domain Question Answering Wenhu Chen Pat Verga Michiel de Jong John Wieting William W. Cohen RALM KELM 37 26 0 10 Apr 2022
Introducing Neural Bag of Whole-Words with ColBERTer: Contextualized Late Interactions using Enhanced Reduction Sebastian Hofstatter Omar Khattab Sophia Althammer Mete Sertkan Allan Hanbury 27 33 0 24 Mar 2022
DuReader_retrieval: A Large-scale Chinese Benchmark for Passage Retrieval from Web Search Engine Yifu Qiu Hongyu Li Yingqi Qu Ying-Cong Chen Qiaoqiao She Jing Liu Hua Wu Haifeng Wang RALM 38 15 0 19 Mar 2022
RELIC: Retrieving Evidence for Literary Claims Katherine Thai Yapei Chang Kalpesh Krishna Mohit Iyyer RALM 28 16 0 18 Mar 2022
Augmenting Document Representations for Dense Retrieval with Interpolation and Perturbation Soyeong Jeong Jinheon Baek Sukmin Cho Sung Ju Hwang Jong C. Park 28 11 0 15 Mar 2022
Reasoning over Public and Private Data in Retrieval-Based Systems Simran Arora Patrick Lewis Angela Fan Jacob Kahn Christopher Ré 23 23 0 14 Mar 2022
LaPraDoR: Unsupervised Pretrained Dense Retriever for Zero-Shot Text Retrieval Canwen Xu Daya Guo Nan Duan Julian McAuley RALM VLM 29 46 0 11 Mar 2022
Internet-augmented language models through few-shot prompting for open-domain question answering Angeliki Lazaridou E. Gribovskaya Wojciech Stokowiec N. Grigorev KELM LRM 20 131 0 10 Mar 2022
PMC-Patients: A Large-scale Dataset of Patient Summaries and Relations for Benchmarking Retrieval-based Clinical Decision Support Systems Zhengyun Zhao Qiao Jin Fangyuan Chen Tuorui Peng Sheng Yu PINN 19 34 0 28 Feb 2022
SGPT: GPT Sentence Embeddings for Semantic Search Niklas Muennighoff RALM 35 176 0 17 Feb 2022
InPars: Data Augmentation for Information Retrieval using Large Language Models L. Bonifacio Hugo Queiroz Abonizio Marzieh Fadaee Rodrigo Nogueira VLM RALM 36 62 0 10 Feb 2022
Text and Code Embeddings by Contrastive Pre-Training Arvind Neelakantan Tao Xu Raul Puri Alec Radford Jesse Michael Han ... Tabarak Khan Toki Sherbakov Joanne Jang Peter Welinder Lilian Weng SSL AI4TS 232 425 0 24 Jan 2022
HC4: A New Suite of Test Collections for Ad Hoc CLIR Dawn J Lawrie J. Mayfield Douglas W. Oard Eugene Yang VLM AILaw 38 30 0 24 Jan 2022
Improving Biomedical Information Retrieval with Neural Retrievers Man Luo Arindam Mitra Tejas Gokhale Chitta Baral 35 33 0 19 Jan 2022
Establishing Strong Baselines for TripClick Health Retrieval Sebastian Hofstatter Sophia Althammer Mete Sertkan Allan Hanbury MedIm 36 12 0 02 Jan 2022
Unsupervised Dense Information Retrieval with Contrastive Learning Gautier Izacard Mathilde Caron Lucas Hosseini Sebastian Riedel Piotr Bojanowski Armand Joulin Edouard Grave RALM 38 813 0 16 Dec 2021
Extreme Zero-Shot Learning for Extreme Text Classification Yuanhao Xiong Wei-Cheng Chang Cho-Jui Hsieh Hsiang-Fu Yu Inderjit Dhillon VLM 27 25 0 16 Dec 2021
Large Dual Encoders Are Generalizable Retrievers Jianmo Ni Chen Qu Jing Lu Zhuyun Dai Gustavo Hernández Ábrego ... Vincent Zhao Yi Luan Keith B. Hall Ming-Wei Chang Yinfei Yang DML 33 434 0 15 Dec 2021
Boosted Dense Retriever Patrick Lewis Barlas Oğuz Wenhan Xiong Fabio Petroni Wen-tau Yih Sebastian Riedel MDE 23 17 0 14 Dec 2021
GPL: Generative Pseudo Labeling for Unsupervised Domain Adaptation of Dense Retrieval Kexin Wang Nandan Thakur Nils Reimers Iryna Gurevych VLM 24 149 0 14 Dec 2021
A Study on Token Pruning for ColBERT Carlos Lassance Maroua Maachou Joohee Park S. Clinchant 33 13 0 13 Dec 2021
Match Your Words! A Study of Lexical Matching in Neural Information Retrieval Thibault Formal Benjamin Piwowarski S. Clinchant 22 20 0 10 Dec 2021
MetaQA: Combining Expert Agents for Multi-Skill Question Answering Haritz Puerto Gözde Gül Sahin Iryna Gurevych LLMAG 33 20 0 03 Dec 2021
ColBERTv2: Effective and Efficient Retrieval via Lightweight Late Interaction Keshav Santhanam Omar Khattab Jon Saad-Falcon Christopher Potts Matei A. Zaharia 39 385 0 02 Dec 2021
Long-range and hierarchical language predictions in brains and algorithms Charlotte Caucheteux Alexandre Gramfort J. King 20 22 0 28 Nov 2021
TLDR: Twin Learning for Dimensionality Reduction Yannis Kalantidis Carlos Lassance Jon Almazán Diane Larlus SSL 27 10 0 18 Oct 2021
DISAPERE: A Dataset for Discourse Structure in Peer Review Discussions Neha Nayak Kennard Timothy J. O'Gorman Rajarshi Das Akshay Sharma Chhandak Bagchi Matthew Clinton Pranay Kumar Yelugam Hamed Zamani Andrew McCallum 39 28 0 16 Oct 2021