BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Models

17 April 2021

Papers citing "BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Models"

50 / 572 papers shown

Title
Challenging Decoder helps in Masked Auto-Encoder Pre-training for Dense Passage Retrieval Zehan Li Yanzhao Zhang Dingkun Long Pengjun Xie RALM 33 3 0 22 May 2023
A Comprehensive Survey of Sentence Representations: From the BERT Epoch to the ChatGPT Era and Beyond Abhinav Ramesh Kashyap Thang-Tung Nguyen Viktor Schlegel Stefan Winkler See-Kiong Ng Soujanya Poria AI4TS 3DV SSL 37 6 0 22 May 2023
ReFIT: Relevance Feedback from a Reranker during Inference R. Reddy Pradeep Dasigi Md Arafat Sultan Arman Cohan Avirup Sil Heng Ji Hannaneh Hajishirzi 30 2 0 19 May 2023
QUEST: A Retrieval Dataset of Entity-Seeking Queries with Implicit Set Operations Chaitanya Malaviya Peter Shaw Ming-Wei Chang Kenton Lee Kristina Toutanova 16 14 0 19 May 2023
BERM: Training the Balanced and Extractable Representation for Matching to Improve Generalization Ability of Dense Retrieval Shicheng Xu Liang Pang Huawei Shen Xueqi Cheng 16 11 0 18 May 2023
Large Language Models are Built-in Autoregressive Search Engines Noah Ziems Wenhao Yu Zhihan Zhang Meng Jiang KELM 70 40 0 16 May 2023
NevIR: Negation in Neural Information Retrieval Orion Weller Dawn J Lawrie Benjamin Van Durme MU 61 18 0 12 May 2023
Synergistic Interplay between Search and Large Language Models for Information Retrieval Jiazhan Feng Chongyang Tao Xiubo Geng Tao Shen Can Xu Guodong Long Dongyan Zhao Daxin Jiang KELM 63 5 0 12 May 2023
Evaluating Embedding APIs for Information Retrieval Ehsan Kamalloo Xinyu Crystina Zhang Odunayo Ogundepo Nandan Thakur David Alfonso-Hermelo Mehdi Rezagholizadeh Jimmy J. Lin RALM 29 19 0 10 May 2023
Synthetic Query Generation for Privacy-Preserving Deep Retrieval Systems using Differentially Private Language Models Aldo G. Carranza Rezsa Farahani Natalia Ponomareva Alexey Kurakin Matthew Jagielski Milad Nasr SyDa 28 7 0 10 May 2023
Unsupervised Dense Retrieval Training with Web Anchors Yiqing Xie X. Liu Chenyan Xiong RALM 17 3 0 10 May 2023
Empowering Language Model with Guided Knowledge Fusion for Biomedical Document Re-ranking D. Gupta Dina Demner-Fushman 26 1 0 07 May 2023
Efficient k-NN Search with Cross-Encoders using Adaptive Multi-Round CUR Decomposition Nishant Yadav Nicholas Monath Manzil Zaheer Andrew McCallum 18 1 0 04 May 2023
Re $^3$ Dial: Retrieve, Reorganize and Rescale Dialogue Corpus for Long-Turn Open-Domain Dialogue Pre-training Jiaxin Wen Hao Zhou Jian Guan Minlie Huang 28 0 0 04 May 2023
RetroMAE-2: Duplex Masked Auto-Encoder For Pre-Training Retrieval-Oriented Language Models Shitao Xiao Zheng Liu Yingxia Shao Weidong (Tom) Cai RALM 42 22 0 04 May 2023
Zero-Shot Listwise Document Reranking with a Large Language Model Xueguang Ma Xinyu Crystina Zhang Ronak Pradeep Jimmy J. Lin 65 50 0 03 May 2023
Multivariate Representation Learning for Information Retrieval Hamed Zamani Michael Bendersky DML 24 3 0 27 Apr 2023
Large Language Models are Strong Zero-Shot Retriever Tao Shen Guodong Long Xiubo Geng Chongyang Tao Dinesh Manocha Daxin Jiang RALM KELM 50 34 0 27 Apr 2023
CoT-MoTE: Exploring ConTextual Masked Auto-Encoder Pre-training with Mixture-of-Textual-Experts for Passage Retrieval Guangyuan Ma Xing Wu Peng Wang Songlin Hu MoE RALM 26 5 0 20 Apr 2023
Rethinking Dense Retrieval's Few-Shot Ability Si Sun Yi-Wen Lu Shi Yu Xiangyang Li Zhonghua Li Bo Zhao Zhiyuan Liu Deiming Ye Jie Bao 8 0 0 12 Apr 2023
WebBrain: Learning to Generate Factually Correct Articles for Queries by Grounding on Large Web Corpus Hongjing Qian Yutao Zhu Zhicheng Dou Haoqi Gu Xinyu Zhang Zheng Liu Ruofei Lai Bo Zhao J. Nie Ji-Rong Wen 38 25 0 10 Apr 2023
Noise-Robust Dense Retrieval via Contrastive Alignment Post Training Daniel Fernando Campos ChengXiang Zhai Alessandro Magnani 29 4 0 06 Apr 2023
CoT-MAE v2: Contextual Masked Auto-Encoder with Multi-view Modeling for Passage Retrieval Xing Wu Guangyuan Ma Peng Wang Meng Lin Zijia Lin Fuzheng Zhang Songlin Hu RALM 24 7 0 05 Apr 2023
Rethinking the Role of Token Retrieval in Multi-Vector Retrieval Jinhyuk Lee Zhuyun Dai Sai Meher Karthik Duddu Tao Lei Iftekhar Naim Ming-Wei Chang Vincent Zhao 24 15 0 04 Apr 2023
Improving Dual-Encoder Training through Dynamic Indexes for Negative Mining Nicholas Monath Manzil Zaheer Kelsey R. Allen Andrew McCallum 27 6 0 27 Mar 2023
Paraphrasing evades detectors of AI-generated text, but retrieval is an effective defense Kalpesh Krishna Yixiao Song Marzena Karpinska John Wieting Mohit Iyyer DeLMO 21 298 0 23 Mar 2023
Parameter-Efficient Sparse Retrievers and Rerankers using Adapters Vaishali Pal Carlos Lassance Hervé Déjean S. Clinchant 135 3 0 23 Mar 2023
Improving Content Retrievability in Search with Controllable Query Generation Gustavo Penha Enrico Palumbo Maryam Aziz Alice Wang Hugues Bouchard 37 11 0 21 Mar 2023
Conversational Tree Search: A New Hybrid Dialog Task Dirk Vath Lindsey Vanderlyn Ngoc Thang Vu 51 7 0 17 Mar 2023
Query2doc: Query Expansion with Large Language Models Liang Wang Nan Yang Furu Wei 88 99 0 14 Mar 2023
Rediscovering Hashed Random Projections for Efficient Quantization of Contextualized Sentence Embeddings Ulf A. Hamster Ji-Ung Lee Alexander Geyken Iryna Gurevych 34 0 0 13 Mar 2023
Can a Frozen Pretrained Language Model be used for Zero-shot Neural Retrieval on Entity-centric Questions? Yasuto Hoshi Daisuke Miyashita Yasuhiro Morioka Youyang Ng Osamu Torii J. Deguchi 23 0 0 09 Mar 2023
Magnushammer: A Transformer-Based Approach to Premise Selection Maciej Mikuła Szymon Tworkowski Szymon Antoniak Bartosz Piotrowski Albert Qiaochu Jiang Jinyi Zhou Christian Szegedy Lukasz Kuciñski Piotr Milo's Yuhuai Wu 47 42 0 08 Mar 2023
xCodeEval: A Large Scale Multilingual Multitask Benchmark for Code Understanding, Generation, Translation and Retrieval Mohammad Abdullah Matin Khan M Saiful Bari Xuan Long Do Weishi Wang Md. Rizwan Parvez Chenyu You ALM ELM 34 14 0 06 Mar 2023
UDAPDR: Unsupervised Domain Adaptation via LLM Prompting and Distillation of Rerankers Jon Saad-Falcon Omar Khattab Keshav Santhanam Radu Florian M. Franz Salim Roukos Avirup Sil Md Arafat Sultan Christopher Potts 29 41 0 01 Mar 2023
Complex QA and language models hybrid architectures, Survey Xavier Daull P. Bellot Emmanuel Bruno Vincent Martin Elisabeth Murisasco ELM 28 15 0 17 Feb 2023
How to Train Your DRAGON: Diverse Augmentation Towards Generalizable Dense Retrieval Sheng-Chieh Lin Akari Asai Minghan Li Barlas Oğuz Jimmy J. Lin Yashar Mehdad Wen-tau Yih Xilun Chen 34 93 0 15 Feb 2023
Improving Out-of-Distribution Generalization of Neural Rerankers with Contextualized Late Interaction Xinyu Crystina Zhang Minghan Li Jimmy J. Lin 35 1 0 13 Feb 2023
Augmenting Zero-Shot Dense Retrievers with Plug-in Mixture-of-Memories Suyu Ge Chenyan Xiong Corby Rosset Arnold Overwijk Jiawei Han Paul N. Bennett VLM 41 6 0 07 Feb 2023
In-Context Retrieval-Augmented Language Models Ori Ram Yoav Levine Itay Dalmedigos Dor Muhlgay Amnon Shashua Kevin Leyton-Brown Y. Shoham KELM RALM LRM 31 543 0 31 Jan 2023
Finding the Law: Enhancing Statutory Article Retrieval via Graph Neural Networks Antoine Louis Gijs van Dijck Gerasimos Spanakis AILaw 23 9 0 30 Jan 2023
EmbedDistill: A Geometric Knowledge Distillation for Information Retrieval Seungyeon Kim A. S. Rawat Manzil Zaheer Sadeep Jayasumana Veeranjaneyulu Sadhanala Wittawat Jitkrittum A. Menon Rob Fergus Surinder Kumar FedML 47 7 0 27 Jan 2023
SemSup-XC: Semantic Supervision for Zero and Few-shot Extreme Classification Pranjal Aggarwal Ameet Deshpande Karthik R. Narasimhan AILaw VLM 22 6 0 26 Jan 2023
A Study on FGSM Adversarial Training for Neural Retrieval Simon Lupart S. Clinchant AAML 32 7 0 25 Jan 2023
ExaRanker: Explanation-Augmented Neural Ranker Fernando Ferraretto Thiago Laitz R. Lotufo Rodrigo Nogueira ELM LRM 36 7 0 25 Jan 2023
An Experimental Study on Pretraining Transformers from Scratch for IR Carlos Lassance Hervé Déjean S. Clinchant 28 11 0 25 Jan 2023
JCSE: Contrastive Learning of Japanese Sentence Embeddings and Its Applications Zihao Chen H. Handa Kimiaki Shirahama 22 2 0 19 Jan 2023
Towards Answering Climate Questionnaires from Unstructured Climate Reports Daniel M. Spokoyny Tanmay Laud Thomas W. Corringham Taylor Berg-Kirkpatrick 13 6 0 11 Jan 2023
InPars-Light: Cost-Effective Unsupervised Training of Efficient Rankers Leonid Boytsov Preksha Patel Vivek Sourabh Riddhi Nisar Sayan Kundu R. Ramanathan Eric Nyberg 29 19 0 08 Jan 2023
InPars-v2: Large Language Models as Efficient Dataset Generators for Information Retrieval Vitor Jeronymo L. Bonifacio Hugo Queiroz Abonizio Marzieh Fadaee R. Lotufo Jakub Zavrel Rodrigo Nogueira RALM SyDa 31 92 0 04 Jan 2023