BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Models

17 April 2021

Papers citing "BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Models"

50 / 572 papers shown

Title
Learning List-Level Domain-Invariant Representations for Ranking Ruicheng Xian Honglei Zhuang Zhen Qin Hamed Zamani Jing Lu Ji Ma Kai Hui Han Zhao Xuanhui Wang Michael Bendersky OOD 54 9 0 21 Dec 2022
HYRR: Hybrid Infused Reranking for Passage Retrieval Jing Lu Keith B. Hall Ji Ma Jianmo Ni 33 6 0 20 Dec 2022
Open Domain Multi-document Summarization: A Comprehensive Study of Model Brittleness under Retrieval John Giorgi Luca Soldaini Bo Wang Gary D. Bader Kyle Lo Lucy Lu Wang Arman Cohan 15 17 0 20 Dec 2022
Precise Zero-Shot Dense Retrieval without Relevance Labels Luyu Gao Xueguang Ma Jimmy J. Lin Jamie Callan RALM 33 291 0 20 Dec 2022
To Adapt or to Annotate: Challenges and Interventions for Domain Adaptation in Open-Domain Question Answering Dheeru Dua Emma Strubell Sameer Singh Pat Verga OOD 47 3 0 20 Dec 2022
What Are You Token About? Dense Retrieval as Distributions Over the Vocabulary Ori Ram L. Bezalel Adi Zicher Yonatan Belinkov Jonathan Berant Amir Globerson 44 36 0 20 Dec 2022
Adam: Dense Retrieval Distillation with Adaptive Dark Examples Chongyang Tao Chang Liu Tao Shen Can Xu Xiubo Geng Binxing Jiao Daxin Jiang 49 3 0 20 Dec 2022
One Embedder, Any Task: Instruction-Finetuned Text Embeddings Hongjin Su Weijia Shi Jungo Kasai Yizhong Wang Yushi Hu Mari Ostendorf Wen-tau Yih Noah A. Smith Luke Zettlemoyer Tao Yu 27 282 0 19 Dec 2022
Query-as-context Pre-training for Dense Passage Retrieval Xing Wu Guangyuan Ma Wanhui Qian Zijia Lin Songlin Hu 35 9 0 19 Dec 2022
On Isotropy, Contextualization and Learning Dynamics of Contrastive-based Sentence Representation Learning Chenghao Xiao Yang Long Noura Al Moubayed 24 8 0 18 Dec 2022
CAPSTONE: Curriculum Sampling for Dense Retrieval with Document Expansion Xingwei He Yeyun Gong Alex Jin Hang Zhang Anlei Dong Jian Jiao Siu-Ming Yiu Nan Duan RALM 54 3 0 18 Dec 2022
PolQA: Polish Question Answering Dataset Piotr Rybak Piotr Przybyła M. Ogrodniczuk 28 6 0 17 Dec 2022
AugTriever: Unsupervised Dense Retrieval by Scalable Data Augmentation Rui Meng Ye Liu Semih Yavuz Divyansh Agarwal Lifu Tu Ning Yu Jianguo Zhang Meghana Moorthy Bhat Yingbo Zhou RALM 58 0 0 17 Dec 2022
MASTER: Multi-task Pre-trained Bottlenecked Masked Autoencoders are Better Dense Retrievers Kun Zhou Xiao Liu Yeyun Gong Wayne Xin Zhao Daxin Jiang Nan Duan Ji-Rong Wen 32 16 0 15 Dec 2022
Retrieval-based Disentangled Representation Learning with Natural Language Supervision Jiawei Zhou Xiaoguang Li Lifeng Shang Xin Jiang Qun Liu L. Chen DRL 35 6 0 15 Dec 2022
In Defense of Cross-Encoders for Zero-Shot Retrieval G. Rosa L. Bonifacio Vitor Jeronymo Hugo Queiroz Abonizio Marzieh Fadaee R. Lotufo Rodrigo Nogueira 26 18 0 12 Dec 2022
FastClass: A Time-Efficient Approach to Weakly-Supervised Text Classification Tingyu Xia Yue Wang Yuan Tian Yi-Ju Chang 12 2 0 11 Dec 2022
Text Embeddings by Weakly-Supervised Contrastive Pre-training Liang Wang Nan Yang Xiaolong Huang Binxing Jiao Linjun Yang Daxin Jiang Rangan Majumder Furu Wei VLM 53 531 0 07 Dec 2022
Retrieval as Attention: End-to-end Learning of Retrieval and Reading within a Single Transformer Zhengbao Jiang Luyu Gao Jun Araki Haibo Ding Zhiruo Wang Jamie Callan Graham Neubig RALM 27 40 0 05 Dec 2022
Moving Beyond Downstream Task Accuracy for Information Retrieval Benchmarking Keshav Santhanam Jon Saad-Falcon M. Franz Omar Khattab Avirup Sil Radu Florian Md Arafat Sultan Salim Roukos Matei A. Zaharia Christopher Potts OffRL 26 10 0 02 Dec 2022
Multi-label Few-shot ICD Coding as Autoregressive Generation with Prompt Zhichao Yang Sunjae Kwon Zonghai Yao Hongfeng Yu 26 17 0 24 Nov 2022
CITADEL: Conditional Token Interaction via Dynamic Lexical Routing for Efficient and Effective Multi-Vector Retrieval Minghan Li Sheng-Chieh Lin Barlas Oğuz Asish Ghoshal Jimmy J. Lin Yashar Mehdad Wen-tau Yih Xilun Chen 30 26 0 18 Nov 2022
Task-aware Retrieval with Instructions Akari Asai Timo Schick Patrick Lewis Xilun Chen Gautier Izacard Sebastian Riedel Hannaneh Hajishirzi Wen-tau Yih 45 88 0 16 Nov 2022
RetroMAE v2: Duplex Masked Auto-Encoder For Pre-Training Retrieval-Oriented Language Models Shitao Xiao Zheng Liu RALM 26 2 0 16 Nov 2022
Unsupervised Domain Adaptation for Sparse Retrieval by Filling Vocabulary and Word Frequency Gaps Hiroki Iida Naoaki Okazaki 42 4 0 08 Nov 2022
Multi-Vector Retrieval as Sparse Alignment Yujie Qian Jinhyuk Lee Sai Meher Karthik Duddu Zhuyun Dai Siddhartha Brahma Iftekhar Naim Tao Lei Vincent Zhao 30 12 0 02 Nov 2022
Generate, Discriminate and Contrast: A Semi-Supervised Sentence Representation Learning Framework Yiming Chen Yan Zhang Bin Wang Zuozhu Liu Haizhou Li 40 25 0 30 Oct 2022
COCO-DR: Combating Distribution Shifts in Zero-Shot Dense Retrieval with Contrastive and Distributionally Robust Learning Yue Yu Chenyan Xiong Si Sun Chao Zhang Arnold Overwijk VLM OOD 50 22 0 27 Oct 2022
SciFact-Open: Towards open-domain scientific claim verification David Wadden Kyle Lo Bailey Kuehl Arman Cohan Iz Beltagy Lucy Lu Wang Hannaneh Hajishirzi LRM 27 55 0 25 Oct 2022
Cross-document Event Coreference Search: Task, Dataset and Modeling Alon Eirew Avi Caciularu Ido Dagan 50 10 0 23 Oct 2022
Exploring Representation-Level Augmentation for Code Search Haochen Li Steven C. H. Hoi Cyril Leung Yanxian Huang Yuan Huang Hongyu Zhang Yanlin Wang 53 19 0 21 Oct 2022
Decoding a Neural Retriever's Latent Space for Query Suggestion Leonard Adolphs Michelle Chen Huebscher Christian Buck Sertan Girgin Olivier Bachem Massimiliano Ciaramita Thomas Hofmann RALM 21 8 0 21 Oct 2022
Incorporating Relevance Feedback for Information-Seeking Retrieval using Few-Shot Document Re-Ranking Tim Baumgärtner Leonardo F. R. Ribeiro Nils Reimers Iryna Gurevych 35 6 0 19 Oct 2022
Making a MIRACL: Multilingual Information Retrieval Across a Continuum of Languages Xinyu Crystina Zhang Nandan Thakur Odunayo Ogundepo Ehsan Kamalloo David Alfonso-Hermelo Xiaoguang Li Qun Liu Mehdi Rezagholizadeh Jimmy J. Lin 37 53 0 18 Oct 2022
MTEB: Massive Text Embedding Benchmark Niklas Muennighoff Nouamane Tazi L. Magne Nils Reimers 28 375 0 13 Oct 2022
RankT5: Fine-Tuning T5 for Text Ranking with Ranking Losses Honglei Zhuang Zhen Qin R. Jagerman Kai Hui Ji Ma Jing Lu Jianmo Ni Xuanhui Wang Michael Bendersky AIMat 37 129 0 12 Oct 2022
Task-Aware Specialization for Efficient and Robust Dense Retrieval for Open-Domain Question Answering Hao Cheng Hao Fang Xiaodong Liu Jianfeng Gao RALM 41 5 0 11 Oct 2022
Noise-Robust De-Duplication at Scale Emily Silcock Luca DÁmico-Wong Jinglin Yang Melissa Dell SyDa 39 20 0 09 Oct 2022
InfoCSE: Information-aggregated Contrastive Learning of Sentence Embeddings Xing Wu Chaochen Gao Zijia Lin Jizhong Han Zhongyuan Wang Songlin Hu 21 32 0 08 Oct 2022
Enhanced vectors for top-k document retrieval in Question Answering M. Hammad 21 0 0 08 Oct 2022
Detect, Retrieve, Comprehend: A Flexible Framework for Zero-Shot Document-Level Question Answering T. McDonald Brian Tsan Amar Saini Juanita Ordoñez Luis Gutierrez Phan-Anh-Huy Nguyen Blake Mason Brenda Ng RALM 27 3 0 04 Oct 2022
A Study on the Efficiency and Generalization of Light Hybrid Retrievers Man Luo Shashank Jain Anchit Gupta Arash Einolghozati Barlas Oğuz Debojeet Chatterjee Xilun Chen Chitta Baral Peyman Heidari VLM 43 6 0 04 Oct 2022
Zero-Shot Retrieval with Search Agents and Hybrid Environments Michelle Chen Huebscher Christian Buck Massimiliano Ciaramita S. Rothe 32 9 0 30 Sep 2022
FiD-Light: Efficient and Effective Retrieval-Augmented Text Generation Sebastian Hofstatter Jiecao Chen K. Raman Hamed Zamani RALM 65 77 0 28 Sep 2022
Promptagator: Few-shot Dense Retrieval From 8 Examples Zhuyun Dai Vincent Zhao Ji Ma Yi Luan Jianmo Ni Jing Lu A. Bakalov Kelvin Guu Keith B. Hall Ming-Wei Chang RALM 11 223 0 23 Sep 2022
MetricBERT: Text Representation Learning via Self-Supervised Triplet Training Itzik Malkiel Dvir Ginzburg Oren Barkan Avi Caciularu Yoni Weill Noam Koenigstein SSL 31 13 0 13 Aug 2022
Disentangled Modeling of Domain and Relevance for Adaptable Dense Retrieval Jingtao Zhan Qingyao Ai Yiqun Liu Jiaxin Mao Xiaohui Xie Hao Fei Shaoping Ma 35 10 0 11 Aug 2022
Low-Resource Dense Retrieval for Open-Domain Question Answering: A Comprehensive Survey Xiaoyu Shen Svitlana Vakulenko Marco Del Tredici Gianni Barlacchi Bill Byrne Adria de Gispert RALM VLM 28 20 0 05 Aug 2022
Masked Autoencoders As The Unified Learners For Pre-Trained Sentence Representation Alexander H. Liu Samuel J. Yang 32 5 0 30 Jul 2022
Parameter-Efficient Prompt Tuning Makes Generalized and Calibrated Neural Text Retrievers Weng Lam Tam Xiao Liu Kaixuan Ji Lilong Xue Xing Zhang Yuxiao Dong Jiahua Liu Maodi Hu Jie Tang VPVLM 24 27 0 14 Jul 2022