Unsupervised Corpus Aware Language Model Pre-training for Dense Passage Retrieval

12 August 2021

Papers citing "Unsupervised Corpus Aware Language Model Pre-training for Dense Passage Retrieval"

18 / 68 papers shown

Title
Disentangled Modeling of Domain and Relevance for Adaptable Dense Retrieval Jingtao Zhan Qingyao Ai Yiqun Liu Jiaxin Mao Xiaohui Xie M. Zhang Shaoping Ma 30 10 0 11 Aug 2022
Masked Autoencoders As The Unified Learners For Pre-Trained Sentence Representation Alexander H. Liu Samuel J. Yang 29 5 0 30 Jul 2022
An Efficiency Study for SPLADE Models Carlos Lassance S. Clinchant 37 70 0 08 Jul 2022
Bridging the Gap Between Indexing and Retrieval for Differentiable Search Index with Query Generation Shengyao Zhuang Houxing Ren Linjun Shou Jian Pei Ming Gong Guido Zuccon Daxin Jiang 40 65 0 21 Jun 2022
RetroMAE: Pre-Training Retrieval-oriented Language Models Via Masked Auto-Encoder Shitao Xiao Zheng Liu Yingxia Shao Zhao Cao RALM 118 109 0 24 May 2022
From Distillation to Hard Negative Sampling: Making Sparse Neural IR Models More Effective Thibault Formal Carlos Lassance Benjamin Piwowarski S. Clinchant VLM 26 138 0 10 May 2022
Curriculum Learning for Dense Retrieval Distillation Hansi Zeng Hamed Zamani Vishwa Vinay 24 49 0 28 Apr 2022
METRO: Efficient Denoising Pretraining of Large Scale Autoencoding Language Models with Model Generated Signals Payal Bajaj Chenyan Xiong Guolin Ke Xiaodong Liu Di He Saurabh Tiwary Tie-Yan Liu Paul N. Bennett Xia Song Jianfeng Gao 47 32 0 13 Apr 2022
DuReader_retrieval: A Large-scale Chinese Benchmark for Passage Retrieval from Web Search Engine Yifu Qiu Hongyu Li Yingqi Qu Ying Chen Qiaoqiao She Jing Liu Hua-Hong Wu Haifeng Wang RALM 38 15 0 19 Mar 2022
LaPraDoR: Unsupervised Pretrained Dense Retriever for Zero-Shot Text Retrieval Canwen Xu Daya Guo Nan Duan Julian McAuley RALM VLM 18 46 0 11 Mar 2022
Tevatron: An Efficient and Flexible Toolkit for Dense Retrieval Luyu Gao Xueguang Ma Jimmy J. Lin Jamie Callan 32 76 0 11 Mar 2022
Unsupervised Dense Information Retrieval with Contrastive Learning Gautier Izacard Mathilde Caron Lucas Hosseini Sebastian Riedel Piotr Bojanowski Armand Joulin Edouard Grave RALM 38 808 0 16 Dec 2021
CODER: An efficient framework for improving retrieval through COntextual Document Embedding Reranking George Zerveas Navid Rekabsaz Daniel Cohen Carsten Eickhoff 31 8 0 16 Dec 2021
A Study on Token Pruning for ColBERT Carlos Lassance Maroua Maachou Joohee Park S. Clinchant 27 13 0 13 Dec 2021
ColBERTv2: Effective and Efficient Retrieval via Lightweight Late Interaction Keshav Santhanam Omar Khattab Jon Saad-Falcon Christopher Potts Matei A. Zaharia 39 383 0 02 Dec 2021
Encoder Adaptation of Dense Passage Retrieval for Open-Domain Question Answering Minghan Li Jimmy J. Lin AI4CE 25 9 0 04 Oct 2021
RocketQA: An Optimized Training Approach to Dense Passage Retrieval for Open-Domain Question Answering Yingqi Qu Yuchen Ding Jing Liu Kai Liu Ruiyang Ren Xin Zhao Daxiang Dong Hua-Hong Wu Haifeng Wang RALM OffRL 214 594 0 16 Oct 2020
Efficient Estimation of Word Representations in Vector Space Tomáš Mikolov Kai Chen G. Corrado J. Dean 3DV 272 31,267 0 16 Jan 2013