Query-as-context Pre-training for Dense Passage Retrieval

Query-as-context Pre-training for Dense Passage Retrieval

19 December 2022

Papers citing "Query-as-context Pre-training for Dense Passage Retrieval"

18 / 18 papers shown

Title
NExtLong: Toward Effective Long-Context Training without Long Documents Chaochen Gao Xing Wu Zijia Lin Debing Zhang Songlin Hu SyDa 68 1 0 22 Jan 2025
QAEncoder: Towards Aligned Representation Learning in Question Answering System Zhengren Wang Qinhan Yu Shida Wei Zhiyu Li Feiyu Xiong Xiaoxing Wang Simin Niu Hao Liang Wentao Zhang RALM 25 1 0 30 Sep 2024
Quest: Query-centric Data Synthesis Approach for Long-context Scaling of Large Language Model Chaochen Gao Xing Wu Qingfang Fu Songlin Hu SyDa 34 5 0 30 May 2024
DocReLM: Mastering Document Retrieval with Language Model Gengchen Wei Xinle Pang Tianning Zhang Yu Sun Xun Qian Chen Lin Han-Sen Zhong Wanli Ouyang RALM 36 0 0 19 May 2024
Drop your Decoder: Pre-training with Bag-of-Word Prediction for Dense Passage Retrieval Guangyuan Ma Xing Wu Zijia Lin Songlin Hu 29 3 0 20 Jan 2024
Pre-training with Large Language Model-based Document Expansion for Dense Passage Retrieval Guangyuan Ma Xing Wu Peng Wang Zijia Lin Songlin Hu RALM 24 10 0 16 Aug 2023
CoT-MoTE: Exploring ConTextual Masked Auto-Encoder Pre-training with Mixture-of-Textual-Experts for Passage Retrieval Guangyuan Ma Xing Wu Peng Wang Songlin Hu MoE RALM 13 5 0 20 Apr 2023
HLATR: Enhance Multi-stage Text Retrieval with Hybrid List Aware Transformer Reranking Yanzhao Zhang Dingkun Long Guangwei Xu Pengjun Xie 43 29 0 21 May 2022
Masked Autoencoders Are Scalable Vision Learners Kaiming He Xinlei Chen Saining Xie Yanghao Li Piotr Dollár Ross B. Girshick ViT TPM 305 7,434 0 11 Nov 2021
RocketQAv2: A Joint Training Method for Dense Passage Retrieval and Passage Re-ranking Ruiyang Ren Yingqi Qu Jing Liu Wayne Xin Zhao Qiaoqiao She Hua-Hong Wu Haifeng Wang Ji-Rong Wen 133 248 0 14 Oct 2021
SPLADE v2: Sparse Lexical and Expansion Model for Information Retrieval Thibault Formal Carlos Lassance Benjamin Piwowarski S. Clinchant 196 186 0 21 Sep 2021
PAIR: Leveraging Passage-Centric Similarity Relation for Improving Dense Passage Retrieval Ruiyang Ren Shangwen Lv Yingqi Qu Jing Liu Wayne Xin Zhao Qiaoqiao She Hua-Hong Wu Haifeng Wang Ji-Rong Wen 128 90 0 13 Aug 2021
Unsupervised Corpus Aware Language Model Pre-training for Dense Passage Retrieval Luyu Gao Jamie Callan RALM 163 329 0 12 Aug 2021
BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Models Nandan Thakur Nils Reimers Andreas Rucklé Abhishek Srivastava Iryna Gurevych VLM 231 966 0 17 Apr 2021
Overview of the TREC 2020 deep learning track Nick Craswell Bhaskar Mitra Emine Yilmaz Daniel Fernando Campos 54 368 0 15 Feb 2021
RocketQA: An Optimized Training Approach to Dense Passage Retrieval for Open-Domain Question Answering Yingqi Qu Yuchen Ding Jing Liu Kai Liu Ruiyang Ren Xin Zhao Daxiang Dong Hua-Hong Wu Haifeng Wang RALM OffRL 214 593 0 16 Oct 2020
Pretrained Transformers for Text Ranking: BERT and Beyond Jimmy J. Lin Rodrigo Nogueira Andrew Yates VLM 219 608 0 13 Oct 2020
Overview of the TREC 2019 deep learning track Nick Craswell Bhaskar Mitra Emine Yilmaz Daniel Fernando Campos E. Voorhees 180 465 0 17 Mar 2020