Efficiently Teaching an Effective Dense Retriever with Balanced Topic Aware Sampling

14 April 2021

Papers citing "Efficiently Teaching an Effective Dense Retriever with Balanced Topic Aware Sampling"

42 / 92 papers shown

Title
PROD: Progressive Distillation for Dense Retrieval Zhenghao Lin Yeyun Gong Xiao Liu Hang Zhang Chen Lin ... Jian Jiao Jing Lu Daxin Jiang Rangan Majumder Nan Duan 51 27 0 27 Sep 2022
ConTextual Masked Auto-Encoder for Dense Passage Retrieval Xing Wu Guangyuan Ma Meng Lin Zijia Lin Zhongyuan Wang Songlin Hu RALM 33 24 0 16 Aug 2022
Evaluating Dense Passage Retrieval using Transformers Nima Sadri 15 0 0 15 Aug 2022
Continuous Active Learning Using Pretrained Transformers Nima Sadri G. Cormack KELM 29 2 0 15 Aug 2022
Disentangled Modeling of Domain and Relevance for Adaptable Dense Retrieval Jingtao Zhan Qingyao Ai Yiqun Liu Jiaxin Mao Xiaohui Xie Hao Fei Shaoping Ma 43 10 0 11 Aug 2022
NGAME: Negative Mining-aware Mini-batching for Extreme Classification Kunal Dahiya Nilesh Gupta Deepak Saini Akshay Soni Yajun Wang ... Sonu Mehta Ramachandran Ramjee Sumeet Agarwal Purushottam Kar Manik Varma 44 35 0 10 Jul 2022
An Efficiency Study for SPLADE Models Carlos Lassance S. Clinchant 48 70 0 08 Jul 2022
Are We There Yet? A Decision Framework for Replacing Term Based Retrieval with Dense Retrieval Systems Sebastian Hofstatter Nick Craswell Bhaskar Mitra Hamed Zamani Allan Hanbury 43 5 0 26 Jun 2022
Neural Retriever and Go Beyond: A Thesis Proposal Man Luo 37 1 0 31 May 2022
Optimizing Test-Time Query Representations for Dense Retrieval Mujeen Sung Jungsoo Park Jaewoo Kang Danqi Chen Jinhyuk Lee 38 5 0 25 May 2022
From Distillation to Hard Negative Sampling: Making Sparse Neural IR Models More Effective Thibault Formal Carlos Lassance Benjamin Piwowarski S. Clinchant VLM 33 139 0 10 May 2022
Curriculum Learning for Dense Retrieval Distillation Hansi Zeng Hamed Zamani Vishwa Vinay 24 49 0 28 Apr 2022
A Thorough Examination on Zero-shot Dense Retrieval Ruiyang Ren Yingqi Qu Qingbin Liu Wayne Xin Zhao Qifei Wu Yuchen Ding Hua Wu Haifeng Wang Ji-Rong Wen 37 41 0 27 Apr 2022
Entity-Conditioned Question Generation for Robust Attention Distribution in Neural Information Retrieval R. Reddy Md Arafat Sultan M. Franz Avirup Sil Heng Ji 32 7 0 24 Apr 2022
Parameter-Efficient Neural Reranking for Cross-Lingual and Multilingual Retrieval Robert Litschko Ivan Vulić Goran Glavaš LRM 42 14 0 05 Apr 2022
LaPraDoR: Unsupervised Pretrained Dense Retriever for Zero-Shot Text Retrieval Canwen Xu Daya Guo Nan Duan Julian McAuley RALM VLM 29 46 0 11 Mar 2022
Text and Code Embeddings by Contrastive Pre-Training Arvind Neelakantan Tao Xu Raul Puri Alec Radford Jesse Michael Han ... Tabarak Khan Toki Sherbakov Joanne Jang Peter Welinder Lilian Weng SSL AI4TS 232 425 0 24 Jan 2022
Progressively Optimized Bi-Granular Document Representation for Scalable Embedding Based Retrieval Shitao Xiao Zheng Liu Weihao Han Jianjin Zhang Yingxia Shao ... Hao Sun Denvy Deng Liangjie Zhang Qi Zhang Xing Xie 35 17 0 14 Jan 2022
Continual Learning of Long Topic Sequences in Neural Information Retrieval Thomas Gerald Laure Soulier CLL 43 4 0 10 Jan 2022
Sparsifying Sparse Representations for Passage Retrieval by Top- $k$ Masking Jheng-Hong Yang Xueguang Ma Jimmy J. Lin 18 13 0 17 Dec 2021
Unsupervised Dense Information Retrieval with Contrastive Learning Gautier Izacard Mathilde Caron Lucas Hosseini Sebastian Riedel Piotr Bojanowski Armand Joulin Edouard Grave RALM 40 817 0 16 Dec 2021
CODER: An efficient framework for improving retrieval through COntextual Document Embedding Reranking George Zerveas Navid Rekabsaz Daniel Cohen Carsten Eickhoff 31 8 0 16 Dec 2021
Large Dual Encoders Are Generalizable Retrievers Jianmo Ni Chen Qu Jing Lu Zhuyun Dai Gustavo Hernández Ábrego ... Vincent Zhao Yi Luan Keith B. Hall Ming-Wei Chang Yinfei Yang DML 38 434 0 15 Dec 2021
GPL: Generative Pseudo Labeling for Unsupervised Domain Adaptation of Dense Retrieval Kexin Wang Nandan Thakur Nils Reimers Iryna Gurevych VLM 24 149 0 14 Dec 2021
A Study on Token Pruning for ColBERT Carlos Lassance Maroua Maachou Joohee Park S. Clinchant 33 13 0 13 Dec 2021
Match Your Words! A Study of Lexical Matching in Neural Information Retrieval Thibault Formal Benjamin Piwowarski S. Clinchant 22 20 0 10 Dec 2021
ColBERTv2: Effective and Efficient Retrieval via Lightweight Late Interaction Keshav Santhanam Omar Khattab Jon Saad-Falcon Christopher Potts Matei A. Zaharia 39 385 0 02 Dec 2021
Zero-Shot Dense Retrieval with Momentum Adversarial Domain Invariant Representations Ji Xin Chenyan Xiong A. Srinivasan Ankita Sharma Damien Jose Paul N. Bennett VLM 83 41 0 14 Oct 2021
RocketQAv2: A Joint Training Method for Dense Passage Retrieval and Passage Re-ranking Ruiyang Ren Yingqi Qu Jing Liu Wayne Xin Zhao Qiaoqiao She Hua Wu Haifeng Wang Ji-Rong Wen 141 249 0 14 Oct 2021
Salient Phrase Aware Dense Retrieval: Can a Dense Retriever Imitate a Sparse One? Xilun Chen Kushal Lakhotia Barlas Oğuz Anchit Gupta Patrick Lewis Stanislav Peshterliev Yashar Mehdad Sonal Gupta Wen-tau Yih 58 68 0 13 Oct 2021
A Time-Optimized Content Creation Workflow for Remote Teaching Sebastian Hofstatter Sophia Althammer Mete Sertkan Allan Hanbury 14 0 0 11 Oct 2021
A Proposed Conceptual Framework for a Representational Approach to Information Retrieval Jimmy J. Lin 21 51 0 04 Oct 2021
SPLADE v2: Sparse Lexical and Expansion Model for Information Retrieval Thibault Formal Carlos Lassance Benjamin Piwowarski S. Clinchant 209 186 0 21 Sep 2021
Improving Query Representations for Dense Retrieval with Pseudo Relevance Feedback HongChien Yu Chenyan Xiong Jamie Callan RALM 33 68 0 30 Aug 2021
Mr. TyDi: A Multi-lingual Benchmark for Dense Retrieval Xinyu Crystina Zhang Xueguang Ma Peng Shi Jimmy J. Lin 25 110 0 19 Aug 2021
A Few Brief Notes on DeepImpact, COIL, and a Conceptual Framework for Information Retrieval Techniques Jimmy J. Lin Xueguang Ma 30 144 0 28 Jun 2021
BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Models Nandan Thakur Nils Reimers Andreas Rucklé Abhishek Srivastava Iryna Gurevych VLM 270 977 0 17 Apr 2021
Overview of the TREC 2020 deep learning track Nick Craswell Bhaskar Mitra Emine Yilmaz Daniel Fernando Campos 54 369 0 15 Feb 2021
The Expando-Mono-Duo Design Pattern for Text Ranking with Pretrained Sequence-to-Sequence Models Ronak Pradeep Rodrigo Nogueira Jimmy J. Lin MoE 67 167 0 14 Jan 2021
Distilling Knowledge from Reader to Retriever for Question Answering Gautier Izacard Edouard Grave RALM 185 251 0 08 Dec 2020
RocketQA: An Optimized Training Approach to Dense Passage Retrieval for Open-Domain Question Answering Yingqi Qu Yuchen Ding Jing Liu Kai Liu Ruiyang Ren Xin Zhao Daxiang Dong Hua Wu Haifeng Wang RALM OffRL 214 595 0 16 Oct 2020
Pretrained Transformers for Text Ranking: BERT and Beyond Jimmy J. Lin Rodrigo Nogueira Andrew Yates VLM 244 612 0 13 Oct 2020