Pre-training Tasks for Embedding-based Large-scale Retrieval

10 February 2020

Sanjiv Kumar

Papers citing "Pre-training Tasks for Embedding-based Large-scale Retrieval"

35 / 35 papers shown

Title
Unleashing the Power of LLMs in Dense Retrieval with Query Likelihood Modeling Hengran Zhang Keping Bi Jiafeng Guo Xiaojie Sun Shihao Liu Daiting Shi Dawei Yin Xueqi Cheng RALM 314 0 0 07 Apr 2025
Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks Nils Reimers Iryna Gurevych 346 11,979 0 27 Aug 2019
RoBERTa: A Robustly Optimized BERT Pretraining Approach Yinhan Liu Myle Ott Naman Goyal Jingfei Du Mandar Joshi Danqi Chen Omer Levy M. Lewis Luke Zettlemoyer Veselin Stoyanov AIMat 322 24,160 0 26 Jul 2019
ReQA: An Evaluation for End-to-End Answer Retrieval Models Amin Ahmad Noah Constant Yinfei Yang Daniel Cer RALM 22 53 0 10 Jul 2019
XLNet: Generalized Autoregressive Pretraining for Language Understanding Zhilin Yang Zihang Dai Yiming Yang J. Carbonell Ruslan Salakhutdinov Quoc V. Le AI4CE 148 8,386 0 19 Jun 2019
Retrieve, Read, Rerank: Towards End-to-End Multi-Document Reading Comprehension Minghao Hu Yuxing Peng Zhen Huang Dongsheng Li RALM 39 59 0 11 Jun 2019
Latent Retrieval for Weakly Supervised Open Domain Question Answering Kenton Lee Ming-Wei Chang Kristina Toutanova RALM 54 1,004 0 01 Jun 2019
Multi-step Retriever-Reader Interaction for Scalable Open-domain Question Answering Rajarshi Das Shehzaad Dhuliawala Manzil Zaheer Andrew McCallum RALM LRM 41 163 0 14 May 2019
Taming Pretrained Transformers for Extreme Multi-label Text Classification Wei-Cheng Chang Hsiang-Fu Yu Kai Zhong Yiming Yang Inderjit Dhillon 32 20 0 07 May 2019
Distilling Task-Specific Knowledge from BERT into Simple Neural Networks Raphael Tang Yao Lu Linqing Liu Lili Mou Olga Vechtomova Jimmy J. Lin 45 419 0 28 Mar 2019
End-to-End Open-Domain Question Answering with BERTserini Wei Yang Yuqing Xie Aileen Lin Xingyu Li Luchen Tan Kun Xiong Ming Li Jimmy J. Lin RALM 69 494 0 05 Feb 2019
Stochastic Negative Mining for Learning with Large Output Spaces Sashank J. Reddi Satyen Kale Felix X. Yu D. Holtmann-Rice Jiecao Chen Sanjiv Kumar NoLa 31 62 0 16 Oct 2018
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 629 93,936 0 11 Oct 2018
Training Millions of Personalized Dialogue Agents Pierre-Emmanuel Mazaré Samuel Humeau Martin Raison Antoine Bordes 55 267 0 06 Sep 2018
Efficient Training on Very Large Corpora via Gramian Estimation Walid Krichene Nicolas Mayoraz Steffen Rendle Li Zhang Xinyang Yi Lichan Hong Ed H. Chi John R. Anderson 31 47 0 18 Jul 2018
Universal Sentence Encoder Daniel Cer Yinfei Yang Sheng-yi Kong Nan Hua Nicole Limtiaco ... Steve Yuan Chris Tar Yun-hsuan Sung B. Strope R. Kurzweil 131 1,897 0 29 Mar 2018
An efficient framework for learning sentence representations Lajanugen Logeswaran Honglak Lee 50 540 0 07 Mar 2018
Adaptive Sampled Softmax with Kernel Based Sampling Guy Blanc Steffen Rendle BDL 31 73 0 02 Dec 2017
Few-Shot Learning Through an Information Retrieval Lens Eleni Triantafillou R. Zemel R. Urtasun 30 238 0 09 Jul 2017
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 256 129,831 0 12 Jun 2017
Efficient Natural Language Response Suggestion for Smart Reply Matthew Henderson Rami Al-Rfou B. Strope Yun-hsuan Sung László Lukács Ruiqi Guo Sanjiv Kumar Balint Miklos R. Kurzweil 68 427 0 01 May 2017
Discourse-Based Objectives for Fast Unsupervised Sentence Representation Learning Yacine Jernite Samuel R. Bowman David Sontag 47 111 0 23 Apr 2017
A Broad-Coverage Challenge Corpus for Sentence Understanding through Inference Adina Williams Nikita Nangia Samuel R. Bowman 308 4,444 0 18 Apr 2017
Reading Wikipedia to Answer Open-Domain Questions Danqi Chen Adam Fisch Jason Weston Antoine Bordes RALM 70 2,003 0 31 Mar 2017
MS MARCO: A Human Generated MAchine Reading COmprehension Dataset Payal Bajaj Daniel Fernando Campos Nick Craswell Li Deng Jianfeng Gao ... Mir Rosenberg Xia Song Alina Stoica Saurabh Tiwary Tong Wang RALM 103 2,698 0 28 Nov 2016
Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation Yonghui Wu M. Schuster Zhiwen Chen Quoc V. Le Mohammad Norouzi ... Alex Rudnick Oriol Vinyals G. Corrado Macduff Hughes J. Dean AIMat 759 6,768 0 26 Sep 2016
Efficient softmax approximation for GPUs Edouard Grave Armand Joulin Moustapha Cissé David Grangier Hervé Jégou 53 271 0 14 Sep 2016
SQuAD: 100,000+ Questions for Machine Comprehension of Text Pranav Rajpurkar Jian Zhang Konstantin Lopyrev Percy Liang RALM 82 8,067 0 16 Jun 2016
Strategies for Training Large Vocabulary Neural Language Models Welin Chen David Grangier Michael Auli VLM 35 139 0 15 Dec 2015
Quantization based Fast Inner Product Search Ruiqi Guo Sanjiv Kumar K. Choromanski David Simcha 54 109 0 04 Sep 2015
A large annotated corpus for learning natural language inference Samuel R. Bowman Gabor Angeli Christopher Potts Christopher D. Manning 167 4,256 0 21 Aug 2015
Skip-Thought Vectors Ryan Kiros Yukun Zhu Ruslan Salakhutdinov R. Zemel Antonio Torralba R. Urtasun Sanja Fidler SSL 97 2,405 0 22 Jun 2015
Distilling the Knowledge in a Neural Network Geoffrey E. Hinton Oriol Vinyals J. Dean FedML 79 19,448 0 09 Mar 2015
Asymmetric LSH (ALSH) for Sublinear Time Maximum Inner Product Search (MIPS) Anshumali Shrivastava Ping Li 82 470 0 22 May 2014
Distributed Representations of Sentences and Documents Quoc V. Le Tomas Mikolov FaML 128 9,231 0 16 May 2014