Pre-training Tasks for Embedding-based Large-scale Retrieval

10 February 2020

Sanjiv Kumar

Papers citing "Pre-training Tasks for Embedding-based Large-scale Retrieval"

35 / 35 papers shown

Title
Unleashing the Power of LLMs in Dense Retrieval with Query Likelihood Modeling Hengran Zhang Keping Bi Jiafeng Guo Xiaojie Sun Shihao Liu Daiting Shi Dawei Yin Xueqi Cheng RALM 294 0 0 07 Apr 2025
Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks Nils Reimers Iryna Gurevych 145 11,951 0 27 Aug 2019
RoBERTa: A Robustly Optimized BERT Pretraining Approach Yinhan Liu Myle Ott Naman Goyal Jingfei Du Mandar Joshi Danqi Chen Omer Levy M. Lewis Luke Zettlemoyer Veselin Stoyanov AIMat 284 24,058 0 26 Jul 2019
ReQA: An Evaluation for End-to-End Answer Retrieval Models Amin Ahmad Noah Constant Yinfei Yang Daniel Cer RALM 22 53 0 10 Jul 2019
XLNet: Generalized Autoregressive Pretraining for Language Understanding Zhilin Yang Zihang Dai Yiming Yang J. Carbonell Ruslan Salakhutdinov Quoc V. Le AI4CE 134 8,377 0 19 Jun 2019
Retrieve, Read, Rerank: Towards End-to-End Multi-Document Reading Comprehension Minghao Hu Yuxing Peng Zhen Huang Dongsheng Li RALM 39 59 0 11 Jun 2019
Latent Retrieval for Weakly Supervised Open Domain Question Answering Kenton Lee Ming-Wei Chang Kristina Toutanova RALM 47 1,001 0 01 Jun 2019
Multi-step Retriever-Reader Interaction for Scalable Open-domain Question Answering Rajarshi Das Shehzaad Dhuliawala Manzil Zaheer Andrew McCallum RALM LRM 40 163 0 14 May 2019
Taming Pretrained Transformers for Extreme Multi-label Text Classification Wei-Cheng Chang Hsiang-Fu Yu Kai Zhong Yiming Yang Inderjit Dhillon 32 20 0 07 May 2019
Distilling Task-Specific Knowledge from BERT into Simple Neural Networks Raphael Tang Yao Lu Linqing Liu Lili Mou Olga Vechtomova Jimmy J. Lin 37 418 0 28 Mar 2019
End-to-End Open-Domain Question Answering with BERTserini Wei Yang Yuqing Xie Aileen Lin Xingyu Li Luchen Tan Kun Xiong Ming Li Jimmy J. Lin RALM 64 494 0 05 Feb 2019
Stochastic Negative Mining for Learning with Large Output Spaces Sashank J. Reddi Satyen Kale Felix X. Yu D. Holtmann-Rice Jiecao Chen Sanjiv Kumar NoLa 27 62 0 16 Oct 2018
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 290 93,660 0 11 Oct 2018
Training Millions of Personalized Dialogue Agents Pierre-Emmanuel Mazaré Samuel Humeau Martin Raison Antoine Bordes 47 267 0 06 Sep 2018
Efficient Training on Very Large Corpora via Gramian Estimation Walid Krichene Nicolas Mayoraz Steffen Rendle Li Zhang Xinyang Yi Lichan Hong Ed H. Chi John R. Anderson 27 47 0 18 Jul 2018
Universal Sentence Encoder Daniel Cer Yinfei Yang Sheng-yi Kong Nan Hua Nicole Limtiaco ... Steve Yuan Chris Tar Yun-hsuan Sung B. Strope R. Kurzweil 89 1,895 0 29 Mar 2018
An efficient framework for learning sentence representations Lajanugen Logeswaran Honglak Lee 35 540 0 07 Mar 2018
Adaptive Sampled Softmax with Kernel Based Sampling Guy Blanc Steffen Rendle BDL 27 73 0 02 Dec 2017
Few-Shot Learning Through an Information Retrieval Lens Eleni Triantafillou R. Zemel R. Urtasun 28 238 0 09 Jul 2017
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 171 129,250 0 12 Jun 2017
Efficient Natural Language Response Suggestion for Smart Reply Matthew Henderson Rami Al-Rfou B. Strope Yun-hsuan Sung László Lukács Ruiqi Guo Sanjiv Kumar Balint Miklos R. Kurzweil 49 426 0 01 May 2017
Discourse-Based Objectives for Fast Unsupervised Sentence Representation Learning Yacine Jernite Samuel R. Bowman David Sontag 32 111 0 23 Apr 2017
A Broad-Coverage Challenge Corpus for Sentence Understanding through Inference Adina Williams Nikita Nangia Samuel R. Bowman 275 4,421 0 18 Apr 2017
Reading Wikipedia to Answer Open-Domain Questions Danqi Chen Adam Fisch Jason Weston Antoine Bordes RALM 66 2,001 0 31 Mar 2017
MS MARCO: A Human Generated MAchine Reading COmprehension Dataset Payal Bajaj Daniel Fernando Campos Nick Craswell Li Deng Jianfeng Gao ... Mir Rosenberg Xia Song Alina Stoica Saurabh Tiwary Tong Wang RALM 99 2,691 0 28 Nov 2016
Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation Yonghui Wu M. Schuster Zhiwen Chen Quoc V. Le Mohammad Norouzi ... Alex Rudnick Oriol Vinyals G. Corrado Macduff Hughes J. Dean AIMat 741 6,756 0 26 Sep 2016
Efficient softmax approximation for GPUs Edouard Grave Armand Joulin Moustapha Cissé David Grangier Hervé Jégou 47 271 0 14 Sep 2016
SQuAD: 100,000+ Questions for Machine Comprehension of Text Pranav Rajpurkar Jian Zhang Konstantin Lopyrev Percy Liang RALM 45 8,035 0 16 Jun 2016
Strategies for Training Large Vocabulary Neural Language Models Welin Chen David Grangier Michael Auli VLM 33 139 0 15 Dec 2015
Quantization based Fast Inner Product Search Ruiqi Guo Sanjiv Kumar K. Choromanski David Simcha 51 109 0 04 Sep 2015
A large annotated corpus for learning natural language inference Samuel R. Bowman Gabor Angeli Christopher Potts Christopher D. Manning 140 4,256 0 21 Aug 2015
Skip-Thought Vectors Ryan Kiros Yukun Zhu Ruslan Salakhutdinov R. Zemel Antonio Torralba R. Urtasun Sanja Fidler SSL 63 2,404 0 22 Jun 2015
Distilling the Knowledge in a Neural Network Geoffrey E. Hinton Oriol Vinyals J. Dean FedML 57 19,448 0 09 Mar 2015
Asymmetric LSH (ALSH) for Sublinear Time Maximum Inner Product Search (MIPS) Anshumali Shrivastava Ping Li 64 470 0 22 May 2014
Distributed Representations of Sentences and Documents Quoc V. Le Tomas Mikolov FaML 104 9,229 0 16 May 2014