No Parameter Left Behind: How Distillation and Model Size Affect
Zero-Shot Retrieval

No Parameter Left Behind: How Distillation and Model Size Affect Zero-Shot Retrieval

6 June 2022

Hugo Queiroz Abonizio

Rodrigo Nogueira

Papers citing "No Parameter Left Behind: How Distillation and Model Size Affect Zero-Shot Retrieval"

11 / 11 papers shown

Title
Task-aware Retrieval with Instructions Akari Asai Timo Schick Patrick Lewis Xilun Chen Gautier Izacard Sebastian Riedel Hannaneh Hajishirzi Wen-tau Yih 45 88 0 16 Nov 2022
NeuralSearchX: Serving a Multi-billion-parameter Reranker for Multilingual Metasearch at a Low Cost Thales Sales Almeida Thiago Laitz Joao Seródio L. Bonifacio R. Lotufo Rodrigo Nogueira 22 4 0 26 Oct 2022
mRobust04: A Multilingual Version of the TREC Robust 2004 Benchmark Vitor Jeronymo Mauricio Nascimento R. Lotufo Rodrigo Nogueira 23 3 0 27 Sep 2022
Multitask Prompted Training Enables Zero-Shot Task Generalization Victor Sanh Albert Webson Colin Raffel Stephen H. Bach Lintang Sutawika ... T. Bers Stella Biderman Leo Gao Thomas Wolf Alexander M. Rush LRM 215 1,661 0 15 Oct 2021
Zero-Shot Dense Retrieval with Momentum Adversarial Domain Invariant Representations Ji Xin Chenyan Xiong A. Srinivasan Ankita Sharma Damien Jose Paul N. Bennett VLM 83 41 0 14 Oct 2021
Cross-Lingual Open-Domain Question Answering with Answer Sentence Generation Benjamin Muller Luca Soldaini Rik Koncel-Kedziorski Eric Lind Alessandro Moschitti LRM 38 7 0 14 Oct 2021
Unsupervised Corpus Aware Language Model Pre-training for Dense Passage Retrieval Luyu Gao Jamie Callan RALM 175 329 0 12 Aug 2021
BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Models Nandan Thakur Nils Reimers Andreas Rucklé Abhishek Srivastava Iryna Gurevych VLM 264 975 0 17 Apr 2021
RocketQA: An Optimized Training Approach to Dense Passage Retrieval for Open-Domain Question Answering Yingqi Qu Yuchen Ding Jing Liu Kai Liu Ruiyang Ren Xin Zhao Daxiang Dong Hua Wu Haifeng Wang RALM OffRL 214 595 0 16 Oct 2020
Pretrained Transformers for Text Ranking: BERT and Beyond Jimmy J. Lin Rodrigo Nogueira Andrew Yates VLM 244 612 0 13 Oct 2020
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 299 6,984 0 20 Apr 2018