ED2LM: Encoder-Decoder to Language Model for Faster Document Re-ranking Inference

25 April 2022

Zhen Qin

Cicero Nogueira dos Santos

Yi Tay

Donald Metzler

ArXiv (abs)PDF HTML

Papers citing "ED2LM: Encoder-Decoder to Language Model for Faster Document Re-ranking Inference"

30 / 30 papers shown

Title
Transformer Memory as a Differentiable Search Index Yi Tay Vinh Q. Tran Mostafa Dehghani Jianmo Ni Dara Bahri ... Zhe Zhao Jai Gupta Tal Schuster William W. Cohen Donald Metzler 93 285 0 14 Feb 2022
The Efficiency Misnomer Daoyuan Chen Liuyi Yao Dawei Gao Ashish Vaswani Yaliang Li 103 103 0 25 Oct 2021
RocketQAv2: A Joint Training Method for Dense Passage Retrieval and Passage Re-ranking Ruiyang Ren Yingqi Qu Jing Liu Wayne Xin Zhao Qiaoqiao She Hua Wu Haifeng Wang Ji-Rong Wen 272 255 0 14 Oct 2021
SDR: Efficient Neural Re-ranking using Succinct Document Representation Nachshon Cohen Amit Portnoy B. Fetahu A. Ingber AI4TS 116 11 0 03 Oct 2021
Text-to-Text Multi-view Learning for Passage Re-ranking Jia-Huei Ju Jheng-Hong Yang Chuan-Ju Wang AIMat 35 20 0 29 Apr 2021
COIL: Revisit Exact Lexical Match in Information Retrieval with Contextualized Inverted List Luyu Gao Zhuyun Dai Jamie Callan 63 219 0 15 Apr 2021
Overview of the TREC 2020 deep learning track Nick Craswell Bhaskar Mitra Emine Yilmaz Daniel Fernando Campos 127 388 0 15 Feb 2021
RocketQA: An Optimized Training Approach to Dense Passage Retrieval for Open-Domain Question Answering Yingqi Qu Yuchen Ding Jing Liu Kai Liu Ruiyang Ren Xin Zhao Daxiang Dong Hua Wu Haifeng Wang RALM OffRL 255 617 0 16 Oct 2020
End-to-End Synthetic Data Generation for Domain Adaptation of Question Answering Systems Siamak Shakeri Cicero Nogueira dos Santos He Zhu Patrick Ng Feng Nan Zhiguo Wang Ramesh Nallapati Bing Xiang OOD 63 103 0 12 Oct 2020
Beyond [CLS] through Ranking by Generation Cicero Nogueira dos Santos Xiaofei Ma Ramesh Nallapati Zhiheng Huang Bing Xiang RALM 69 30 0 06 Oct 2020
Simplified TinyBERT: Knowledge Distillation for Document Retrieval Xuanang Chen Xianpei Han Kai Hui Le Sun Yingfei Sun 50 25 0 16 Sep 2020
Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrieval Lee Xiong Chenyan Xiong Ye Li Kwok-Fung Tang Jialin Liu Paul N. Bennett Junaid Ahmed Arnold Overwijk 139 1,232 0 01 Jul 2020
Funnel-Transformer: Filtering out Sequential Redundancy for Efficient Language Processing Zihang Dai Guokun Lai Yiming Yang Quoc V. Le 88 234 0 05 Jun 2020
The Cascade Transformer: an Application for Efficient Answer Sentence Selection Luca Soldaini Alessandro Moschitti 68 44 0 05 May 2020
ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERT Omar Khattab Matei A. Zaharia 138 1,376 0 27 Apr 2020
Dense Passage Retrieval for Open-Domain Question Answering Vladimir Karpukhin Barlas Oğuz Sewon Min Patrick Lewis Ledell Yu Wu Sergey Edunov Danqi Chen Wen-tau Yih RALM 201 3,786 0 10 Apr 2020
Overview of the TREC 2019 deep learning track Nick Craswell Bhaskar Mitra Emine Yilmaz Daniel Fernando Campos E. Voorhees 237 495 0 17 Mar 2020
Document Ranking with a Pretrained Sequence-to-Sequence Model Rodrigo Nogueira Zhiying Jiang Jimmy J. Lin 79 584 0 14 Mar 2020
Training Question Answering Models From Synthetic Data Raul Puri Ryan Spring M. Patwary Mohammad Shoeybi Bryan Catanzaro ELM 79 159 0 22 Feb 2020
BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension M. Lewis Yinhan Liu Naman Goyal Marjan Ghazvininejad Abdel-rahman Mohamed Omer Levy Veselin Stoyanov Luke Zettlemoyer AIMat VLM 263 10,851 0 29 Oct 2019
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer Colin Raffel Noam M. Shazeer Adam Roberts Katherine Lee Sharan Narang Michael Matena Yanqi Zhou Wei Li Peter J. Liu AIMat 462 20,317 0 23 Oct 2019
MRQA 2019 Shared Task: Evaluating Generalization in Reading Comprehension Adam Fisch Alon Talmor Robin Jia Minjoon Seo Eunsol Choi Danqi Chen 74 307 0 22 Oct 2019
DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter Victor Sanh Lysandre Debut Julien Chaumond Thomas Wolf 255 7,547 0 02 Oct 2019
Select and Attend: Towards Controllable Content Selection in Text Generation Xiaoyu Shen Jun Suzuki Kentaro Inui Hui Su Dietrich Klakow Satoshi Sekine 52 29 0 10 Sep 2019
Document Expansion by Query Prediction Rodrigo Nogueira Wei Yang Jimmy J. Lin Kyunghyun Cho 114 417 0 17 Apr 2019
Mesh-TensorFlow: Deep Learning for Supercomputers Noam M. Shazeer Youlong Cheng Niki Parmar Dustin Tran Ashish Vaswani ... HyoukJoong Lee O. Milenkovic C. Young Ryan Sepassi Blake Hechtman GNN MoE AI4CE 87 392 0 05 Nov 2018
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.8K 95,175 0 11 Oct 2018
Hierarchical Neural Story Generation Angela Fan M. Lewis Yann N. Dauphin DiffM 183 1,626 0 13 May 2018
MS MARCO: A Human Generated MAchine Reading COmprehension Dataset Payal Bajaj Daniel Fernando Campos Nick Craswell Li Deng Jianfeng Gao ... Mir Rosenberg Xia Song Alina Stoica Saurabh Tiwary Tong Wang RALM 151 2,744 0 28 Nov 2016
Distilling the Knowledge in a Neural Network Geoffrey E. Hinton Oriol Vinyals J. Dean FedML 364 19,733 0 09 Mar 2015