TwinBERT: Distilling Knowledge to Twin-Structured BERT Models for Efficient Retrieval

14 February 2020

Papers citing "TwinBERT: Distilling Knowledge to Twin-Structured BERT Models for Efficient Retrieval"

12 / 12 papers shown

Title
Can Cross Encoders Produce Useful Sentence Embeddings? Haritha Ananthakrishnan Julian T Dolby Harsha Kokel Horst Samulowitz Kavitha Srinivas 66 0 0 05 Feb 2025
SimA: Simple Softmax-free Attention for Vision Transformers Soroush Abbasi Koohpayegani Hamed Pirsiavash 24 25 0 17 Jun 2022
RetroMAE: Pre-Training Retrieval-oriented Language Models Via Masked Auto-Encoder Shitao Xiao Zheng Liu Yingxia Shao Bo Zhao RALM 123 110 0 24 May 2022
Establishing Strong Baselines for TripClick Health Retrieval Sebastian Hofstatter Sophia Althammer Mete Sertkan Allan Hanbury MedIm 36 12 0 02 Jan 2022
Semi-Siamese Bi-encoder Neural Ranking Model Using Lightweight Fine-Tuning Euna Jung Jaekeol Choi Wonjong Rhee 22 13 0 28 Oct 2021
mMARCO: A Multilingual Version of the MS MARCO Passage Ranking Dataset L. Bonifacio Vitor Jeronymo Hugo Queiroz Abonizio Israel Campiotti Marzieh Fadaee R. Lotufo Rodrigo Nogueira 42 108 0 31 Aug 2021
Hybrid Encoder: Towards Efficient and Precise Native AdsRecommendation via Hybrid Transformer Encoding Networks Junhan Yang Zheng Liu Bowen Jin Jianxun Lian Defu Lian Akshay Soni Eun Yong Kang Yajun Wang Guangzhong Sun Xing Xie 46 1 0 22 Apr 2021
Speech Recognition by Simply Fine-tuning BERT Wen-Chin Huang Chia-Hua Wu Shang-Bao Luo Kuan-Yu Chen Hsin-Min Wang T. Toda 72 28 0 30 Jan 2021
TextGNN: Improving Text Encoder via Graph Neural Network in Sponsored Search Jason Zhu Yanling Cui Yuming Liu Hao Sun Xue Li Markus Pelger Tianqi Yan Liangjie Zhang Ruofei Zhang Huasha Zhao AI4CE 72 75 0 15 Jan 2021
Pretrained Transformers for Text Ranking: BERT and Beyond Jimmy J. Lin Rodrigo Nogueira Andrew Yates VLM 244 612 0 13 Oct 2020
Pre-trained Models for Natural Language Processing: A Survey Xipeng Qiu Tianxiang Sun Yige Xu Yunfan Shao Ning Dai Xuanjing Huang LM&MA VLM 243 1,452 0 18 Mar 2020
Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation Yonghui Wu M. Schuster Z. Chen Quoc V. Le Mohammad Norouzi ... Alex Rudnick Oriol Vinyals G. Corrado Macduff Hughes J. Dean AIMat 718 6,748 0 26 Sep 2016