GeneMask: Fast Pretraining of Gene Sequences to Enable Few-Shot Learning

29 July 2023

Papers citing "GeneMask: Fast Pretraining of Gene Sequences to Enable Few-Shot Learning"

5 / 5 papers shown

Title
Unlocking Efficiency: Adaptive Masking for Gene Transformer Models Soumyadeep Roy S. Sural Niloy Ganguly MedIm 40 0 0 13 Aug 2024
Fine-Grained Zero-Shot Learning with DNA as Side Information Sarkhan Badirli Zeynep Akata G. Mohler Christel Picard M. M. Dundar SyDa BDL 46 34 0 29 Sep 2021
Big Bird: Transformers for Longer Sequences Manzil Zaheer Guru Guruganesh Kumar Avinava Dubey Joshua Ainslie Chris Alberti ... Philip Pham Anirudh Ravula Qifan Wang Li Yang Amr Ahmed VLM 282 2,015 0 28 Jul 2020
Exploiting Cloze Questions for Few Shot Text Classification and Natural Language Inference Timo Schick Hinrich Schütze 258 1,589 0 21 Jan 2020
On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima N. Keskar Dheevatsa Mudigere J. Nocedal M. Smelyanskiy P. T. P. Tang ODL 287 2,890 0 15 Sep 2016