RITA: a Study on Scaling Up Generative Protein Sequence Models

11 May 2022

Papers citing "RITA: a Study on Scaling Up Generative Protein Sequence Models"

8 / 8 papers shown

Title
Multi-level Protein Representation Learning for Blind Mutational Effect Prediction Y. Tan Bingxin Zhou Yuanhong Jiang Yu Wang Liang Hong 33 2 0 08 Jun 2023
Is novelty predictable? Clara Fannjiang Jennifer Listgarten AI4CE 19 14 0 01 Jun 2023
Exploring the Protein Sequence Space with Global Generative Models S. Romero-Romero Sebastian Lindner Noelia Ferruz 37 5 0 03 May 2023
Ankh: Optimized Protein Language Model Unlocks General-Purpose Modelling Ahmed Elnaggar Hazem Essam Wafaa Salah-Eldin Walid Moustafa Mohamed Elkerdawy Charlotte Rochereau B. Rost 167 87 0 16 Jan 2023
Tranception: protein fitness prediction with autoregressive transformers and inference-time retrieval Pascal Notin M. Dias J. Frazer Javier Marchena-Hurtado Aidan Gomez D. Marks Y. Gal 60 178 0 27 May 2022
Train Short, Test Long: Attention with Linear Biases Enables Input Length Extrapolation Ofir Press Noah A. Smith M. Lewis 253 701 0 27 Aug 2021
The Power of Scale for Parameter-Efficient Prompt Tuning Brian Lester Rami Al-Rfou Noah Constant VPVLM 280 3,872 0 18 Apr 2021
Scaling Laws for Neural Language Models Jared Kaplan Sam McCandlish T. Henighan Tom B. Brown B. Chess R. Child Scott Gray Alec Radford Jeff Wu Dario Amodei 264 4,505 0 23 Jan 2020