ProGen2: Exploring the Boundaries of Protein Language Models

ProGen2: Exploring the Boundaries of Protein Language Models

27 June 2022

Erik Nijkamp

Jeffrey A. Ruffolo

Eli N. Weinstein

Papers citing "ProGen2: Exploring the Boundaries of Protein Language Models"

15 / 15 papers shown

Title
Large Language Models in Bioinformatics: A Survey Zhilin Wang Zikang Wang Jiyue Jiang Pengan Chen Xiangyu Shi Yu-Hu Li AI4CE LM&MA 63 1 0 06 Mar 2025
Recent advances in deep learning and language models for studying the microbiome Binghao Yan Yunbi Nam Lingyao Li Rebecca A Deek Hongzhe Li Siyuan Ma 20 1 0 15 Sep 2024
Preference optimization of protein language models as a multi-objective binder design paradigm Pouria A. Mistani Venkatesh Mysore 32 6 0 07 Mar 2024
Materials Informatics Transformer: A Language Model for Interpretable Materials Properties Prediction Hongshuo Huang Rishikesh Magar Chang Xu A. Farimani AI4CE 38 4 0 30 Aug 2023
Multi-level Protein Representation Learning for Blind Mutational Effect Prediction Y. Tan Bingxin Zhou Yuanhong Jiang Yu Wang Liang Hong 26 2 0 08 Jun 2023
Is novelty predictable? Clara Fannjiang Jennifer Listgarten AI4CE 17 14 0 01 Jun 2023
Accurate and Definite Mutational Effect Prediction with Lightweight Equivariant Graph Neural Networks Bingxin Zhou Outongyi Lv Kai Yi Xinye Xiong P. Tan Liang Hong Yu Wang 26 4 0 13 Apr 2023
BloombergGPT: A Large Language Model for Finance Shijie Wu Ozan Irsoy Steven Lu Vadim Dabravolski Mark Dredze Sebastian Gehrmann P. Kambadur David S. Rosenberg Gideon Mann AIFin 76 786 0 30 Mar 2023
ProtST: Multi-Modality Learning of Protein Sequences and Biomedical Texts Minghao Xu Xinyu Yuan Santiago Miret Jian Tang AI4TS 27 95 0 28 Jan 2023
Ankh: Optimized Protein Language Model Unlocks General-Purpose Modelling Ahmed Elnaggar Hazem Essam Wafaa Salah-Eldin Walid Moustafa Mohamed Elkerdawy Charlotte Rochereau B. Rost 167 86 0 16 Jan 2023
Generative Antibody Design for Complementary Chain Pairing Sequences through Encoder-Decoder Language Model S. K. Chu K. Wei AI4CE 19 7 0 06 Jan 2023
SESNet: sequence-structure feature-integrated deep learning method for data-efficient protein engineering Mingchen Li Liqi Kang Y. Xiong Yu Wang Guisheng Fan P. Tan Liang Hong 16 22 0 29 Dec 2022
Tranception: protein fitness prediction with autoregressive transformers and inference-time retrieval Pascal Notin M. Dias J. Frazer Javier Marchena-Hurtado Aidan N. Gomez D. Marks Y. Gal 55 177 0 27 May 2022
Scaling Laws for Neural Language Models Jared Kaplan Sam McCandlish T. Henighan Tom B. Brown B. Chess R. Child Scott Gray Alec Radford Jeff Wu Dario Amodei 246 4,489 0 23 Jan 2020
Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism M. Shoeybi M. Patwary Raul Puri P. LeGresley Jared Casper Bryan Catanzaro MoE 245 1,821 0 17 Sep 2019