Strategies for Pretraining Neural Operators

Strategies for Pretraining Neural Operators

12 June 2024

Anthony Y. Zhou

AmirPouya Hemmasian

Amir Barati Farimani

Papers citing "Strategies for Pretraining Neural Operators"

13 / 13 papers shown

Title
Text2PDE: Latent Diffusion Models for Accessible Physics Simulation Anthony Y. Zhou Zijie Li Michael Schneier John R Buchanan Jr Amir Barati Farimani AI4CE DiffM 57 5 0 02 Oct 2024
Explain Like I'm Five: Using LLMs to Improve PDE Surrogate Models with Text Cooper Lorsung Amir Barati Farimani AI4CE 60 1 0 02 Oct 2024
Pretraining Codomain Attention Neural Operators for Solving Multiphysics PDEs Md Ashiqur Rahman Robert Joseph George Mogab Elleithy Daniel Leibovici Zong-Yi Li ... Julius Berner Raymond A. Yeh Jean Kossaifi Kamyar Azizzadenesheli A. Anandkumar AI4CE 54 19 0 19 Mar 2024
PICL: Physics Informed Contrastive Learning for Partial Differential Equations Cooper Lorsung A. Farimani AI4CE 33 4 0 29 Jan 2024
A foundational neural operator that continuously learns without forgetting Tapas Tripura Souvik Chakraborty CLL 43 7 0 29 Oct 2023
Towards Multi-spatiotemporal-scale Generalized PDE Modeling Jayesh K. Gupta Johannes Brandstetter AI4CE 53 117 0 30 Sep 2022
Improving Molecular Contrastive Learning via Faulty Negative Mitigation and Decomposed Fragment Contrast Yuyang Wang Rishikesh Magar Chen Liang A. Farimani 40 78 0 18 Feb 2022
VLP: A Survey on Vision-Language Pre-training Feilong Chen Duzhen Zhang Minglun Han Xiuyi Chen Jing Shi Shuang Xu Bo Xu VLM 82 212 0 18 Feb 2022
Masked Autoencoders Are Scalable Vision Learners Kaiming He Xinlei Chen Saining Xie Yanghao Li Piotr Dollár Ross B. Girshick ViT TPM 305 7,434 0 11 Nov 2021
Fourier Neural Operator for Parametric Partial Differential Equations Zong-Yi Li Nikola B. Kovachki Kamyar Azizzadenesheli Burigede Liu K. Bhattacharya Andrew M. Stuart Anima Anandkumar AI4CE 203 2,282 0 18 Oct 2020
Scaling Laws for Neural Language Models Jared Kaplan Sam McCandlish T. Henighan Tom B. Brown B. Chess R. Child Scott Gray Alec Radford Jeff Wu Dario Amodei 228 4,460 0 23 Jan 2020
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks Chelsea Finn Pieter Abbeel Sergey Levine OOD 290 11,681 0 09 Mar 2017
U-Net: Convolutional Networks for Biomedical Image Segmentation Olaf Ronneberger Philipp Fischer Thomas Brox SSeg 3DV 288 75,800 0 18 May 2015