Data-Efficient Operator Learning via Unsupervised Pretraining and
In-Context Learning

Data-Efficient Operator Learning via Unsupervised Pretraining and In-Context Learning

24 February 2024

Shashank Subramanian

Dmitriy Morozov

Michael W. Mahoney

Papers citing "Data-Efficient Operator Learning via Unsupervised Pretraining and In-Context Learning"

12 / 12 papers shown

Title
Paving the way for scientific foundation models: enhancing generalization and robustness in PDEs with constraint-aware pre-training A. Totounferoush Serge Kotchourko Michael W. Mahoney S. AI4CE 34 0 0 24 Mar 2025
A Multimodal PDE Foundation Model for Prediction and Scientific Text Descriptions Elisa Negrini Yuxuan Liu Liu Yang Stanley Osher Hayden Schaeffer AI4CE 86 0 0 09 Feb 2025
Model Balancing Helps Low-data Training and Fine-tuning Zihang Liu Y. Hu Tianyu Pang Yefan Zhou Pu Ren Yaoqing Yang 34 2 0 16 Oct 2024
Provable In-Context Learning of Linear Systems and Linear Elliptic PDEs with Transformers Frank Cole Yulong Lu Riley OÑeill Tianhao Zhang 40 2 0 18 Sep 2024
AhmedML: High-Fidelity Computational Fluid Dynamics Dataset for Incompressible, Low-Speed Bluff Body Aerodynamics Neil Ashton Danielle C. Maddix Samuel Gundry Parisa M. Shabestari AI4CE 38 2 0 30 Jul 2024
Strategies for Pretraining Neural Operators Anthony Y. Zhou Cooper Lorsung AmirPouya Hemmasian Amir Barati Farimani AI4CE 39 4 0 12 Jun 2024
Masked Autoencoders are PDE Learners Anthony Y. Zhou A. Farimani AI4CE 38 5 0 26 Mar 2024
Hierarchical Dense Correlation Distillation for Few-Shot Segmentation Bohao Peng Zhuotao Tian Xiaoyang Wu Chenyao Wang Shu Liu Jingyong Su Jiaya Jia 45 71 0 26 Mar 2023
Masked Autoencoders Are Scalable Vision Learners Kaiming He Xinlei Chen Saining Xie Yanghao Li Piotr Dollár Ross B. Girshick ViT TPM 305 7,434 0 11 Nov 2021
Enhancing Computational Fluid Dynamics with Machine Learning Ricardo Vinuesa Steven L. Brunton AI4CE 106 355 0 05 Oct 2021
Fourier Neural Operator for Parametric Partial Differential Equations Zong-Yi Li Nikola B. Kovachki Kamyar Azizzadenesheli Burigede Liu K. Bhattacharya Andrew M. Stuart Anima Anandkumar AI4CE 203 2,282 0 18 Oct 2020
Improved Baselines with Momentum Contrastive Learning Xinlei Chen Haoqi Fan Ross B. Girshick Kaiming He SSL 267 3,369 0 09 Mar 2020