DPOT: Auto-Regressive Denoising Operator Transformer for Large-Scale PDE Pre-Training

6 March 2024

Hang Su

Jun Zhu

Papers citing "DPOT: Auto-Regressive Denoising Operator Transformer for Large-Scale PDE Pre-Training"

22 / 22 papers shown

Title
Physics-informed Temporal Alignment for Auto-regressive PDE Foundation Models Congcong Zhu Xiaoyan Xu Jiayue Han Jingrun Chen OOD AI4CE 41 0 0 16 May 2025
CodePDE: An Inference Framework for LLM-driven PDE Solver Generation Shanda Li Tanya Marwah Junhong Shen W. Sun Andrej Risteski Yiming Yang Ameet Talwalkar AI4CE 39 0 0 13 May 2025
DISCO: learning to DISCover an evolution Operator for multi-physics-agnostic prediction Rudy Morel Jiequn Han Edouard Oyallon AI4CE 56 0 0 28 Apr 2025
TANTE: Time-Adaptive Operator Learning via Neural Taylor Expansion Zhikai Wu Sifan Wang Shiyang Zhang Sizhuang He Min Zhu Anran Jiao Lu Lu David van Dijk 96 1 0 12 Feb 2025
Data-Efficient Inference of Neural Fluid Fields via SciML Foundation Model Yuqiu Liu Jingxuan Xu Mauricio Soroco Yunchao Wei Wuyang Chen AI4CE 84 2 0 18 Dec 2024
Model Balancing Helps Low-data Training and Fine-tuning Zihang Liu Yihan Hu Tianyu Pang Yefan Zhou Pu Ren Yaoqing Yang 39 2 0 16 Oct 2024
Zebra: In-Context and Generative Pretraining for Solving Parametric PDEs Louis Serrano Armand K. Koupai Thomas X. Wang Pierre Erbacher Patrick Gallinari AI4CE 38 3 0 04 Oct 2024
Text2PDE: Latent Diffusion Models for Accessible Physics Simulation Anthony Y. Zhou Zijie Li Michael Schneier John R Buchanan Jr Amir Barati Farimani AI4CE DiffM 67 5 0 02 Oct 2024
Micrometer: Micromechanics Transformer for Predicting Mechanical Responses of Heterogeneous Materials Sizhuang He Tong-Rui Liu Shyam Sankaran P. Perdikaris AI4CE 42 3 0 23 Sep 2024
Reduced-Order Neural Operators: Learning Lagrangian Dynamics on Highly Sparse Graphs Hrishikesh Viswanath Yue Chang Julius Berner Julius Berner Peter Yichen Chen Aniket Bera AI4CE 63 2 0 04 Jul 2024
Strategies for Pretraining Neural Operators Anthony Y. Zhou Cooper Lorsung AmirPouya Hemmasian Amir Barati Farimani AI4CE 41 5 0 12 Jun 2024
Unisolver: PDE-Conditional Transformers Are Universal PDE Solvers Zhou Hang Yuezhou Ma Haixu Wu Haowen Wang Mingsheng Long AI4CE 36 9 0 27 May 2024
Pretraining Codomain Attention Neural Operators for Solving Multiphysics PDEs Md Ashiqur Rahman Robert Joseph George Mogab Elleithy Daniel Leibovici Zong-Yi Li ... Julius Berner Raymond A. Yeh Jean Kossaifi Kamyar Azizzadenesheli A. Anandkumar AI4CE 54 20 0 19 Mar 2024
UPS: Efficiently Building Foundation Models for PDE Solving via Cross-Modal Adaptation Junhong Shen Tanya Marwah Ameet Talwalkar AI4CE 44 2 0 11 Mar 2024
Data-Efficient Operator Learning via Unsupervised Pretraining and In-Context Learning Wuyang Chen Jialin Song Pu Ren Shashank Subramanian Dmitriy Morozov Michael W. Mahoney AI4CE 52 9 0 24 Feb 2024
Universal Physics Transformers: A Framework For Efficiently Scaling Neural Operators Benedikt Alkin Andreas Fürst Simon Schmid Lukas Gruber Markus Holzleitner Johannes Brandstetter PINN AI4CE 48 8 0 19 Feb 2024
Solving High-Dimensional PDEs with Latent Spectral Models Haixu Wu Tengge Hu Huakun Luo Jianmin Wang Mingsheng Long AI4CE 65 37 0 30 Jan 2023
Towards Multi-spatiotemporal-scale Generalized PDE Modeling Jayesh K. Gupta Johannes Brandstetter AI4CE 61 118 0 30 Sep 2022
Masked Autoencoders Are Scalable Vision Learners Kaiming He Xinlei Chen Saining Xie Yanghao Li Piotr Dollár Ross B. Girshick ViT TPM 308 7,443 0 11 Nov 2021
MLP-Mixer: An all-MLP Architecture for Vision Ilya O. Tolstikhin N. Houlsby Alexander Kolesnikov Lucas Beyer Xiaohua Zhai ... Andreas Steiner Daniel Keysers Jakob Uszkoreit Mario Lucic Alexey Dosovitskiy 274 2,603 0 04 May 2021
Fourier Neural Operator for Parametric Partial Differential Equations Zong-Yi Li Nikola B. Kovachki Kamyar Azizzadenesheli Burigede Liu K. Bhattacharya Andrew M. Stuart Anima Anandkumar AI4CE 235 2,287 0 18 Oct 2020
U-Net: Convolutional Networks for Biomedical Image Segmentation Olaf Ronneberger Philipp Fischer Thomas Brox SSeg 3DV 330 75,834 0 18 May 2015