v1v2v3v4v5 (latest)

ClimaX: A foundation model for weather and climate

24 January 2023

Tung Nguyen

Johannes Brandstetter

ArXiv (abs)PDF HTML Github (616★)

Papers citing "ClimaX: A foundation model for weather and climate"

46 / 46 papers shown

Title
Group-in-Group Policy Optimization for LLM Agent Training Lang Feng Zhenghai Xue Tingcong Liu Bo An OffRL 199 2 0 16 May 2025
Data-driven Seasonal Climate Predictions via Variational Inference and Transformers Lluís Palma Alejandro Peraza David Civantos Amanda Duarte Stefano Materia Ángel G. Muñoz Jesús Peña Laia Romero Albert Soret Markus G. Donat AI4TS 105 0 0 26 Mar 2025
Investigating the contribution of terrain-following coordinates and conservation schemes in AI-driven precipitation forecasts Yingkai Sha John S. Schreck William E. Chapman David John Gagne II 67 1 0 01 Mar 2025
Vision-LSTM: xLSTM as Generic Vision Backbone Benedikt Alkin M. Beck Korbinian Poppel Sepp Hochreiter Johannes Brandstetter VLM 205 49 0 24 Feb 2025
Position: Multimodal Large Language Models Can Significantly Advance Scientific Reasoning Yibo Yan Shen Wang Jiahao Huo Jingheng Ye Zhendong Chu Xuming Hu Philip S. Yu Carla P. Gomes B. Selman Qingsong Wen LRM 208 17 0 05 Feb 2025
Context Clues: Evaluating Long Context Models for Clinical Prediction Tasks on EHRs Michael Wornow Suhana Bedi Miguel Angel Fuentes Hernandez E. Steinberg Jason Alan Fries Christopher Ré Sanmi Koyejo N. Shah 180 6 0 09 Dec 2024
NeuralDEM -- Real-time Simulation of Industrial Particulate Flows Benedikt Alkin Tobias Kronlachner Samuele Papa Stefan Pirker Thomas Lichtenegger Johannes Brandstetter PINN AI4CE 109 3 1 14 Nov 2024
Can AI weather models predict out-of-distribution gray swan tropical cyclones? Y. Qiang Sun Pedram Hassanzadeh Mohsen Zand Ashesh Chattopadhyay Jonathan Weare D. Abbot 106 7 0 19 Oct 2024
Continuous Ensemble Weather Forecasting with Diffusion models Martin Andrae Tomas Landelius Joel Oskarsson Fredrik Lindsten AI4Cl 77 4 0 07 Oct 2024
HR-Extreme: A High-Resolution Dataset for Extreme Weather Forecasting Nian Ran Peng Xiao Yue Wang Wesley Shi Jianxin Lin Qi Meng Richard Allmendinger AI4Cl 158 0 0 27 Sep 2024
Zero-shot forecasting of chaotic systems Yuanzhao Zhang William Gilpin AI4TS 233 8 0 24 Sep 2024
Training Ultra Long Context Language Model with Fully Pipelined Distributed Transformer Jinghan Yao Sam Ade Jacobs Masahiro Tanaka Olatunji Ruwase Hari Subramoni D. Panda 89 2 0 30 Aug 2024
RAIN: Reinforcement Algorithms for Improving Numerical Weather and Climate Models Pritthijit Nath Henry Moss Emily Shuckburgh Mark Webb AI4Cl AI4CE 122 0 0 28 Aug 2024
The impact of internal variability on benchmarking deep learning climate emulators Björn Lütjens Raffaele Ferrari Duncan Watson-Parris N. Selin AI4Cl 72 1 0 09 Aug 2024
Validating Deep Learning Weather Forecast Models on Recent High-Impact Extreme Events Olivier C. Pasche Jonathan Wider Zhongwei Zhang Jakob Zscheischler Sebastian Engelke AI4Cl 129 11 0 26 Apr 2024
Universal Physics Transformers: A Framework For Efficiently Scaling Neural Operators Benedikt Alkin Andreas Fürst Simon Schmid Lukas Gruber Markus Holzleitner Johannes Brandstetter PINN AI4CE 200 13 0 19 Feb 2024
Pangu-Weather: A 3D High-Resolution Model for Fast and Accurate Global Weather Forecast Kaifeng Bi Lingxi Xie Hengheng Zhang Xin Chen Xiaotao Gu Qi Tian AI4Cl 78 170 0 03 Nov 2022
Clifford Neural Layers for PDE Modeling Johannes Brandstetter Rianne van den Berg Max Welling Jayesh K. Gupta AI4CE 108 90 0 08 Sep 2022
Image as a Foreign Language: BEiT Pretraining for All Vision and Vision-Language Tasks Wenhui Wang Hangbo Bao Li Dong Johan Bjorck Zhiliang Peng ... Kriti Aggarwal O. Mohammed Saksham Singhal Subhojit Som Furu Wei MLLM VLM ViT 148 644 0 22 Aug 2022
A Generalist Agent Scott E. Reed Konrad Zolna Emilio Parisotto Sergio Gomez Colmenarejo Alexander Novikov ... Yutian Chen R. Hadsell Oriol Vinyals Mahyar Bordbar Nando de Freitas LM&Ro LLMAG AI4CE 211 824 0 12 May 2022
Hierarchical Text-Conditional Image Generation with CLIP Latents Aditya A. Ramesh Prafulla Dhariwal Alex Nichol Casey Chu Mark Chen VLM DiffM 413 6,908 0 13 Apr 2022
PaLM: Scaling Language Modeling with Pathways Aakanksha Chowdhery Sharan Narang Jacob Devlin Maarten Bosma Gaurav Mishra ... Kathy Meier-Hellstern Douglas Eck J. Dean Slav Petrov Noah Fiedel PILM LRM 522 6,293 0 05 Apr 2022
Training Compute-Optimal Large Language Models Jordan Hoffmann Sebastian Borgeaud A. Mensch Elena Buchatskaya Trevor Cai ... Karen Simonyan Erich Elsen Jack W. Rae Oriol Vinyals Laurent Sifre AI4TS 208 1,980 0 29 Mar 2022
Practical Conditional Neural Processes Via Tractable Dependent Predictions Stratis Markou James Requeima W. Bruinsma Anna Vaughan Richard Turner UQCV AI4CE 73 25 0 16 Mar 2022
FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operators Jaideep Pathak Shashank Subramanian P. Harrington S. Raja Ashesh Chattopadhyay ... Zong-Yi Li Kamyar Azizzadenesheli Pedram Hassanzadeh K. Kashinath Anima Anandkumar AI4Cl 240 708 0 22 Feb 2022
Forecasting Global Weather with Graph Neural Networks R. Keisler AI4Cl 111 170 0 15 Feb 2022
Florence: A New Foundation Model for Computer Vision Lu Yuan Dongdong Chen Yi-Ling Chen Noel Codella Xiyang Dai ... Zhen Xiao Jianwei Yang Michael Zeng Luowei Zhou Pengchuan Zhang VLM 141 908 0 22 Nov 2021
Swin Transformer V2: Scaling Up Capacity and Resolution Ze Liu Han Hu Yutong Lin Zhuliang Yao Zhenda Xie ... Yue Cao Zheng Zhang Li Dong Furu Wei B. Guo ViT 219 1,825 0 18 Nov 2021
Masked Autoencoders Are Scalable Vision Learners Kaiming He Xinlei Chen Saining Xie Yanghao Li Piotr Dollár Ross B. Girshick ViT TPM 473 7,819 0 11 Nov 2021
Delving Deep into the Generalization of Vision Transformers under Distribution Shifts Chongzhi Zhang Mingyuan Zhang Shanghang Zhang Daisheng Jin Qiang-feng Zhou Zhongang Cai Haiyu Zhao Xianglong Liu Ziwei Liu 67 105 0 14 Jun 2021
Multiscale Vision Transformers Haoqi Fan Bo Xiong K. Mangalam Yanghao Li Zhicheng Yan Jitendra Malik Christoph Feichtenhofer ViT 135 1,265 0 22 Apr 2021
Skillful Precipitation Nowcasting using Deep Generative Models of Radar Suman V. Ravuri Karel Lenc Matthew Willson D. Kangin Rémi R. Lam ... R. Hadsell Nial H. Robinson Ellen Clancy A. Arribas S. Mohamed AI4Cl 178 741 0 02 Apr 2021
Pretrained Transformers as Universal Computation Engines Kevin Lu Aditya Grover Pieter Abbeel Igor Mordatch 56 221 0 09 Mar 2021
Decoupling the Role of Data, Attention, and Losses in Multimodal Transformers Lisa Anne Hendricks John F. J. Mellor R. Schneider Jean-Baptiste Alayrac Aida Nematzadeh 125 116 0 31 Jan 2021
Convolutional conditional neural processes for local climate downscaling Anna Vaughan Will Tebbutt J. S. Hosking Richard Turner BDL 71 49 0 20 Jan 2021
Fourier Neural Operator for Parametric Partial Differential Equations Zong-Yi Li Nikola B. Kovachki Kamyar Azizzadenesheli Burigede Liu K. Bhattacharya Andrew M. Stuart Anima Anandkumar AI4CE 504 2,448 0 18 Oct 2020
Measuring Robustness to Natural Distribution Shifts in Image Classification Rohan Taori Achal Dave Vaishaal Shankar Nicholas Carlini Benjamin Recht Ludwig Schmidt OOD 120 548 0 01 Jul 2020
Array Programming with NumPy Charles R. Harris K. Millman S. Walt R. Gommers Pauli Virtanen ... Tyler Reddy Warren Weckesser Hameer Abbasi C. Gohlke T. Oliphant 156 14,995 0 18 Jun 2020
Pretrained Transformers Improve Out-of-Distribution Robustness Dan Hendrycks Xiaoyuan Liu Eric Wallace Adam Dziedzic R. Krishnan Basel Alomair OOD 199 435 0 13 Apr 2020
MetNet: A Neural Weather Model for Precipitation Forecasting C. Sønderby L. Espeholt Jonathan Heek Mostafa Dehghani Avital Oliver Tim Salimans Shreya Agrawal Jason Hickey Nal Kalchbrenner AI4Cl 297 277 0 24 Mar 2020
Scaling Laws for Neural Language Models Jared Kaplan Sam McCandlish T. Henighan Tom B. Brown B. Chess R. Child Scott Gray Alec Radford Jeff Wu Dario Amodei 611 4,905 0 23 Jan 2020
DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operators Lu Lu Pengzhan Jin George Karniadakis 248 2,153 0 08 Oct 2019
DeepDownscale: a Deep Learning Strategy for High-Resolution Weather Forecast Eduardo Rodrigues Igor Oliveira R. L. F. Cunha M. Netto 46 96 0 15 Aug 2018
Earth System Modeling 2.0: A Blueprint for Models That Learn From Observations and Targeted High-Resolution Simulations T. Schneider Shiwei Lan Andrew M. Stuart J. Teixeira AI4Cl 73 319 0 31 Aug 2017
Intercomparison of Machine Learning Methods for Statistical Downscaling: The Case of Daily and Extreme Precipitation T. Vandal E. Kodra A. Ganguly AI4Cl 63 146 0 13 Feb 2017
Deep Networks with Stochastic Depth Gao Huang Yu Sun Zhuang Liu Daniel Sedra Kilian Q. Weinberger 215 2,361 0 30 Mar 2016