Training multi-objective/multi-task collocation physics-informed neural network with student/teachers transfer learnings

24 July 2021

Papers citing "Training multi-objective/multi-task collocation physics-informed neural network with student/teachers transfer learnings"

35 / 35 papers shown

Title
Dual Cone Gradient Descent for Training Physics-Informed Neural Networks Youngsik Hwang Dong-Young Lim AI4CE 97 3 0 27 Sep 2024
Meta-learning PINN loss functions Apostolos F. Psaros Kenji Kawaguchi George Karniadakis PINN 74 105 0 12 Jul 2021
Data vs. Physics: The Apparent Pareto Front of Physics-Informed Neural Networks Franz M. Rohrhofer S. Posch C. Gößnitzer Bernhard C. Geiger PINN 94 39 0 03 May 2021
Exact imposition of boundary conditions with distance functions in physics-informed deep neural networks N. Sukumar Ankit Srivastava PINN AI4CE 121 254 0 17 Apr 2021
Equivariant geometric learning for digital rock physics: estimating formation factor and effective permeability tensors from Morse graph Chen Cai Nikolaos N. Vlassis Lucas Magee R. Ma Zeyu Xiong B. Bahmani T. Wong Yusu Wang WaiChing Sun 30 16 0 12 Apr 2021
On the eigenvector bias of Fourier feature networks: From regression to solving multi-scale PDEs with physics-informed neural networks Sizhuang He Hanwen Wang P. Perdikaris 185 459 0 18 Dec 2020
$NVIDIA SimNet^{TM}: an AI-accelerated multi-physics simulation framework$ NVIDIA SimNet^{TM}: an AI-accelerated multi-physics simulation framework O. Hennigh S. Narasimhan M. A. Nabian Akshay Subramaniam Kaustubh Tangsali M. Rietmann J. Ferrandis Wonmin Byeon Z. Fang S. Choudhry PINN AI4CE 130 128 0 14 Dec 2020
Fourier Neural Operator for Parametric Partial Differential Equations Zong-Yi Li Nikola B. Kovachki Kamyar Azizzadenesheli Burigede Liu K. Bhattacharya Andrew M. Stuart Anima Anandkumar AI4CE 500 2,444 0 18 Oct 2020
Multi-Loss Weighting with Coefficient of Variations R. Groenendijk Sezer Karaoglu Theo Gevers Thomas Mensink 139 55 0 03 Sep 2020
hp-VPINNs: Variational Physics-Informed Neural Networks With Domain Decomposition E. Kharazmi Zhongqiang Zhang George Karniadakis 171 538 0 11 Mar 2020
Gradient Surgery for Multi-Task Learning Tianhe Yu Saurabh Kumar Abhishek Gupta Sergey Levine Karol Hausman Chelsea Finn 178 1,228 0 19 Jan 2020
Dynamic Task Weighting Methods for Multi-task Networks in Autonomous Driving Systems Isabelle Leang Ganesh Sistu Fabian Burger Andrei Bursuc S. Yogamani 66 53 0 07 Jan 2020
Lift & Learn: Physics-informed machine learning for large-scale nonlinear dynamical systems E. Qian Boris Kramer Benjamin Peherstorfer Karen E. Willcox AI4CE 89 267 0 17 Dec 2019
Robust Training and Initialization of Deep Neural Networks: An Adaptive Basis Viewpoint E. Cyr Mamikon A. Gulian Ravi G. Patel M. Perego N. Trask 93 72 0 10 Dec 2019
PyTorch: An Imperative Style, High-Performance Deep Learning Library Adam Paszke Sam Gross Francisco Massa Adam Lerer James Bradbury ... Sasank Chilamkurthy Benoit Steiner Lu Fang Junjie Bai Soumith Chintala ODL 529 42,559 0 03 Dec 2019
PPINN: Parareal Physics-Informed Neural Network for time-dependent PDEs Xuhui Meng Zhen Li Dongkun Zhang George Karniadakis PINN AI4CE 81 453 0 23 Sep 2019
Adaptive Scheduling for Multi-Task Learning Sébastien Jean Orhan Firat Melvin Johnson 46 43 0 13 Sep 2019
An Energy Approach to the Solution of Partial Differential Equations in Computational Mechanics via Machine Learning: Concepts, Implementation and Applications E. Samaniego C. Anitescu S. Goswami Vien Minh Nguyen-Thanh Hongwei Guo Khader M. Hamdia Timon Rabczuk X. Zhuang PINN AI4CE 215 1,381 0 27 Aug 2019
A Generalized Algorithm for Multi-Objective Reinforcement Learning and Policy Adaptation Runzhe Yang Xingyuan Sun Karthik Narasimhan 79 256 0 21 Aug 2019
DeepXDE: A deep learning library for solving differential equations Lu Lu Xuhui Meng Zhiping Mao George Karniadakis PINN AI4CE 99 1,538 0 10 Jul 2019
$Transfer learning enhanced physics informed neural network for phase-field modeling of fracture$ Transfer learning enhanced physics informed neural network for phase-field modeling of fracture S. Goswami C. Anitescu S. Chakraborty Timon Rabczuk PINN 78 610 0 04 Jul 2019
Physics-Constrained Deep Learning for High-dimensional Surrogate Modeling and Uncertainty Quantification without Labeled Data Yinhao Zhu N. Zabaras P. Koutsourelakis P. Perdikaris PINN AI4CE 114 869 0 18 Jan 2019
Multi-Task Learning as Multi-Objective Optimization Ozan Sener V. Koltun 167 1,286 0 10 Oct 2018
On the Spectral Bias of Neural Networks Nasim Rahaman A. Baratin Devansh Arpit Felix Dräxler Min Lin Fred Hamprecht Yoshua Bengio Aaron Courville 154 1,454 0 22 Jun 2018
Scheduled Multi-Task Learning: From Syntax to Translation E. Kiperwasser Miguel Ballesteros 61 82 0 24 Apr 2018
Deep Hidden Physics Models: Deep Learning of Nonlinear Partial Differential Equations M. Raissi PINN AI4CE 120 755 0 20 Jan 2018
GradNorm: Gradient Normalization for Adaptive Loss Balancing in Deep Multitask Networks Zhao Chen Vijay Badrinarayanan Chen-Yu Lee Andrew Rabinovich ODL 163 1,289 0 07 Nov 2017
The Deep Ritz method: A deep learning-based numerical algorithm for solving variational problems E. Weinan Ting Yu 123 1,389 0 30 Sep 2017
DGM: A deep learning algorithm for solving partial differential equations Justin A. Sirignano K. Spiliopoulos AI4CE 91 2,066 0 24 Aug 2017
An Overview of Multi-Task Learning in Deep Neural Networks Sebastian Ruder CVBM 159 2,830 0 15 Jun 2017
Multi-Task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semantics Alex Kendall Y. Gal R. Cipolla 3DH 272 3,135 0 19 May 2017
Cross-stitch Networks for Multi-task Learning Ishan Misra Abhinav Shrivastava Abhinav Gupta M. Hebert 100 1,351 0 12 Apr 2016
Net2Net: Accelerating Learning via Knowledge Transfer Tianqi Chen Ian Goodfellow Jonathon Shlens 167 672 0 18 Nov 2015
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification Kaiming He Xinming Zhang Shaoqing Ren Jian Sun VLM 335 18,647 0 06 Feb 2015
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 2.0K 150,260 0 22 Dec 2014