Physics-Informed Neural Networks with Unknown Partial Differential Equations: An Application in Multivariate Time Series

A significant advancement in Neural Network (NN) research is the integration of domain-specific knowledge through custom loss functions. This approach addresses a crucial challenge: How can models utilize physics or mathematical principles to enhance predictions when dealing with sparse, noisy, or i...

Full description

Saved in:
Bibliographic Details
Main Authors: Seyedeh Azadeh Fallah Mortezanejad, Ruochen Wang, Ali Mohammad-Djafari
Format: Article
Language:English
Published: MDPI AG 2025-06-01
Series:Entropy
Subjects:
Online Access:https://www.mdpi.com/1099-4300/27/7/682
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:A significant advancement in Neural Network (NN) research is the integration of domain-specific knowledge through custom loss functions. This approach addresses a crucial challenge: How can models utilize physics or mathematical principles to enhance predictions when dealing with sparse, noisy, or incomplete data? Physics-Informed Neural Networks (PINNs) put this idea into practice by incorporating a forward model, such as Partial Differential Equations (PDEs), as soft constraints. This guidance helps the networks find solutions that align with established laws. Recently, researchers have expanded this framework to include Bayesian NNs (BNNs) which allow for uncertainty quantification. However, what happens when the governing equations of a system are not completely known? In this work, we introduce methods to automatically select PDEs from historical data in a parametric family. We then integrate these learned equations into three different modeling approaches: PINNs, Bayesian-PINNs (B-PINNs), and Physical-Informed Bayesian Linear Regression (PI-BLR). To assess these frameworks, we evaluate them on a real-world Multivariate Time Series (MTS) dataset related to electrical power energy management. We compare their effectiveness in forecasting future states under different scenarios: with and without PDE constraints and accuracy considerations. This research aims to bridge the gap between data-driven discovery and physics-guided learning, providing valuable insights for practical applications.
ISSN:1099-4300