APPLICATION OF PHYSICALLY-ORIENTED NEURAL NETWORKS TO SOLVING PROBLEMS OF LINEAR PARTIAL DERIVATIVE EQUATIONS WITH INHOMOGENEOUS MIXED BOUNDARY CONDITIONS

The paper considers the application of Physics-Informed Neural Networks (PINN) to solving a two-dimensional Poisson equation with inhomogeneous mixed boundary conditions. The PINN method combines neural network approximations and physical laws, including the residual of the equation and errors at the boundary, into a single loss function. The model is implemented in the PyTorch environment and trained on a sample generated by the Latin hypercubic sampling method. To verify the accuracy, a comparison is made with an analytical solution, as well as with traditional numerical methods. The influence of key hyperparameters is systematically studied: the number of training points, weights in the loss function, network architecture, and training step. It is found that increasing the weight on the boundary conditions improves convergence and accuracy, and optimal architectures with 4-5 hidden layers and 64 neurons provide a relative error of less than 0.1-0.2%. Unlike numerical schemes requiring grid discretization, PINN has demonstrated versatility and high accuracy when dealing with sparse data and complex conditions, making it a promising tool for computational mathematics and modeling of physical processes in conditions of complex geometry and incomplete information.

1. Raissi, M., Perdikaris, P., Karniadakis, G.E.: Physics-informed neural networks: A deep learning frame work for solving forward and inverse problems involving nonlinear partial differential equations. J. Comput. Phys. 378, 686–707 (2019). https://doi.org/10.1016/j.jcp.2018.10.045

2. Lagaris, I., Likas, A., Fotiadis, D.: Artificial neural networks for solving ordinary and partial differential equations. IEEE Trans. Neural Networks 9(5), 987–1000 (1998). https://doi.org/10.1109/72.712178

3. Dissanayake, M.W.M.G., Phan-Thien, N.: Neural-network-based approximations for solving partial differential equations. Commun. Numer. Methods Eng. 10(3), 195–201 (1994). https://doi.org/10.1002/cnm.1640100303

4. Hornik, K., Stinchcombe, M., White, H.: Multilayer feedforward networks are universal approxima tors. Neural Networks 2(5), 359–366 (1989). https://doi.org/10.1016/0893-6080(89)90020-8

5. Lee, H., Kang, I.S.: Neural algorithm for solving differential equations. J. Comput. Phys. 91(1), 110 131 (1990). https://doi.org/10.1016/0021-9991(90)90007-N

6. Psichogios, D.C., Ungar, L.H.: A hybrid neural network-first principles approach to process modeling. AIChEJ.38(10),1499–1511(1992). https://doi.org/10.1002/aic.690381003

7. Haghighat,E.,Juanes,R.:SciANN:AKeras/Tensorflow wrapper for scientific computations and physicsinformed deep learning using artificial neural networks. Comput. Methods Appl. Mech. Engrg. 373, 113,552 (2021). https://doi.org/10.1016/j.cma.2020.113552

8. Paszke,A.,Gross,S.,Chintala, S., et al.: Automatic differentiation in PyTorch. Tech. rep., (2017) https://openreview.net/forum?id=BJJsrmfCZ

9. Raissi,M.,Yazdani,A.,Karniadakis,G.E.:Hidden fluid mechanics: Learning velocity and pressure fields from flow visualizations. Sci. 367(6481), 1026–1030 (2020). https://doi.org/10.1126/science.aaw4741

10. Haghighat, E., Raissi, M., Moure, A., et al.: A physics-informed deep learning framework for inversion and surrogate modeling in solid mechanics. Comput. Methods Appl. Mech. Engrg. 379, 113,741 (2021b). https://doi.org/10.1016/j.cma.2021.113741

11. Wu, C., Zhu, M., Tan, Q., Kartha, Y. and Lu, L., A Comprehensive Study of Non-Adaptive and Residual-Based Adaptive Sampling for Physics-Informed Neural Networks, Computer Methods in Applied Mechanics and Engineering, vol. 403, p. 115671, October 22, 2022. https://doi.org/10.1016/j.cma.2022.115671

12. Mishra, S., Molinaro, R.: Estimates on the generalization error of physics-informed neural networks for approximating a class of inverse problems for PDEs. IMA J. Numer. Anal. (2021). https://doi.org/10.1093/imanum/drab032

13. Rao, C., Sun, H., & Liu, Y. (2020). Physics-informed deep learning for incompressible laminar flows. Theoretical and Applied Mechanics Letters, 10(3), 207–212. https://doi.org/10.1016/j.taml.2020.01.039

14. Wang, R., Kashinath, K., Mustafa, M., Albert, A., & Yu, R. (2019). Towards Physics-informed Deep Learning for Turbulent Flow Prediction. ArXiv.org. https://arxiv.org/abs/1911.08655

15. Yang, X. I. A., Zafar, S., Wang, J.-X. ., & Xiao, H. (2019). Predictive large-eddy-simulation wall modeling via physics-informed neural networks. Physical Review Fluids, 4(3). https://doi.org/10.1103/physrevfluids.4.034602

16. Kissas, G., Yang, Y., Hwuang, E., Witschey, W. R., Detre, J. A., & Perdikaris, P. (2020). Machine learning in cardiovascular flows modeling: Predicting arterial blood pressure from non-invasive 4D flow MRI data using physics-informed neural networks. Computer Methods in Applied Mechanics and Engineering, 358, 112623. https://doi.org/10.1016/j.cma.2019.112623

17. Arzani, A., Wang, J.-X., & D’Souza, R. M. (2021). Uncovering near-wall blood flow from sparse data with physics-informed neural networks. Physics of Fluids, 33(7), 071905. https://doi.org/10.1063/5.0055600

18. Sahli Costabal, F., Yang, Y., Perdikaris, P., Hurtado, D. E., & Kuhl, E. (2020). Physics-Informed Neural Networks for Cardiac Activation Mapping. Frontiers in Physics, 8. https://doi.org/10.3389/fphy.2020.00042

19. Rasht‐Behesht, M., Huber, C., Shukla, K., & Karniadakis, G. E. (2022). Physics‐Informed Neural Networks (PINNs) for Wave Propagation and Full Waveform Inversions. Journal of Geophysical Research: Solid Earth, 127(5). https://doi.org/10.1029/2021jb023120

20. Almajid, M. M., & Abu-Al-Saud, M. O. (2022). Prediction of porous media fluid flow using physics informed neural networks. Journal of Petroleum Science and Engineering, 208, 109205. https://doi.org/10.1016/j.petrol.2021.109205

21. Cai, S., Wang, Z., Wang, S., Perdikaris, P., & Karniadakis, G. (2021). Physics-Informed Neural Networks (PINNs) for Heat Transfer Problems. Journal of Heat Transfer. https://doi.org/10.1115/1.4050542

22. Zobeiry, N., & Humfeld, K. D. (2021). A physics-informed machine learning approach for solving heat transfer equation in advanced manufacturing and engineering applications. Engineering Applications of Artificial Intelligence, 101, 104232. https://doi.org/10.1016/j.engappai.2021.104232

23. Chen, Y., Lu, L., Karniadakis, G. E., & Dal Negro, L. (2020). Physics-informed neural networks for inverse problems in nano-optics and metamaterials. Optics Express, 28(8), 11618. https://doi.org/10.1364/oe.384875

24. De Ryck, T., Lanthaler, S., & Mishra, S. (2021). On the approximation of functions by tanh neural networks. Neural Networks, 143, 732–750. https://doi.org/10.1016/j.neunet.2021.08.015

25. Liu, X., Zhang, X., Peng, W., Zhou, W., & Yao, W. (2022). A novel meta-learning initialization method for physics-informed neural networks. Neural Computing and Applications, 34(17), 14511–14534. https://doi.org/10.1007/s00521-022-07294-2

26. Gao, H., Sun, L., & Wang, J.-X. (2021). PhyGeoNet: Physics-informed geometry-adaptive convolutional neural networks for solving parameterized steady-state PDEs on irregular domain. Journal of Computational Physics, 428, 110079. https://doi.org/10.1016/j.jcp.2020.110079

27. Yu, J., Lu, L., Meng, X., & Karniadakis, G. E. (2022). Gradient-enhanced physics-informed neural networks for forward and inverse PDE problems. Computer Methods in Applied Mechanics and Engineering, 393, 114823. https://doi.org/10.1016/j.cma.2022.114823