We developed a physics-informed neural network (PINN) framework for solving integro-differential equations (IDEs), with particular emphasis on Volterra-type problems with exponentially decaying kernels. While PINNs provide a flexible approach for incorporating physical laws without mesh-based discretization, the treatment of convolution integral terms remains computationally demanding. To address this issue, we introduced internal variables for exponential kernels, transforming the original IDE into an equivalent system of differential equations, eliminating the need for explicit quadrature, and significantly reducing computational cost and memory requirements. The proposed method incorporates both differential and integral operators within the PINN framework. Numerical results demonstrate that the method maintains accuracy while significantly improving computational efficiency. It also extends naturally to inverse problems, where viscoelastic parameters are accurately identified from sparse observations.
Citation: Yongseok Jang. Internal variable reformulation of Volterra integro-differential equations with exponential kernels for physics-informed neural networks[J]. AIMS Mathematics, 2026, 11(6): 16511-16533. doi: 10.3934/math.2026677
We developed a physics-informed neural network (PINN) framework for solving integro-differential equations (IDEs), with particular emphasis on Volterra-type problems with exponentially decaying kernels. While PINNs provide a flexible approach for incorporating physical laws without mesh-based discretization, the treatment of convolution integral terms remains computationally demanding. To address this issue, we introduced internal variables for exponential kernels, transforming the original IDE into an equivalent system of differential equations, eliminating the need for explicit quadrature, and significantly reducing computational cost and memory requirements. The proposed method incorporates both differential and integral operators within the PINN framework. Numerical results demonstrate that the method maintains accuracy while significantly improving computational efficiency. It also extends naturally to inverse problems, where viscoelastic parameters are accurately identified from sparse observations.
| [1] |
M. Raissi, P. Perdikaris, G. E. Karniadakis, Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations, J. Comput. Phys., 378 (2019), 686–707. https://doi.org/10.1016/j.jcp.2018.10.045 doi: 10.1016/j.jcp.2018.10.045
|
| [2] |
G. E. Karniadakis, I. G. Kevrekidis, L. Lu, P. Perdikaris, S. Wang, L. Yang, Physics-informed machine learning, Nat. Rev. Phys., 3 (2021), 422–440. https://doi.org/10.1038/s42254-021-00314-5 doi: 10.1038/s42254-021-00314-5
|
| [3] | A. G. Baydin, B. A. Pearlmutter, A. A. Radul, J. M. Siskind, Automatic differentiation in machine learning: a survey, J. Mach. Learn. Res., 18 (2018), 1–43. |
| [4] |
E. Hetmaniok, M. Pleszczyński, Y. Khan, Solving the integral differential equations with delayed argument by using the differential transform method, Sensors, 22 (2022), 4124. https://doi.org/10.3390/s22114124 doi: 10.3390/s22114124
|
| [5] |
R. Brociek, M. Goik, J. Miarka, M. Pleszczynski, C. Napoli, Solution of inverse problem for diffusion equation with fractional derivatives using metaheuristic optimization algorithm, Informatica, 35 (2024), 453–481. https://doi.org/10.15388/24-INFOR563 doi: 10.15388/24-INFOR563
|
| [6] |
R. Gao, L. Ju, D. Li, Kernel-based PINNs for time fractional differential equations and Volterra integral-differential equations, Phys. D, 490 (2026), 135174. https://doi.org/10.1016/j.physd.2026.135174 doi: 10.1016/j.physd.2026.135174
|
| [7] |
Y. Jang, S. Shaw, Finite element approximation and analysis of a viscoelastic scalar wave equation with internal variable formulations, J. Comput. Appl. Math., 412 (2022), 114340. https://doi.org/10.1016/j.cam.2022.114340 doi: 10.1016/j.cam.2022.114340
|
| [8] |
Y. Jang, S. Shaw, A priori analysis of a symmetric interior penalty discontinuous Galerkin finite element method for a dynamic linear viscoelasticity model, Comput. Methods Appl. Math., 23 (2023), 647–669. https://doi.org/10.1515/cmam-2022-0201 doi: 10.1515/cmam-2022-0201
|
| [9] |
G. H. Golub, J. H. Welsch, Calculation of Gauss quadrature rules, Math. Comput., 23 (1969), 221–230. https://doi.org/10.2307/2004418 doi: 10.2307/2004418
|
| [10] |
W. McLean, V. Thomée, Numerical solution of an evolution equation with a positive-type memory term, ANZIAM J., 35 (1993), 23–70. https://doi.org/10.1017/S0334270000007268 doi: 10.1017/S0334270000007268
|
| [11] |
Y. Jang, S. Shaw, A priori error analysis for a finite element approximation of dynamic viscoelasticity problems involving a fractional order integro-differential constitutive law, Adv. Comput. Math., 47 (2021), 46. https://doi.org/10.1007/s10444-021-09857-8 doi: 10.1007/s10444-021-09857-8
|
| [12] |
Y. Jang, S. Shaw, Discontinuous Galerkin finite element method for dynamic viscoelasticity models of power-law type, Numer. Methods Partial Differ. Equ., 40 (2024), e23107. https://doi.org/10.1002/num.23107 doi: 10.1002/num.23107
|
| [13] | S. Shaw, J. R. Whiteman, Some partial differential Volterra equation problems arising in viscoelasticity, In: Proceedings of Equadiff 9, Conference on differential equations and their applications, 1998,183–200. |
| [14] | J. M. Golden, G. A. C. Graham, Boundary value problems in linear viscoelasticity, Heidelberg: Springer, 2013. https://doi.org/10.1007/978-3-662-06156-5 |
| [15] | A. D. Drozdov, Viscoelastic structures: Mechanics of growth and aging, Academic Press, 1998. |
| [16] |
G. H. Paulino, Z. H. Jin, Viscoelastic functionally graded materials subjected to antiplane shear fracture, J. Appl. Mech., 68 (2001), 284–293. https://doi.org/10.1115/1.1354205 doi: 10.1115/1.1354205
|
| [17] | T. V. Hoarau-Mantel, A. Matei, Analysis of a viscoelastic antiplane contact problem with slip-dependent friction, Int. J. Appl. Math. Comput. Sci., 12 (2002), 51–58. |
| [18] |
A. R. Johnson, Modeling viscoelastic materials using internal variables, Shock. Vib. Dig., 31 (1999), 91–100. https://doi.org/10.1177/058310249903100201 doi: 10.1177/058310249903100201
|
| [19] | Y. Jang, Spatially continuous and discontinuous Galerkin finite element approximations for dynamic viscoelastic problems, PhD. Thesis, Brunel University London, 2020. |
| [20] |
A. Pinkus, Approximation theory of the MLP model in neural networks, Acta Numer., 8 (1999), 143–195. https://doi.org/10.1017/S0962492900002919 doi: 10.1017/S0962492900002919
|
| [21] |
Y. Shin, J. Darbon, G. E. Karniadakis, On the convergence of physics informed neural networks for linear second-order elliptic and parabolic type PDEs, Commun. Comput. Phys., 28 (2020), 2042–2074. https://doi.org/10.4208/cicp.OA-2020-0193 doi: 10.4208/cicp.OA-2020-0193
|
| [22] |
Y. Shin, Z. Zhang, G. E. Karniadakis, Error estimates of residual minimization using neural networks for linear PDEs, J. Mach. Learn. Model. Comput., 4 (2023), 73–101. https://doi.org/10.1615/JMachLearnModelComput.2023050411 doi: 10.1615/JMachLearnModelComput.2023050411
|
| [23] |
S. Mishra, R. Molinaro, Estimates on the generalization error of physics-informed neural networks for approximating PDEs, IMA J. Numer. Anal., 43 (2023), 1–43. https://doi.org/10.1093/imanum/drab093 doi: 10.1093/imanum/drab093
|
| [24] |
Y. Qian, Y. Zhang, Y. Huang, S. Dong, Physics-informed neural networks for approximating dynamic (hyperbolic) PDEs of second order in time: Error analysis and algorithms, J. Comput. Phys., 495 (2023), 112527. https://doi.org/10.1016/j.jcp.2023.112527 doi: 10.1016/j.jcp.2023.112527
|
| [25] |
S. Mishra, R. Molinaro, Estimates on the generalization error of physics-informed neural networks for approximating a class of inverse problems for PDEs, IMA J. Numer. Anal., 42 (2022), 981–1022. https://doi.org/10.1093/imanum/drab032 doi: 10.1093/imanum/drab032
|
| [26] |
L. Lu, X. Meng, Z. Mao, G. E. Karniadakis, DeepXDE: A deep learning library for solving differential equations, SIAM Rev., 63 (2021), 208–228. https://doi.org/10.1137/19M1274067 doi: 10.1137/19M1274067
|
| [27] | M. Abadi, A. Agarwal, P. Barham, E. Brevdo, Z. Chen, C. Citro, et al., TensorFlow: Large-scale machine learning on heterogeneous systems, arXiv: 1603.04467, 2016. https://doi.org/10.48550/arXiv.1603.04467 |
| [28] |
I. K. Lin, K. S. Ou, Y. M. Liao, Y. Liu, K. S. Chen, X. Zhang, Viscoelastic characterization and modeling of polymer transducers for biological applications, J. Microelectromech. Syst., 18 (2009), 1087–1099. https://doi.org/10.1109/JMEMS.2009.2029166 doi: 10.1109/JMEMS.2009.2029166
|