This paper proposes an interconnected Hammerstein neural network (IHNN)-based hybrid identification method for large-scale interconnected Hammerstein systems subject to stochastic disturbances. In the proposed method, the static nonlinear blocks are approximated by neural networks, while the linear dynamic parameters are recursively estimated using a recursive least-squares scheme with forgetting and covariance adaptation. The proposed identification framework preserves the block-oriented Hammerstein structure and is designed to handle strong subsystem interconnections and noisy operating conditions. A Lyapunov-based analysis is further developed to establish convergence and stability conditions for the overall learning algorithm, which combines backpropagation for the neural-network parameters and recursive estimation for the linear dynamics. The effectiveness of the proposed IHNN identification method is validated through a benchmark interconnected system and a hydraulic-process case study. The simulation results show consistent improvements over a conventional recursive extended least squares (RELS) baseline, including root mean square error (RMSE) reductions of about 35–38% and prediction-error variance reductions of about 60%, at the expense of increased computational time. These results demonstrate that the proposed IHNN approach provides an accurate and practical solution for identifying noisy large-scale interconnected Hammerstein systems.
Citation: Rihab Issaoui, Mourad Elloumi, Imed Bouzida, Omar Naifar. Hierarchical neural identification approach for Hammerstein large-scale stochastic systems: A simulation study of hydraulic process[J]. AIMS Mathematics, 2026, 11(4): 12132-12154. doi: 10.3934/math.2026498
This paper proposes an interconnected Hammerstein neural network (IHNN)-based hybrid identification method for large-scale interconnected Hammerstein systems subject to stochastic disturbances. In the proposed method, the static nonlinear blocks are approximated by neural networks, while the linear dynamic parameters are recursively estimated using a recursive least-squares scheme with forgetting and covariance adaptation. The proposed identification framework preserves the block-oriented Hammerstein structure and is designed to handle strong subsystem interconnections and noisy operating conditions. A Lyapunov-based analysis is further developed to establish convergence and stability conditions for the overall learning algorithm, which combines backpropagation for the neural-network parameters and recursive estimation for the linear dynamics. The effectiveness of the proposed IHNN identification method is validated through a benchmark interconnected system and a hydraulic-process case study. The simulation results show consistent improvements over a conventional recursive extended least squares (RELS) baseline, including root mean square error (RMSE) reductions of about 35–38% and prediction-error variance reductions of about 60%, at the expense of increased computational time. These results demonstrate that the proposed IHNN approach provides an accurate and practical solution for identifying noisy large-scale interconnected Hammerstein systems.
| [1] |
M. Elloumi, H. Gassara, O. Naifar, An overview on modelling of complex interconnected nonlinear systems, Math. Probl. Eng., 2022 (2022), 4789405. https://doi.org/10.1155/2022/4789405 doi: 10.1155/2022/4789405
|
| [2] |
M. Elloumi, S. Kamoun, An iterative parametric estimation method for hammerstein large-scale systems: A simulation study of hydraulic process, Int. J. Simul. Process Model., 11 (2016), 207–219. https://doi.org/10.1504/IJSPM.2016.078501 doi: 10.1504/IJSPM.2016.078501
|
| [3] |
F. Li, X. Sun, T. Wang, R. Liu, Identification methodology for MIMO hammerstein nonlinear model with process noise, Trans. Inst. Meas. Control, 47 (2025), 2190–2202. https://doi.org/10.1177/01423312241276072 doi: 10.1177/01423312241276072
|
| [4] | M. Zhang, L. Jia, F. Li, Identification of the hammerstein system with time delay and colored noise, In: 2025 IEEE 14th Data driven control and learning systems (DDCLS), IEEE, 2025, 1815–1819. https://doi.org/10.1109/DDCLS66240.2025.11065333 |
| [5] |
W. Wu, J. Hu, Z. Zhu, F. Zhang, J. Xu, C. Wang, Deterministic learning-based neural identification and knowledge fusion, Neural Netw., 169 (2024), 165–180. https://doi.org/10.1016/j.neunet.2023.10.004 doi: 10.1016/j.neunet.2023.10.004
|
| [6] |
P. Saha, S. Dash, S. Mukhopadhyay, Physics-incorporated convolutional recurrent neural networks for source identification and forecasting of dynamical systems, Neural Netw., 144 (2021), 359–371. https://doi.org/10.1016/j.neunet.2021.07.004 doi: 10.1016/j.neunet.2021.07.004
|
| [7] |
M. F. da Silva, M. T. da Silva, P. R. Barros, G. A. Junior, Enhanced hammerstein models identification using multiple hidden layers neural networks, Circuits Syst. Signal Process., 44 (2025), 4669–4703. https://doi.org/10.1007/s00034-025-03029-5 doi: 10.1007/s00034-025-03029-5
|
| [8] |
F. Li, L. Song, T. Wang, R. Liu, Parameter identification for nonlinear hammerstein models with stacked sparse autoencoder network, Eng. Appl. Artif. Intell., 163 (2026), 113002. https://doi.org/10.1016/j.engappai.2025.113002 doi: 10.1016/j.engappai.2025.113002
|
| [9] |
F. Li, Y. Zhu, C. Zhao, R. Liu, Parameter estimation of multi-input multi-output hammerstein nonlinear system with deep GRU networks, Int. J. Robust Nonlinear Control, 36 (2026), 4792–4810. https://doi.org/10.1002/rnc.70461 doi: 10.1002/rnc.70461
|
| [10] |
B. Li, H. Wang, X. Tan, Q. Li, J. Chen, X. Qiu, Adaptive heterogeneous graph reasoning for relational understanding in interconnected systems, J. Supercomput., 81 (2025), 112. https://doi.org/10.1007/s11227-024-06623-7 doi: 10.1007/s11227-024-06623-7
|
| [11] |
Y. Tang, J. Ding, Y. Chen, Y. Gao, A. Jiang, C. Wang, Anxiety disorder identification with biomarker detection through subspace-enhanced hypergraph neural network, Neural Netw., 187 (2025), 107293. https://doi.org/10.1016/j.neunet.2025.107293 doi: 10.1016/j.neunet.2025.107293
|
| [12] |
G. Yang, X. Yang, Data-based decentralized control of nonlinear-constrained interconnected systems using reinforcement learning, Neural Netw., 191 (2025), 107780. https://doi.org/10.1016/j.neunet.2025.107780 doi: 10.1016/j.neunet.2025.107780
|
| [13] |
A. B. Makhlouf, O. Naifar, On the barbalat lemma extension for the generalized conformable fractional integrals: Application to adaptive observer design, Asian J. Control, 25 (2023), 563–569. https://doi.org/10.1002/asjc.2797 doi: 10.1002/asjc.2797
|
| [14] |
E. B. Alaia, S. Dhahri, O. Naifar, A gradient-based optimization algorithm for optimal control problems with general conformable fractional derivatives, IEEE Access, 13 (2025), 140270–140281. https://doi.org/10.1109/ACCESS.2025.3595958 doi: 10.1109/ACCESS.2025.3595958
|
| [15] |
J. P. Ntayagabiri, Y. Bentaleb, J. Ndikumagenge, H. El Makhtoum, OMIC: A bagging-based ensemble learning framework for large-scale IoT intrusion detection, J. Fut. Artif. Intell. Tech., 1 (2025), 401–416. https://doi.org/10.62411/faith.3048-3719-63 doi: 10.62411/faith.3048-3719-63
|
| [16] |
C. W. Lynn, Q. Yu, R. Pang, S. E. Palmer, W. Bialek, Exact minimax entropy models of large-scale neuronal activity, Phys. Rev. E, 111 (2025), 054411. https://doi.org/10.1103/PhysRevE.111.054411 doi: 10.1103/PhysRevE.111.054411
|
| [17] | X. Glorot, Y. Bengio, Understanding the difficulty of training deep feedforward neural networks, In: Proceedings of the thirteenth international conference on artificial intelligence and statistics, 2010, 249–256. |
| [18] |
R. Meng, C. Hua, K. Li, Q. Li, Dynamic events-based adaptive NN output feedback control of interconnected nonlinear systems under general output constraint, Neural Netw., 188 (2025), 107452. https://doi.org/10.1016/j.neunet.2025.107452 doi: 10.1016/j.neunet.2025.107452
|
| [19] |
A. Sahoo, V. Narayanan, Differential-game for resource aware approximate optimal control of large-scale nonlinear systems with multiple players, Neural Netw., 124 (2020), 95–108. https://doi.org/10.1016/j.neunet.2019.12.031 doi: 10.1016/j.neunet.2019.12.031
|
| [20] | N. T. Nguyen, Least-squares parameter identification, In: Model-reference adaptive control, Cham: Springer, 2018,125–149. https://doi.org/10.1007/978-3-319-56393-0_6 |
| [21] |
B. Lai, D. S. Bernstein, Generalized forgetting recursive least squares: Stability and robustness guarantees, IEEE Trans. Autom. Control, 69 (2024), 7646–7661. https://doi.org/10.1109/TAC.2024.3394351 doi: 10.1109/TAC.2024.3394351
|
| [22] |
L. Behera, S. Kumar, A. Patnaik, On adaptive learning rate that guarantees convergence in feedforward networks, IEEE Trans. Neural Netw., 17 (2006), 1116–1125. https://doi.org/10.1109/TNN.2006.878121 doi: 10.1109/TNN.2006.878121
|
| [23] |
Z. Man, H. R. Wu, S. Liu, X. Yu, A new adaptive backpropagation algorithm based on Lyapunov stability theory for neural networks, IEEE Trans. Neural Netw., 17 (2006), 1580–1591. https://doi.org/10.1109/TNN.2006.880360 doi: 10.1109/TNN.2006.880360
|
| [24] |
F. Li, X. Sun, Q. Cao, Parameter learning of multi-input multi-output hammerstein system with measurement noises utilizing combined signals, Int. J. Adapt. Control Signal Process., 39 (2024), 1416–1433. https://doi.org/10.1002/acs.3857 doi: 10.1002/acs.3857
|
| [25] |
Q. Zha, F. Li, R. Liu, Identification of the hammerstein nonlinear system with noisy output measurements, Control Theory Technol., 22 (2024), 203–212. https://doi.org/10.1007/s11768-024-00196-9 doi: 10.1007/s11768-024-00196-9
|