Research article

Robust adaptive masked and filtered hierarchical multi-innovation stochastic gradient identification for multivariable ARX systems with missing outputs and common colored non-Gaussian disturbances

  • Published: 09 October 2026
  • MSC : 62F35, 93C35, 93E10, 93E12

  • Subsystem-by-subsystem recursive identification is very inefficient for an $ r $-input $ m $-output multivariable autoregressive with exogenous input (ARX) system since it performs multiple operations due to the common input-information vector used by all output channels. Methods that take advantage of this coupled structure such as hierarchical stochastic-gradient and hierarchical multi-innovation stochastic-gradient methods cut down on computations. Unfortunately, most of the formulations are based on full output measurements and white noise of the measurement, and this restricts their use in networked and industrial acquisition systems. In this paper, a powerful multivariable ARX system with missing output samples, corrupted by a typical first-order colored disturbance and a set of impulsive non-Gaussian innovations, was dealt with using a new stochastic-gradient hierarchical multi-innovation adaptive algorithm (RAMF-HMISG). A masked coupled identification model was initially proposed including one-step reconstructed outputs and binary output-availability variables to ensure that the autoregressive regressors are still available, while the missing samples were not included in the identification loss. A commonly used auxiliary prewhitening filter was then applied to the output, the autoregressive regressors, as well as the shared input regressor, leading to preservation of the deterministic part of the ARX model, while factually separating the filtering/reconstruction mismatch. The correction term was based on Huber loss and the bounded score to make it more robust. A filtered reliability mask was also added as this takes into account current and previous output measurements for each filtered output sample. Based on the previous innovation energy, which was smoothed, non-circular adaptive laws were also proposed for the innovation length $ p(t) $ and convergence index $ \varepsilon(t) $. It was shown that a residual relation and a conservative mean-square boundedness result can be made under the conditions of bounded regressors, block excitation, stable filtering, bounded reconstruction mismatch, and stochastic-approximation step-size conditions. The analysis ensured the stability to a noise/mismatch dependent neighborhood for nonzero disturbances. Numerical simulations, ablation tests, and Monte Carlo statistics demonstrated that the proposed RAMF-HMISG algorithm outperforms other variants of the algorithm, such as zero-filling, masked-only, robust-only, and fixed filtered ones, in terms of smaller parameter-estimation errors under the simultaneous colored noise, missing outputs, and impulsive perturbations. The evaluation further covered a higher-order three-input three-output system, missing-output probabilities up to $ 50\% $, several noise levels, coloring coefficients and impulsive intensities, a component-wise ablation of the two adaptive laws, a scalability study of the adaptive mechanisms, and a numerical verification of the excitation and mismatch conditions used in the analysis. The applicable boundary of the common-filter assumption was also quantified for channel-dependent coloring.

    Citation: Slim Dhahri, Mourad Elloumi, Hend Aljahani, Salem Albalawi, Sahar Almashaan, Hatem Alwardi, Foued Mtiri. Robust adaptive masked and filtered hierarchical multi-innovation stochastic gradient identification for multivariable ARX systems with missing outputs and common colored non-Gaussian disturbances[J]. AIMS Mathematics, 2026, 11(10): 32572-32627. doi: 10.3934/math.20261281

    Related Papers:

  • Subsystem-by-subsystem recursive identification is very inefficient for an $ r $-input $ m $-output multivariable autoregressive with exogenous input (ARX) system since it performs multiple operations due to the common input-information vector used by all output channels. Methods that take advantage of this coupled structure such as hierarchical stochastic-gradient and hierarchical multi-innovation stochastic-gradient methods cut down on computations. Unfortunately, most of the formulations are based on full output measurements and white noise of the measurement, and this restricts their use in networked and industrial acquisition systems. In this paper, a powerful multivariable ARX system with missing output samples, corrupted by a typical first-order colored disturbance and a set of impulsive non-Gaussian innovations, was dealt with using a new stochastic-gradient hierarchical multi-innovation adaptive algorithm (RAMF-HMISG). A masked coupled identification model was initially proposed including one-step reconstructed outputs and binary output-availability variables to ensure that the autoregressive regressors are still available, while the missing samples were not included in the identification loss. A commonly used auxiliary prewhitening filter was then applied to the output, the autoregressive regressors, as well as the shared input regressor, leading to preservation of the deterministic part of the ARX model, while factually separating the filtering/reconstruction mismatch. The correction term was based on Huber loss and the bounded score to make it more robust. A filtered reliability mask was also added as this takes into account current and previous output measurements for each filtered output sample. Based on the previous innovation energy, which was smoothed, non-circular adaptive laws were also proposed for the innovation length $ p(t) $ and convergence index $ \varepsilon(t) $. It was shown that a residual relation and a conservative mean-square boundedness result can be made under the conditions of bounded regressors, block excitation, stable filtering, bounded reconstruction mismatch, and stochastic-approximation step-size conditions. The analysis ensured the stability to a noise/mismatch dependent neighborhood for nonzero disturbances. Numerical simulations, ablation tests, and Monte Carlo statistics demonstrated that the proposed RAMF-HMISG algorithm outperforms other variants of the algorithm, such as zero-filling, masked-only, robust-only, and fixed filtered ones, in terms of smaller parameter-estimation errors under the simultaneous colored noise, missing outputs, and impulsive perturbations. The evaluation further covered a higher-order three-input three-output system, missing-output probabilities up to $ 50\% $, several noise levels, coloring coefficients and impulsive intensities, a component-wise ablation of the two adaptive laws, a scalability study of the adaptive mechanisms, and a numerical verification of the excitation and mismatch conditions used in the analysis. The applicable boundary of the common-filter assumption was also quantified for channel-dependent coloring.



    加载中


    [1] L. Ljung, System identification, In: Wiley encyclopedia of electrical and electronics engineering, John Wiley & Sons, 1999. https://doi.org/10.1002/047134608X.W1046
    [2] M. Deistler, System identification: T. Söderström, P. Stoica, Prentice Hall International, 1989, Economet. Theor., 10 (1994), 813–815. https://doi.org/10.1017/S026646660000880X doi: 10.1017/S026646660000880X
    [3] R. Pintelon, J. Schoukens, System identification: A frequency domain approach, 2 Eds., Hoboken, NJ: IEEE Press/Wiley, 2012. https://doi.org/10.1002/9781118287422
    [4] H. F. Chen, L. Guo, Identification and stochastic adaptive control, Boston, MA: Birkhäuser, 1991. https://doi.org/10.1007/978-1-4612-0429-9
    [5] H. Robbins, S. Monro, A stochastic approximation method, Ann. Math. Stat., 22 (1951), 400–407. https://doi.org/10.1214/aoms/1177729586 doi: 10.1214/aoms/1177729586
    [6] A. Benveniste, M. Métivier, P. Priouret, Adaptive algorithms and stochastic approximations, Berlin, Heidelberg: Springer, 1990. https://doi.org/10.1007/978-3-642-75894-2
    [7] A. H. Sayed, Adaptive filters, Hoboken, NJ: John Wiley & Sons, 2008. https://doi.org/10.1002/9780470374122
    [8] P. S. R. Diniz, Adaptive filtering: Algorithms and practical implementation, 4 Eds., New York: Springer, 2013. https://doi.org/10.1007/978-1-4614-4106-9
    [9] H. J. Kushner, G. G. Yin, Stochastic approximation and recursive algorithms and applications, 2 Eds., New York: Springer, 2003. https://doi.org/10.1007/b97441
    [10] F. Ding, X. Liu, G. Liu, Several multi-innovation identification methods, Digit. Signal Process., 20 (2010), 1027–1039. https://doi.org/10.1016/j.dsp.2009.10.030 doi: 10.1016/j.dsp.2009.10.030
    [11] Y. Liu, L. Yu, F. Ding, Multi-innovation extended stochastic gradient algorithm and its performance analysis, Circuits Syst. Signal Process., 29 (2010), 649–667. https://doi.org/10.1007/s00034-010-9174-8 doi: 10.1007/s00034-010-9174-8
    [12] Y. Liu, F. Ding, Y. Shi, An efficient hierarchical identification method for general dual-rate sampled-data systems, Automatica, 50 (2014), 962–970. https://doi.org/10.1016/j.automatica.2013.12.025 doi: 10.1016/j.automatica.2013.12.025
    [13] H. Xing, F. Ding, F. Pan, E. Yang, Hierarchical recursive least squares parameter estimation methods for multiple-input multiple-output systems by using the auxiliary models, Int. J. Adapt. Control Signal Process., 37 (2023), 2983–3007. https://doi.org/10.1002/acs.3669 doi: 10.1002/acs.3669
    [14] H. Xing, F. Ding, F. Pan, Highly-computational hierarchical iterative identification methods for multiple-input multiple-output systems by using the auxiliary models, Int. J. Robust Nonlinear Control, 33 (2023), 10845–10863. https://doi.org/10.1002/rnc.6917 doi: 10.1002/rnc.6917
    [15] H. Xing, F. Ding, F. Pan, Auxiliary model-based hierarchical stochastic gradient methods for multiple-input multiple-output systems, J. Comput. Appl. Math., 442 (2024), 115687. https://doi.org/10.1016/j.cam.2023.115687 doi: 10.1016/j.cam.2023.115687
    [16] F. Ding, Y. Xiao, L. Xu, Z. Fang, Hierarchical stochastic gradient and hierarchical multi-innovation stochastic gradient identification for multivariable ARX models, Int. J. Adapt. Control Signal Process., 40 (2026), 79–102. https://doi.org/10.1002/acs.4081 doi: 10.1002/acs.4081
    [17] F. Ding, X. Luan, L. Xu, X. Zhang, Hierarchical recursive gradient parameter identification for multi-input ARX systems with partially-coupled information vectors, Int. J. Adapt. Control Signal Process., 39 (2025), 1978–1995. https://doi.org/10.1002/acs.4036 doi: 10.1002/acs.4036
    [18] F. Ding, L. Xu, X. Zhang, H. Xu, Y. Zhou, X. Luan, Hierarchical generalized extended parameter identification for multivariable equation-error ARMA-like systems by using the filtering identification idea, Annu. Rev. Control, 60 (2025), 100993. https://doi.org/10.1016/j.arcontrol.2025.100993 doi: 10.1016/j.arcontrol.2025.100993
    [19] H. Wang, Q. Zhang, X. Liu, Auxiliary model-based maximum likelihood multi-innovation recursive least squares identification for multiple-input multiple-output systems, J. Franklin Inst., 361 (2024), 107352. https://doi.org/10.1016/j.jfranklin.2024.107352 doi: 10.1016/j.jfranklin.2024.107352
    [20] H. Wang, X. Liu, Highly efficient three-stage maximum likelihood recursive least squares identification method for multiple-input multiple-output systems, Syst. Control Lett., 200 (2025), 106094. https://doi.org/10.1016/j.sysconle.2025.106094 doi: 10.1016/j.sysconle.2025.106094
    [21] H. Wang, X. Liu, Highly efficient two-stage filtering-based maximum likelihood stochastic gradient algorithm for multiple-input multiple-output systems, Circuits Syst. Signal Process., 44 (2025), 5608–5639. https://doi.org/10.1007/s00034-025-03068-y doi: 10.1007/s00034-025-03068-y
    [22] H. Wang, X. Liu, Auxiliary model-based maximum likelihood multi-innovation forgetting gradient identification for a class of multivariable systems, Optim. Control Appl. Met., 46 (2025), 1249–1264. https://doi.org/10.1002/oca.3257 doi: 10.1002/oca.3257
    [23] Q. Zhang, H. Wang, X. Liu, Auxiliary model maximum likelihood least squares-based iterative algorithm for multivariable autoregressive output-error autoregressive moving average systems, P. I. Mech. Eng. I-J. Sys., 239 (2025), 441–463. https://doi.org/10.1177/09596518241280323 doi: 10.1177/09596518241280323
    [24] Q. Zhang, X. Liu, Auxiliary model maximum likelihood moving-data-window generalized extended gradient-based iterative algorithm for multivariable autoregressive output-error autoregressive moving-average systems, Optim. Control Appl. Meth., 46 (2025), 2255–2275. https://doi.org/10.1002/oca.3321 doi: 10.1002/oca.3321
    [25] A. P. Dempster, N. M. Laird, D. B. Rubin, Maximum likelihood from incomplete data via the EM algorithm, J. R. Stat. Soc. B, 39 (1977), 1–22. https://doi.org/10.1111/j.2517-6161.1977.tb01600.x doi: 10.1111/j.2517-6161.1977.tb01600.x
    [26] R. J. A. Little, D. B. Rubin, Statistical analysis with missing data, 3 Eds., Hoboken, NJ: John Wiley & Sons, 2019. https://doi.org/10.1002/9781119482260
    [27] R. H. Shumway, D. S. Stoffer, An approach to time series smoothing and forecasting using the EM algorithm, J. Time Ser. Anal., 3 (1982), 253–264. https://doi.org/10.1111/j.1467-9892.1982.tb00349.x doi: 10.1111/j.1467-9892.1982.tb00349.x
    [28] A. J. Isaksson, Identification of ARX-models subject to missing data, IEEE Trans. Automat. Contr., 38 (1993), 813–819. https://doi.org/10.1109/9.277253 doi: 10.1109/9.277253
    [29] J. Chen, Q. Zhu, Y. Liu, Modified Kalman filtering based multi-step-length gradient iterative algorithm for ARX models with random missing outputs, Automatica, 118 (2020), 109034. https://doi.org/10.1016/j.automatica.2020.109034 doi: 10.1016/j.automatica.2020.109034
    [30] Y. Gu, J. Chen, Y. Tan, A scheme of gradient-based iterative identification with separable synchronous variable-innovation for Exp-ARX systems with arbitrary data loss, IEEE Trans. Ind. Inform., 21 (2025), 7499–7509. https://doi.org/10.1109/TII.2025.3574425 doi: 10.1109/TII.2025.3574425
    [31] F. Ding, L. Xu, X. Zhang, Y. Zhou, X. Luan, Recursive identification methods for general stochastic systems with colored noises by using the hierarchical identification principle and the filtering identification idea, Annu. Rev. Control, 57 (2024), 100942. https://doi.org/10.1016/j.arcontrol.2024.100942 doi: 10.1016/j.arcontrol.2024.100942
    [32] H. Xing, F. Ding, X. Zhang, X. Luan, E. Yang, Highly-efficient filtered hierarchical identification algorithms for multiple-input multiple-output systems with colored noises, Syst. Control Lett., 186 (2024), 105762. https://doi.org/10.1016/j.sysconle.2024.105762 doi: 10.1016/j.sysconle.2024.105762
    [33] H. Xing, G. Miao, F. Ding, Three-stage filtered gradient identification methods for multivariable ARX systems with colored noise, Optim. Control Appl. Meth., 47 (2026), 372–386. https://doi.org/10.1002/oca.70063 doi: 10.1002/oca.70063
    [34] H. Xu, L. Xu, B. Shen, A novel three-stage filtering identification algorithm for the exponential autoregressive time-series model, IEEE Signal Proc. Lett., 32 (2025), 2089–2093. https://doi.org/10.1109/LSP.2025.3567804 doi: 10.1109/LSP.2025.3567804
    [35] Y. Zou, L. Xu, Parameter identification and open-circuit voltage estimation of lithium-ion battery circuit model based on multi-innovation theory, Int. J. Circ. Theor. Appl., 54 (2026), 2747–2764. https://doi.org/10.1002/cta.70128 doi: 10.1002/cta.70128
    [36] Y. Liu, X. Yin, F. Ding, Q. Zhu, Greedy orthogonal least squares identification for multivariable Hammerstein models, Circuits Syst. Signal Process., 45 (2026), 1865–1886. https://doi.org/10.1007/s00034-025-03327-y doi: 10.1007/s00034-025-03327-y
    [37] Z. Li, S. Ding, L. Zhang, G. Song, Filter-based predefined-time optimal fault-tolerant consensus control for nonlinear multi-agent systems via reinforcement learning, Neurocomputing, 679 (2026), 133224. https://doi.org/10.1016/j.neucom.2026.133224 doi: 10.1016/j.neucom.2026.133224
    [38] W. Liu, P. P. Pokharel, J. C. Principe, Correntropy: Properties and applications in non-Gaussian signal processing, IEEE Trans. Signal Process., 55 (2007), 5286–5298. https://doi.org/10.1109/TSP.2007.896065 doi: 10.1109/TSP.2007.896065
    [39] X. Wang, Y. Duan, Heterogeneous mixed kernel correntropy-based robust iterative estimation methods and convergence analysis for the nonlinear system with outliers, Circuits Syst. Signal Process., 44 (2025), 6550–6581. https://doi.org/10.1007/s00034-025-03156-z doi: 10.1007/s00034-025-03156-z
    [40] X. Wang, Y. Duan, Gaussian–Versoria mixed kernel correntropy-based robust parameter and state estimation for bilinear state–space systems with non-Gaussian process and measurement noises, Axioms, 14 (2025), 630. https://doi.org/10.3390/axioms14080630 doi: 10.3390/axioms14080630
    [41] F. Barani, A. Savadi, H. Sadoghi Yazdi, A distributed learning based on robust diffusion SGD over adaptive networks with noisy output data, J. Parallel Distr. Com., 190 (2024), 104883. https://doi.org/10.1016/j.jpdc.2024.104883 doi: 10.1016/j.jpdc.2024.104883
    [42] W. Wang, S. Liu, Y. Jiang, J. Sun, W. Xu, X. Chen, A robust filter and smoother-based expectation-maximization algorithm for bilinear systems with heavy-tailed noise, Mech. Syst. Signal Pr., 236 (2025), 112912. https://doi.org/10.1016/j.ymssp.2025.112912 doi: 10.1016/j.ymssp.2025.112912
    [43] G. Qian, L. Shen, Y. Guan, J. Qian, S. Wang, Robust recursive widely linear adaptive filtering algorithm for censored regression, Signal Process., 230 (2025), 109854. https://doi.org/10.1016/j.sigpro.2024.109854 doi: 10.1016/j.sigpro.2024.109854
    [44] B. Chen, L. Xing, H. Zhao, N. Zheng, J. C. Príncipe, Generalized correntropy for robust adaptive filtering, IEEE Trans. Signal Process., 64 (2016), 3376–3387. https://doi.org/10.1109/TSP.2016.2539127 doi: 10.1109/TSP.2016.2539127
    [45] B. Chen, X. Liu, H. Zhao, J. C. Príncipe, Maximum correntropy Kalman filter, Automatica, 76 (2017), 70–77. https://doi.org/10.1016/j.automatica.2016.10.004 doi: 10.1016/j.automatica.2016.10.004
    [46] Y. Zou, S. C. Chan, T. S. Ng, Least mean M-estimate algorithms for robust adaptive filtering in impulse noise, IEEE Trans. Circuits Syst. Ⅱ, 47 (2000), 1564–1569. https://doi.org/10.1109/82.899657 doi: 10.1109/82.899657
    [47] S. C. Chan, Y. X. Zou, A recursive least M-estimate algorithm for robust adaptive filtering in impulsive noise: Fast algorithm and convergence performance analysis, IEEE Trans. Signal Process., 52 (2004), 975–991. https://doi.org/10.1109/TSP.2004.823496 doi: 10.1109/TSP.2004.823496
    [48] P. J. Huber, Robust estimation of a location parameter, Ann. Math. Stat., 35 (1964), 73–101. https://doi.org/10.1214/aoms/1177703732 doi: 10.1214/aoms/1177703732
    [49] P. J. Huber, E. M. Ronchetti, Robust statistics, 2 Eds., Hoboken, NJ: John Wiley & Sons, 2009. https://doi.org/10.1002/9780470434697
    [50] F. R. Hampel, E. M. Ronchetti, P. J. Rousseeuw, W. A. Stahel, Robust statistics: The approach based on influence functions, New York: John Wiley & Sons, 1986. https://doi.org/10.1002/9781118186435
    [51] H. Raghavan, A. K. Tangirala, R. B. Gopaluni, S. L. Shah, Identification of chemical processes with irregular output sampling, Control Eng. Pract., 14 (2006), 467–480. https://doi.org/10.1016/j.conengprac.2005.01.015 doi: 10.1016/j.conengprac.2005.01.015
    [52] S. Gibson, B. Ninness, Robust maximum-likelihood estimation of multivariable dynamic systems, Automatica, 41 (2005), 1667–1682. https://doi.org/10.1016/j.automatica.2005.05.008 doi: 10.1016/j.automatica.2005.05.008
    [53] T. B. Schön, A. Wills, B. Ninness, System identification of nonlinear state-space models, Automatica, 47 (2011), 39–49. https://doi.org/10.1016/j.automatica.2010.10.013 doi: 10.1016/j.automatica.2010.10.013
    [54] X. Chen, S. Zhao, F. Liu, Robust identification of linear ARX models with recursive EM algorithm based on Student's t-distribution, J. Franklin Inst., 358 (2021), 1103–1121. https://doi.org/10.1016/j.jfranklin.2020.06.003 doi: 10.1016/j.jfranklin.2020.06.003
    [55] F. Ding, T. Chen, Performance analysis of multi-innovation gradient type identification methods, Automatica, 43 (2007), 1–14. https://doi.org/10.1016/j.automatica.2006.07.024 doi: 10.1016/j.automatica.2006.07.024
  • Reader Comments
  • © 2026 the Author(s), licensee AIMS Press. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0)
通讯作者: 陈斌, bchen63@163.com
  • 1. 

    沈阳化工大学材料科学与工程学院 沈阳 110142

  1. 本站搜索
  2. 百度学术搜索
  3. 万方数据库搜索
  4. CNKI搜索

Metrics

Article views(5) PDF downloads(0) Cited by(0)

Article outline

Figures and Tables

Figures(15)  /  Tables(25)

/

DownLoad:  Full-Size Img  PowerPoint
Return
Return

Catalog