Estimating the mean parameters in random variables, particularly within multivariate normal distributions, is a critical issue in statistics. Traditional methods, such as the maximum likelihood estimator, often struggle in high-dimensional or small-sample contexts, driving interest in shrinkage estimators that enhance accuracy by reducing variance. This study builds on the foundational work by Stein and others examining the minimax properties of shrinkage estimators. In this paper, we propose Bayesian estimation techniques that incorporate prior information within a balanced loss function framework, aiming to improve upon existing methods. Our findings demonstrate the advantages of using the balanced loss function for performance evaluation, which offers a robust alternative to conventional quadratic loss functions. In this paper, we present the theoretical foundations, a simulation study, and an application to real data.
Citation: Amani Alahmadi, Abdelkader Benkhaled, Waleed Almutiry. On the effectiveness of the new estimators obtained from the Bayes estimator[J]. AIMS Mathematics, 2025, 10(3): 5762-5784. doi: 10.3934/math.2025265
Estimating the mean parameters in random variables, particularly within multivariate normal distributions, is a critical issue in statistics. Traditional methods, such as the maximum likelihood estimator, often struggle in high-dimensional or small-sample contexts, driving interest in shrinkage estimators that enhance accuracy by reducing variance. This study builds on the foundational work by Stein and others examining the minimax properties of shrinkage estimators. In this paper, we propose Bayesian estimation techniques that incorporate prior information within a balanced loss function framework, aiming to improve upon existing methods. Our findings demonstrate the advantages of using the balanced loss function for performance evaluation, which offers a robust alternative to conventional quadratic loss functions. In this paper, we present the theoretical foundations, a simulation study, and an application to real data.
| [1] |
A. Benkhaled, A. Hamdaoui, A study of minimax shrinkage estimators dominating the James-Stein estimator under the balanced loss function, Open Math., 20 (2022), 1–11. https://doi.org/10.1515/math-2022-0008 doi: 10.1515/math-2022-0008
|
| [2] |
G. Casella, J. T. Hwang, Limit expressions for the risk of James-Stein estimators, Can. J. Stat., 10 (1982), 305–309. https://doi.org/10.2307/3556196 doi: 10.2307/3556196
|
| [3] |
S. Khan, A. Saleh, On the comparison of the pre-test and shrinkage estimators for the univariate normal mean, Stat. Pap., 42 (2001), 451–473. https://doi.org/10.1007/s003620100073 doi: 10.1007/s003620100073
|
| [4] |
A. Hamdaoui, A. Benkhaled, N. Mezouar, Minimaxity and limits of risks ratios of shrinkage estimators of a multivariate normal mean in the bayesian case, Stat., Optim. Inf. Comput., 8 (2020), 507–520. https://doi.org/10.19139/soic-2310-5070-735 doi: 10.19139/soic-2310-5070-735
|
| [5] |
A. Hamdaoui, W. Almutiry, M. Terbeche, A. Benkhaled, Comparison of risk ratios of shrinkage estimators in high dimensions, Mathematics, 52 (2022), 1–14. https://doi.org/10.3390/math10010052 doi: 10.3390/math10010052
|
| [6] | W. James, C. Stein, Estimation with quadratic loss, Proc 4th Berkeley Symp, Math. Statist.Prob., Univ of California Press, Berkeley, 1 (1961), 361–379. |
| [7] | D. V. Lindley, A. F. M. Smith, Bayes estimates for the linear model (with discussion), J. Roy. Statist. Soc., 34 (1972), 1–41. |
| [8] |
N. Singh, Estimation of parameters of a multivariate normal population from truncated and censored samples, J. R. Stat. Soc. B, 22 (1960), 307–311. https://doi.org/10.1111/j.2517-6161.1960.tb00376.x doi: 10.1111/j.2517-6161.1960.tb00376.x
|
| [9] |
C. Stein, Estimation of the mean of a multivariate normal distribution, Ann. Statist., 9 (1981), 1135–1151. https://doi.org/10.1214/aos/1176345632 doi: 10.1214/aos/1176345632
|
| [10] |
E. Gómez-Déniz, A generalization of the credibility theory obtained by using the weighted balanced loss function, Insur. Math. Econ., 42 (2008), 850–854. https://doi.org/10.1016/j.insmatheco.2007.09.002 doi: 10.1016/j.insmatheco.2007.09.002
|
| [11] | C. Stein, Inadmissibilty of the usual estimator for the mean of a multivariate normal distribution, Proc. 3th Berkeley Symp, Math. Statist. Prob. Univ. of California Press, Berkeley, 1 (1956), 197–206. |
| [12] |
R. Yang, J. O. Berger, Estimation of a covariance matrix using the reference prior, Ann. Statist., 22 (1994), 1195–1211. https://doi.org/10.1214/aos/1176325625 doi: 10.1214/aos/1176325625
|