Research article

Gibbs normalizability and maximum-entropy programs with bilinear moment constraints on orthants

  • Published: 24 September 2026
  • MSC : 94A17, 62B10, 44A60, 15B48, 90C60

  • Gibbs weights with attractive bilinear interactions need not define probability laws on unbounded orthants. This paper gives a maximum-entropy and partition-function classification of that failure. For densities on $ [0, \infty)^2 $ with prescribed marginal means and product moment $ \mathbb{E}[XY] $, the entropy program is well posed exactly when $ \mathbb{E}[XY]\le \mathbb{E}[X] \mathbb{E}[Y] $. In the attractive case $ \mathbb{E}[XY] > \mathbb{E}[X] \mathbb{E}[Y] $, the entropy supremum equals the means-only product-exponential value but is not attained: The attractive constraint is entropically invisible while destroying normalizability. We then identify the repairs. Self-moment damping of orders $ p, q > 1 $ normalizes every attractive bilinear exponent when $ 1/p+1/q < 1 $ and never normalizes it when $ 1/p+1/q > 1 $. In the critical case $ 1/p+1/q = 1 $, normalizability is decided by an explicit inequality between the damping coefficients, which at $ p = q = 2 $ is the Gaussian condition $ \gamma^2 < 4\alpha\alpha' $; when that inequality holds with equality, the linear multipliers decide, and we classify this remaining boundary completely. Hard-wall confinement also repairs the model: Truncation to $ [0, K]^2 $ restores well-posedness and has sharp entropy deficit $ \Delta(\mu_1^{-1}+\mu_2^{-1})/K+o(K^{-1}) $. In dimension $ n $, quadratic Gibbs normalizability is governed by copositivity of the negated coupling matrix together with the sign of the linear field on the zero cone, in every regime except a degenerate boundary of transverse codimension at least two, which we leave unresolved; the associated decision problem is co-NP-hard, where co-NP is the class of decision problems whose complements belong to nondeterministic polynomial time (NP). The results give checkable criteria for when bilinear maximum-entropy models on orthants are genuinely solvable.

    Citation: Abdulaziz M. D. Aljohani, Khaled M. Alhawiti. Gibbs normalizability and maximum-entropy programs with bilinear moment constraints on orthants[J]. AIMS Mathematics, 2026, 11(9): 31758-31813. doi: 10.3934/math.20261251

    Related Papers:

  • Gibbs weights with attractive bilinear interactions need not define probability laws on unbounded orthants. This paper gives a maximum-entropy and partition-function classification of that failure. For densities on $ [0, \infty)^2 $ with prescribed marginal means and product moment $ \mathbb{E}[XY] $, the entropy program is well posed exactly when $ \mathbb{E}[XY]\le \mathbb{E}[X] \mathbb{E}[Y] $. In the attractive case $ \mathbb{E}[XY] > \mathbb{E}[X] \mathbb{E}[Y] $, the entropy supremum equals the means-only product-exponential value but is not attained: The attractive constraint is entropically invisible while destroying normalizability. We then identify the repairs. Self-moment damping of orders $ p, q > 1 $ normalizes every attractive bilinear exponent when $ 1/p+1/q < 1 $ and never normalizes it when $ 1/p+1/q > 1 $. In the critical case $ 1/p+1/q = 1 $, normalizability is decided by an explicit inequality between the damping coefficients, which at $ p = q = 2 $ is the Gaussian condition $ \gamma^2 < 4\alpha\alpha' $; when that inequality holds with equality, the linear multipliers decide, and we classify this remaining boundary completely. Hard-wall confinement also repairs the model: Truncation to $ [0, K]^2 $ restores well-posedness and has sharp entropy deficit $ \Delta(\mu_1^{-1}+\mu_2^{-1})/K+o(K^{-1}) $. In dimension $ n $, quadratic Gibbs normalizability is governed by copositivity of the negated coupling matrix together with the sign of the linear field on the zero cone, in every regime except a degenerate boundary of transverse codimension at least two, which we leave unresolved; the associated decision problem is co-NP-hard, where co-NP is the class of decision problems whose complements belong to nondeterministic polynomial time (NP). The results give checkable criteria for when bilinear maximum-entropy models on orthants are genuinely solvable.



    加载中


    [1] E. T. Jaynes, Information theory and statistical mechanics, Phys. Rev., 106 (1957), 620–630. https://doi.org/10.1103/PhysRev.106.620 doi: 10.1103/PhysRev.106.620
    [2] C. E. Shannon, A mathematical theory of communication, Bell Syst. Tech. J., 27 (1948), 379–423. https://doi.org/10.1002/j.1538-7305.1948.tb01338.x doi: 10.1002/j.1538-7305.1948.tb01338.x
    [3] I. Csiszár, $I$-divergence geometry of probability distributions and minimization problems, Ann. Probab., 3 (1975), 146–158. https://doi.org/10.1214/aop/1176996454 doi: 10.1214/aop/1176996454
    [4] I. Csiszár, F. Matúš, Information projections revisited, IEEE Trans. Inform. Theory, 49 (2003), 1474–1490. https://doi.org/10.1109/TIT.2003.810633 doi: 10.1109/TIT.2003.810633
    [5] T. M. Cover, J. A. Thomas, Elements of information theory, Hoboken: Wiley, 2006. https://doi.org/10.1002/047174882X
    [6] P. Ishwar, P. Moulin, On the existence and characterization of the maxent distribution under general moment inequality constraints, IEEE Trans. Inform. Theory, 51 (2005), 3322–3333. https://doi.org/10.1109/TIT.2005.853317 doi: 10.1109/TIT.2005.853317
    [7] J. E. Contreras-Reyes, Lerch distribution based on maximum nonsymmetric entropy principle: application to Conway's game of life cellular automaton, Chaos Solitons Fract., 151 (2021), 111272. https://doi.org/10.1016/j.chaos.2021.111272 doi: 10.1016/j.chaos.2021.111272
    [8] D. Ruelle, Superstable interactions in classical statistical mechanics, Comm. Math. Phys., 18 (1970), 127–159. https://doi.org/10.1007/BF01646091 doi: 10.1007/BF01646091
    [9] H. O. Georgii, Gibbs measures and phase transitions, Berlin: De Gruyter, 2011. https://doi.org/10.1515/9783110250329
    [10] S. Kullback, R. A. Leibler, On information and sufficiency, Ann. Math. Statist., 22 (1951), 79–86. https://doi.org/10.1214/aoms/1177729694 doi: 10.1214/aoms/1177729694
    [11] I. N. Sanov, On the probability of large deviations of random variables, Mat. Sb., 42 (1957), 11–44.
    [12] M. D. Donsker, S. R. S. Varadhan, Asymptotic evaluation of certain Markov process expectations for large time. I, Comm. Pure Appl. Math., 28 (1975), 1–47. https://doi.org/10.1002/cpa.3160280102 doi: 10.1002/cpa.3160280102
    [13] P. Dupuis, R. S. Ellis, A weak convergence approach to the theory of large deviations, New York: Wiley, 1997. https://doi.org/10.1002/9781118165904
    [14] A. Dembo, O. Zeitouni, Large deviations techniques and applications, New York: Springer, 1998. https://doi.org/10.1007/978-3-642-03311-7
    [15] O. E. Barndorff-Nielsen, Information and exponential families in statistical theory, Chichester: Wiley, 1978. https://doi.org/10.1002/9781118857281
    [16] L. D. Brown, Fundamentals of statistical exponential families with applications in statistical decision theory, Hayward: Institute of Mathematical Statistics, 1986.
    [17] J. M. Borwein, A. S. Lewis, Duality relationships for entropy-like minimization problems, SIAM J. Control Optim., 29 (1991), 325–338. https://doi.org/10.1137/0329017 doi: 10.1137/0329017
    [18] R. T. Rockafellar, Convex analysis, Princeton: Princeton University Press, 1970. https://doi.org/10.1515/9781400873173
    [19] S. Boyd, L. Vandenberghe, Convex optimization, Cambridge: Cambridge University Press, 2004.
    [20] M. J. Wainwright, M. I. Jordan, Graphical models, exponential families, and variational inference, Found. Trends Mach. Learn., 1 (2008), 1–305. https://doi.org/10.1561/2200000001 doi: 10.1561/2200000001
    [21] E. K. Haviland, On the momentum problem for distributions in more than one dimension, Amer. J. Math., 57 (1935), 562–568. https://doi.org/10.2307/2371187 doi: 10.2307/2371187
    [22] J. A. Shohat, J. D. Tamarkin, The problem of moments, New York: American Mathematical Society, 1943. https://doi.org/10.1090/SURV/001
    [23] M. G. Krein, A. A. Nudelman, The Markov moment problem and extremal problems, Providence: American Mathematical Society, 1977. https://doi.org/10.1090/mmono/050
    [24] R. E. Curto, L. A. Fialkow, Solution of the truncated complex moment problem for flat data, Mem. Amer. Math. Soc., 119 (1996), 568. https://doi.org/10.1090/memo/0568 doi: 10.1090/memo/0568
    [25] J. B. Lasserre, Moments, positive polynomials and their applications, London: Imperial College Press, 2009. https://doi.org/10.1142/p665
    [26] A. Berman, N. Shaked-Monderer, Completely positive matrices, Singapore: World Scientific, 2003. https://doi.org/10.1142/5273
    [27] I. M. Bomze, Copositive optimization–-recent developments and applications, European J. Oper. Res., 216 (2012), 509–520. https://doi.org/10.1016/j.ejor.2011.04.026 doi: 10.1016/j.ejor.2011.04.026
    [28] P. J. C. Dickinson, L. Gijben, On the computational complexity of membership problems for the completely positive cone and its dual, Comput. Optim. Appl., 57 (2014), 403–415. https://doi.org/10.1007/s10589-013-9594-z doi: 10.1007/s10589-013-9594-z
    [29] K. G. Murty, S. N. Kabadi, Some NP-complete problems in quadratic and nonlinear programming, Math. Program., 39 (1987), 117–129. https://doi.org/10.1007/BF02592948 doi: 10.1007/BF02592948
    [30] O. Olteanu, Applications of the Hahn-Banach theorem, a solution of the moment problem and the related approximation, Mathematics, 12 (2024), 2878. https://doi.org/10.3390/math12182878 doi: 10.3390/math12182878
    [31] M. F. Iqbal, F. Ahmed, Approximation hierarchies for the copositive tensor cone and their application to the polynomial optimization over the simplex, Mathematics, 10 (2022), 1683. https://doi.org/10.3390/math10101683 doi: 10.3390/math10101683
    [32] B. Sturmfels, M. L. Telek, Copositive geometry of Feynman integrals, Lett. Math. Phys., 115 (2025), 74. https://doi.org/10.1007/s11005-025-01961-w doi: 10.1007/s11005-025-01961-w
    [33] B. C. Arnold, D. Strauss, Bivariate distributions with exponential conditionals, J. Amer. Statist. Assoc., 83 (1988), 522–527. https://doi.org/10.1080/01621459.1988.10478627 doi: 10.1080/01621459.1988.10478627
    [34] E. J. Gumbel, Bivariate exponential distributions, J. Amer. Statist. Assoc., 55 (1960), 698–707. https://doi.org/10.1080/01621459.1960.10483368 doi: 10.1080/01621459.1960.10483368
    [35] B. C. Arnold, D. J. Strauss, Bivariate distributions with conditionals in prescribed exponential families, J. Roy. Statist. Soc. Ser. B, 53 (1991), 365–375. https://doi.org/10.1111/j.2517-6161.1991.tb01829.x doi: 10.1111/j.2517-6161.1991.tb01829.x
    [36] B. C. Arnold, E. Castillo, J. M. Sarabia, Conditional specification of statistical models, New York: Springer, 1999. https://doi.org/10.1007/b97592
    [37] Q. Sun, Y. Zhou, S. Huang, Fast rates of exponential cost function, Stat. Papers, 66 (2025), 51. https://doi.org/10.1007/s00362-025-01672-3 doi: 10.1007/s00362-025-01672-3
    [38] S. Jiang, H. Xu, Q. Sun, S. Huang, Robust learning of minimum error entropy under heavy-tailed noise, J. Comput. Appl. Math., 487 (2026), 117686. https://doi.org/10.1016/j.cam.2026.117686 doi: 10.1016/j.cam.2026.117686
    [39] D. Henrion, Maximal entropy in the moment body, arXiv Preprint, 2025. https://doi.org/10.48550/arXiv.2507.02461
    [40] C. Liu, G. Ma, Maximum entropy principle for uncertain sets with expectation and variance constraints, AIMS Math., 11 (2026), 9303–9318. https://doi.org/10.3934/math.2026384 doi: 10.3934/math.2026384
    [41] G. H. Hardy, J. E. Littlewood, G. Pólya, Inequalities, Cambridge: Cambridge University Press, 1934.
    [42] J. E. Contreras-Reyes, Jensen-autocorrelation function for weakly stationary processes and applications, Phys. D, 470 (2024), 134424. https://doi.org/10.1016/j.physd.2024.134424 doi: 10.1016/j.physd.2024.134424
    [43] H. Z. An, F. C. Huang, The geometrical ergodicity of nonlinear autoregressive models, Statist. Sinica, 6 (1996), 943–956.
    [44] J. G. De Gooijer, On threshold moving-average models, J. Time Ser. Anal., 19 (1998), 1–18. https://doi.org/10.1111/1467-9892.00074 doi: 10.1111/1467-9892.00074
    [45] J. Besag, Spatial interaction and the statistical analysis of lattice systems, J. Roy. Statist. Soc. Ser. B, 36 (1974), 192–236. https://doi.org/10.1111/j.2517-6161.1974.tb00999.x doi: 10.1111/j.2517-6161.1974.tb00999.x
    [46] E. Yang, P. Ravikumar, G. I. Allen, Z. Liu, Graphical models via univariate exponential family distributions, J. Mach. Learn. Res., 16 (2015), 3813–3847.
    [47] D. I. Inouye, P. Ravikumar, I. S. Dhillon, Square root graphical models: multivariate generalizations of univariate exponential families that permit positive dependencies, ICML 2016, 48 (2016), 2445–2453.
  • Reader Comments
  • © 2026 the Author(s), licensee AIMS Press. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0)
通讯作者: 陈斌, bchen63@163.com
  • 1. 

    沈阳化工大学材料科学与工程学院 沈阳 110142

  1. 本站搜索
  2. 百度学术搜索
  3. 万方数据库搜索
  4. CNKI搜索

Metrics

Article views(283) PDF downloads(43) Cited by(0)

Article outline

Figures and Tables

Figures(2)  /  Tables(12)

Other Articles By Authors

/

DownLoad:  Full-Size Img  PowerPoint
Return
Return

Catalog