Gibbs weights with attractive bilinear interactions need not define probability laws on unbounded orthants. This paper gives a maximum-entropy and partition-function classification of that failure. For densities on $ [0, \infty)^2 $ with prescribed marginal means and product moment $ \mathbb{E}[XY] $, the entropy program is well posed exactly when $ \mathbb{E}[XY]\le \mathbb{E}[X] \mathbb{E}[Y] $. In the attractive case $ \mathbb{E}[XY] > \mathbb{E}[X] \mathbb{E}[Y] $, the entropy supremum equals the means-only product-exponential value but is not attained: The attractive constraint is entropically invisible while destroying normalizability. We then identify the repairs. Self-moment damping of orders $ p, q > 1 $ normalizes every attractive bilinear exponent when $ 1/p+1/q < 1 $ and never normalizes it when $ 1/p+1/q > 1 $. In the critical case $ 1/p+1/q = 1 $, normalizability is decided by an explicit inequality between the damping coefficients, which at $ p = q = 2 $ is the Gaussian condition $ \gamma^2 < 4\alpha\alpha' $; when that inequality holds with equality, the linear multipliers decide, and we classify this remaining boundary completely. Hard-wall confinement also repairs the model: Truncation to $ [0, K]^2 $ restores well-posedness and has sharp entropy deficit $ \Delta(\mu_1^{-1}+\mu_2^{-1})/K+o(K^{-1}) $. In dimension $ n $, quadratic Gibbs normalizability is governed by copositivity of the negated coupling matrix together with the sign of the linear field on the zero cone, in every regime except a degenerate boundary of transverse codimension at least two, which we leave unresolved; the associated decision problem is co-NP-hard, where co-NP is the class of decision problems whose complements belong to nondeterministic polynomial time (NP). The results give checkable criteria for when bilinear maximum-entropy models on orthants are genuinely solvable.
Citation: Abdulaziz M. D. Aljohani, Khaled M. Alhawiti. Gibbs normalizability and maximum-entropy programs with bilinear moment constraints on orthants[J]. AIMS Mathematics, 2026, 11(9): 31758-31813. doi: 10.3934/math.20261251
Gibbs weights with attractive bilinear interactions need not define probability laws on unbounded orthants. This paper gives a maximum-entropy and partition-function classification of that failure. For densities on $ [0, \infty)^2 $ with prescribed marginal means and product moment $ \mathbb{E}[XY] $, the entropy program is well posed exactly when $ \mathbb{E}[XY]\le \mathbb{E}[X] \mathbb{E}[Y] $. In the attractive case $ \mathbb{E}[XY] > \mathbb{E}[X] \mathbb{E}[Y] $, the entropy supremum equals the means-only product-exponential value but is not attained: The attractive constraint is entropically invisible while destroying normalizability. We then identify the repairs. Self-moment damping of orders $ p, q > 1 $ normalizes every attractive bilinear exponent when $ 1/p+1/q < 1 $ and never normalizes it when $ 1/p+1/q > 1 $. In the critical case $ 1/p+1/q = 1 $, normalizability is decided by an explicit inequality between the damping coefficients, which at $ p = q = 2 $ is the Gaussian condition $ \gamma^2 < 4\alpha\alpha' $; when that inequality holds with equality, the linear multipliers decide, and we classify this remaining boundary completely. Hard-wall confinement also repairs the model: Truncation to $ [0, K]^2 $ restores well-posedness and has sharp entropy deficit $ \Delta(\mu_1^{-1}+\mu_2^{-1})/K+o(K^{-1}) $. In dimension $ n $, quadratic Gibbs normalizability is governed by copositivity of the negated coupling matrix together with the sign of the linear field on the zero cone, in every regime except a degenerate boundary of transverse codimension at least two, which we leave unresolved; the associated decision problem is co-NP-hard, where co-NP is the class of decision problems whose complements belong to nondeterministic polynomial time (NP). The results give checkable criteria for when bilinear maximum-entropy models on orthants are genuinely solvable.
| [1] |
E. T. Jaynes, Information theory and statistical mechanics, Phys. Rev., 106 (1957), 620–630. https://doi.org/10.1103/PhysRev.106.620 doi: 10.1103/PhysRev.106.620
|
| [2] |
C. E. Shannon, A mathematical theory of communication, Bell Syst. Tech. J., 27 (1948), 379–423. https://doi.org/10.1002/j.1538-7305.1948.tb01338.x doi: 10.1002/j.1538-7305.1948.tb01338.x
|
| [3] |
I. Csiszár, $I$-divergence geometry of probability distributions and minimization problems, Ann. Probab., 3 (1975), 146–158. https://doi.org/10.1214/aop/1176996454 doi: 10.1214/aop/1176996454
|
| [4] |
I. Csiszár, F. Matúš, Information projections revisited, IEEE Trans. Inform. Theory, 49 (2003), 1474–1490. https://doi.org/10.1109/TIT.2003.810633 doi: 10.1109/TIT.2003.810633
|
| [5] | T. M. Cover, J. A. Thomas, Elements of information theory, Hoboken: Wiley, 2006. https://doi.org/10.1002/047174882X |
| [6] |
P. Ishwar, P. Moulin, On the existence and characterization of the maxent distribution under general moment inequality constraints, IEEE Trans. Inform. Theory, 51 (2005), 3322–3333. https://doi.org/10.1109/TIT.2005.853317 doi: 10.1109/TIT.2005.853317
|
| [7] |
J. E. Contreras-Reyes, Lerch distribution based on maximum nonsymmetric entropy principle: application to Conway's game of life cellular automaton, Chaos Solitons Fract., 151 (2021), 111272. https://doi.org/10.1016/j.chaos.2021.111272 doi: 10.1016/j.chaos.2021.111272
|
| [8] |
D. Ruelle, Superstable interactions in classical statistical mechanics, Comm. Math. Phys., 18 (1970), 127–159. https://doi.org/10.1007/BF01646091 doi: 10.1007/BF01646091
|
| [9] | H. O. Georgii, Gibbs measures and phase transitions, Berlin: De Gruyter, 2011. https://doi.org/10.1515/9783110250329 |
| [10] |
S. Kullback, R. A. Leibler, On information and sufficiency, Ann. Math. Statist., 22 (1951), 79–86. https://doi.org/10.1214/aoms/1177729694 doi: 10.1214/aoms/1177729694
|
| [11] | I. N. Sanov, On the probability of large deviations of random variables, Mat. Sb., 42 (1957), 11–44. |
| [12] |
M. D. Donsker, S. R. S. Varadhan, Asymptotic evaluation of certain Markov process expectations for large time. I, Comm. Pure Appl. Math., 28 (1975), 1–47. https://doi.org/10.1002/cpa.3160280102 doi: 10.1002/cpa.3160280102
|
| [13] | P. Dupuis, R. S. Ellis, A weak convergence approach to the theory of large deviations, New York: Wiley, 1997. https://doi.org/10.1002/9781118165904 |
| [14] | A. Dembo, O. Zeitouni, Large deviations techniques and applications, New York: Springer, 1998. https://doi.org/10.1007/978-3-642-03311-7 |
| [15] | O. E. Barndorff-Nielsen, Information and exponential families in statistical theory, Chichester: Wiley, 1978. https://doi.org/10.1002/9781118857281 |
| [16] | L. D. Brown, Fundamentals of statistical exponential families with applications in statistical decision theory, Hayward: Institute of Mathematical Statistics, 1986. |
| [17] |
J. M. Borwein, A. S. Lewis, Duality relationships for entropy-like minimization problems, SIAM J. Control Optim., 29 (1991), 325–338. https://doi.org/10.1137/0329017 doi: 10.1137/0329017
|
| [18] | R. T. Rockafellar, Convex analysis, Princeton: Princeton University Press, 1970. https://doi.org/10.1515/9781400873173 |
| [19] | S. Boyd, L. Vandenberghe, Convex optimization, Cambridge: Cambridge University Press, 2004. |
| [20] |
M. J. Wainwright, M. I. Jordan, Graphical models, exponential families, and variational inference, Found. Trends Mach. Learn., 1 (2008), 1–305. https://doi.org/10.1561/2200000001 doi: 10.1561/2200000001
|
| [21] |
E. K. Haviland, On the momentum problem for distributions in more than one dimension, Amer. J. Math., 57 (1935), 562–568. https://doi.org/10.2307/2371187 doi: 10.2307/2371187
|
| [22] | J. A. Shohat, J. D. Tamarkin, The problem of moments, New York: American Mathematical Society, 1943. https://doi.org/10.1090/SURV/001 |
| [23] | M. G. Krein, A. A. Nudelman, The Markov moment problem and extremal problems, Providence: American Mathematical Society, 1977. https://doi.org/10.1090/mmono/050 |
| [24] |
R. E. Curto, L. A. Fialkow, Solution of the truncated complex moment problem for flat data, Mem. Amer. Math. Soc., 119 (1996), 568. https://doi.org/10.1090/memo/0568 doi: 10.1090/memo/0568
|
| [25] | J. B. Lasserre, Moments, positive polynomials and their applications, London: Imperial College Press, 2009. https://doi.org/10.1142/p665 |
| [26] | A. Berman, N. Shaked-Monderer, Completely positive matrices, Singapore: World Scientific, 2003. https://doi.org/10.1142/5273 |
| [27] |
I. M. Bomze, Copositive optimization–-recent developments and applications, European J. Oper. Res., 216 (2012), 509–520. https://doi.org/10.1016/j.ejor.2011.04.026 doi: 10.1016/j.ejor.2011.04.026
|
| [28] |
P. J. C. Dickinson, L. Gijben, On the computational complexity of membership problems for the completely positive cone and its dual, Comput. Optim. Appl., 57 (2014), 403–415. https://doi.org/10.1007/s10589-013-9594-z doi: 10.1007/s10589-013-9594-z
|
| [29] |
K. G. Murty, S. N. Kabadi, Some NP-complete problems in quadratic and nonlinear programming, Math. Program., 39 (1987), 117–129. https://doi.org/10.1007/BF02592948 doi: 10.1007/BF02592948
|
| [30] |
O. Olteanu, Applications of the Hahn-Banach theorem, a solution of the moment problem and the related approximation, Mathematics, 12 (2024), 2878. https://doi.org/10.3390/math12182878 doi: 10.3390/math12182878
|
| [31] |
M. F. Iqbal, F. Ahmed, Approximation hierarchies for the copositive tensor cone and their application to the polynomial optimization over the simplex, Mathematics, 10 (2022), 1683. https://doi.org/10.3390/math10101683 doi: 10.3390/math10101683
|
| [32] |
B. Sturmfels, M. L. Telek, Copositive geometry of Feynman integrals, Lett. Math. Phys., 115 (2025), 74. https://doi.org/10.1007/s11005-025-01961-w doi: 10.1007/s11005-025-01961-w
|
| [33] |
B. C. Arnold, D. Strauss, Bivariate distributions with exponential conditionals, J. Amer. Statist. Assoc., 83 (1988), 522–527. https://doi.org/10.1080/01621459.1988.10478627 doi: 10.1080/01621459.1988.10478627
|
| [34] |
E. J. Gumbel, Bivariate exponential distributions, J. Amer. Statist. Assoc., 55 (1960), 698–707. https://doi.org/10.1080/01621459.1960.10483368 doi: 10.1080/01621459.1960.10483368
|
| [35] |
B. C. Arnold, D. J. Strauss, Bivariate distributions with conditionals in prescribed exponential families, J. Roy. Statist. Soc. Ser. B, 53 (1991), 365–375. https://doi.org/10.1111/j.2517-6161.1991.tb01829.x doi: 10.1111/j.2517-6161.1991.tb01829.x
|
| [36] | B. C. Arnold, E. Castillo, J. M. Sarabia, Conditional specification of statistical models, New York: Springer, 1999. https://doi.org/10.1007/b97592 |
| [37] |
Q. Sun, Y. Zhou, S. Huang, Fast rates of exponential cost function, Stat. Papers, 66 (2025), 51. https://doi.org/10.1007/s00362-025-01672-3 doi: 10.1007/s00362-025-01672-3
|
| [38] |
S. Jiang, H. Xu, Q. Sun, S. Huang, Robust learning of minimum error entropy under heavy-tailed noise, J. Comput. Appl. Math., 487 (2026), 117686. https://doi.org/10.1016/j.cam.2026.117686 doi: 10.1016/j.cam.2026.117686
|
| [39] | D. Henrion, Maximal entropy in the moment body, arXiv Preprint, 2025. https://doi.org/10.48550/arXiv.2507.02461 |
| [40] |
C. Liu, G. Ma, Maximum entropy principle for uncertain sets with expectation and variance constraints, AIMS Math., 11 (2026), 9303–9318. https://doi.org/10.3934/math.2026384 doi: 10.3934/math.2026384
|
| [41] | G. H. Hardy, J. E. Littlewood, G. Pólya, Inequalities, Cambridge: Cambridge University Press, 1934. |
| [42] |
J. E. Contreras-Reyes, Jensen-autocorrelation function for weakly stationary processes and applications, Phys. D, 470 (2024), 134424. https://doi.org/10.1016/j.physd.2024.134424 doi: 10.1016/j.physd.2024.134424
|
| [43] | H. Z. An, F. C. Huang, The geometrical ergodicity of nonlinear autoregressive models, Statist. Sinica, 6 (1996), 943–956. |
| [44] |
J. G. De Gooijer, On threshold moving-average models, J. Time Ser. Anal., 19 (1998), 1–18. https://doi.org/10.1111/1467-9892.00074 doi: 10.1111/1467-9892.00074
|
| [45] |
J. Besag, Spatial interaction and the statistical analysis of lattice systems, J. Roy. Statist. Soc. Ser. B, 36 (1974), 192–236. https://doi.org/10.1111/j.2517-6161.1974.tb00999.x doi: 10.1111/j.2517-6161.1974.tb00999.x
|
| [46] | E. Yang, P. Ravikumar, G. I. Allen, Z. Liu, Graphical models via univariate exponential family distributions, J. Mach. Learn. Res., 16 (2015), 3813–3847. |
| [47] | D. I. Inouye, P. Ravikumar, I. S. Dhillon, Square root graphical models: multivariate generalizations of univariate exponential families that permit positive dependencies, ICML 2016, 48 (2016), 2445–2453. |