Persistence, extinction, and chaotic dynamics in a predator-prey system with cooperative hunting and prey refuge

Thotahewage Mihiri M. De Silva; Sophia R.-J. Jang; Thotahewage Mihiri M. De Silva; Sophia R.-J. Jang

doi:10.3934/math.2026868

AIMS Mathematics

2026, Volume 11, Issue 7: 21412-21440. doi: 10.3934/math.2026868

Previous Article Next Article

Research article Special Issues

Persistence, extinction, and chaotic dynamics in a predator-prey system with cooperative hunting and prey refuge

Thotahewage Mihiri M. De Silva ¹,
Sophia R.-J. Jang ^{2
,
,}

1.
Department of Mathematics, University of Kelaniya, Kelaniya, Sri Lanka
2.
Department of Mathematics & Statistics, Texas Tech University, Lubbock, TX, USA

Received: 15 May 2026 Revised: 25 June 2026 Accepted: 02 July 2026 Published: 17 July 2026
MSC : 92D25, 92B05

Building on the discrete host-parasitoid model of Wu and Zhao (2018), we have proposed a discrete-time predator-prey system with Ricker-type prey growth, prey refuge, and predator hunting cooperation. Analytical results showed that when the prey growth rate is moderate and the predator reproduction number exceeds one, the system is uniformly persistent: both predator and prey populations are guaranteed to remain above a strictly positive lower bound in the long term, for all positive initial conditions, regardless of the strength of hunting cooperation. We further established global asymptotic stability of the predator-free equilibrium under a sufficient condition requiring the predator nullcline to lie entirely beyond the normalized prey carrying capacity, and we identified a related condition under which a predator-extinct $2$-cycle is globally stable. Numerical simulations revealed that the influence of cooperation depends strongly on prey growth: low growth leads to sensitive, possibly chaotic oscillations; moderate growth stabilizes coexistence; and high growth allows cooperation to act as a "rescue" mechanism for predators while inducing complex, non-equilibrium behavior. These results considerably extend previous discrete predator–prey models with prey refuge by demonstrating that hunting cooperation does not alter the persistence threshold but significantly enriches global dynamics by permitting bistability, oscillatory coexistence, and chaotic attractors.
- Ricker growth,
- uniform persistence,
- prey refuge,
- predator hunting cooperation
Citation: Thotahewage Mihiri M. De Silva, Sophia R.-J. Jang. Persistence, extinction, and chaotic dynamics in a predator-prey system with cooperative hunting and prey refuge[J]. AIMS Mathematics, 2026, 11(7): 21412-21440. doi: 10.3934/math.2026868

Related Papers:

Abstract

Building on the discrete host-parasitoid model of Wu and Zhao (2018), we have proposed a discrete-time predator-prey system with Ricker-type prey growth, prey refuge, and predator hunting cooperation. Analytical results showed that when the prey growth rate is moderate and the predator reproduction number exceeds one, the system is uniformly persistent: both predator and prey populations are guaranteed to remain above a strictly positive lower bound in the long term, for all positive initial conditions, regardless of the strength of hunting cooperation. We further established global asymptotic stability of the predator-free equilibrium under a sufficient condition requiring the predator nullcline to lie entirely beyond the normalized prey carrying capacity, and we identified a related condition under which a predator-extinct $2$-cycle is globally stable. Numerical simulations revealed that the influence of cooperation depends strongly on prey growth: low growth leads to sensitive, possibly chaotic oscillations; moderate growth stabilizes coexistence; and high growth allows cooperation to act as a "rescue" mechanism for predators while inducing complex, non-equilibrium behavior. These results considerably extend previous discrete predator–prey models with prey refuge by demonstrating that hunting cooperation does not alter the persistence threshold but significantly enriches global dynamics by permitting bistability, oscillatory coexistence, and chaotic attractors.

References

[1]	L. J. S. Allen, Introduction to mathematical biology, Prentice-Hall, Englewood Cliffs, NJ, 2006.
[2]	M. T. Alves, F. M. Hilker, Hunting cooperation and Allee effects in predators, J. Theor. Biol., 419 (2017), 13–22. http://dx.doi.org/10.1016/j.jtbi.2017.02.002 doi: 10.1016/j.jtbi.2017.02.002
[3]	F. S. Berezovskaya, B. Song, C. Castillo-Chavez, Role of prey dispersal and refuges on predator–prey dynamics, SIAM J. Appl. Math., 70 (2010), 1821–1839. https://doi.org/10.1137/080730603 doi: 10.1137/080730603
[4]	G. Benettin, L. Galgani, A. Giorgilli, J. M. Strelcyn, Lyapunov characteristic exponents for smooth dynamical systems; a method for computing all of them. Part 1: Theory, Meccanica, 15 (1980), 9–20. https://doi.org/10.1007/BF02128236 doi: 10.1007/BF02128236
[5]	A. A. Berryman, B. A. Hawkins, The refuge as an integrating concept in ecology and evolution, Oikos, 115 (2006), 192–196. https://doi.org/10.1111/j.0030-1299.2006.15188.x doi: 10.1111/j.0030-1299.2006.15188.x
[6]	S. Chakraborty, B. W. Kooi, B. Biswas, J. Chattopadhyay, Revealing the role of predator interference in a predator–prey system with disease in prey population, Ecol. Complex., 21 (2015), 100–111. https://doi.org/10.1016/j.ecocom.2014.11.005 doi: 10.1016/j.ecocom.2014.11.005
[7]	Y. H. Chou, Y. Chow, X. Hu, S. R.-J. Jang, A Ricker-type predator–prey system with hunting cooperation in discrete time, Math. Comput. Simulat., 190 (2021), 570–586. https://doi.org/10.1016/j.matcom.2021.06.003 doi: 10.1016/j.matcom.2021.06.003
[8]	Y. Chow, S. R.-J. Jang, N. Yeh, Dynamics of a population in two patches with dispersal, J. Differ. Equ. Appl., 24 (2018), 543–563. https://doi.org/10.1080/10236198.2018.1428962 doi: 10.1080/10236198.2018.1428962
[9]	Y. Chow, S. R.-J. Jang, Neimark–Sacker bifurcations in a host–parasitoid system with a host refuge, Discrete Cont. Dyn.-B, 21 (2018), 1713–1728. https://doi.org/10.3934/dcdsb.2016019 doi: 10.3934/dcdsb.2016019
[10]	Y. Chow, S. R.-J. Jang, H. M. Wang, Cooperative hunting in a discrete predator–prey system, Int. J. Biomath., 13 (2020), 2050063. https://doi.org/10.48550/arXiv.1808.00182 doi: 10.48550/arXiv.1808.00182
[11]	J. M. Cushing, An introduction to structured population dynamics, SIAM, Philadelphia, 1998.
[12]	L. A. Dugatkin, Cooperation among animals: An evolutionary perspective, Oxford: Oxford University Press, 1997.
[13]	S. Elaydi, A. A. Yakubu, Basins of attraction of stable cycles, J. Differ. Equ. Appl., 8 (2002), 755–760. https://doi.org/10.1080/10236190290027666 doi: 10.1080/10236190290027666
[14]	S. Elaydi, An introduction to difference equations, 3 Eds., New York: Springer, 2005.
[15]	J. E. Franke, A. A. Yakubu, SIS epidemic attractors in periodic environments, J. Biol. Dynam., 1 (2007), 394–412. https://doi.org/10.1080/17513750701605630 doi: 10.1080/17513750701605630
[16]	S. Ghimire, X. S. Wang, Competition and cooperation on predation: Bifurcation theory of mutualism, J. Biol. Syst., 29 (2021), 49–73. https://doi.org/10.1142/S0218339021500030 doi: 10.1142/S0218339021500030
[17]	E. A. Grove, G. Ladas, Periodicities in nonlinear difference equations, Boca Raton: Chapman and Hall/CRC Press, 2004. https://doi.org/10.1201/9781420037722
[18]	M. P. Hassell, The dynamics of Arthropod predator–prey systems, Princeton: Princeton University Press, 1978.
[19]	J. Hofbauer, J. So, Uniform persistence and repellors for maps, P. Am. Math. Soc., 107 (1989), 1137–1142.
[20]	H. Hu, Distributed constrained optimization for nonlinear stochastic multi-agent systems: Application to resource allocation, Complex Syst. Stabil. Control, 1 (2025), 5. https://doi.org/10.53941/cssc.2025.100005 doi: 10.53941/cssc.2025.100005
[21]	Y. Huang, F. Chen, L. Zhong, Stability analysis of a prey–predator model with Holling type III response function incorporating a prey refuge, Appl. Math. Comput., 182 (2006), 672–683. https://doi.org/10.1016/j.amc.2006.04.030 doi: 10.1016/j.amc.2006.04.030
[22]	S. R.-J. Jang, Backward bifurcation in a discrete SIS model with vaccination, J. Biol. Syst., 16 (2008), 479–494. https://doi.org/10.1142/S0218339008002630 doi: 10.1142/S0218339008002630
[23]	S. R.-J. Jang, W. Zhang, V. Larriva, Cooperative hunting in a predator–prey system with Allee effects in the prey, Nat. Resour. Model., 31 (2018), e12194. https://doi.org/10.1111/nrm.12194 doi: 10.1111/nrm.12194
[24]	S. R.-J. Jang, A. M. Yousef, Effects of prey refuge and predator cooperation on a predator–prey system, J. Biol. Dynam., 17 (2023), 2242372. https://doi.org/10.1080/17513758.2023.2242372 doi: 10.1080/17513758.2023.2242372
[25]	M. Kot, Elements of mathematical ecology, Cambridge: Cambridge University Press, 2001.
[26]	G. Mandal, L. N. Guin, S. Chakravarty, R. Han, Dynamic complexities in a predator–prey model with prey refuge influenced by double Allee effects, Math. Comput. Simulat., 227 (2025), 527–552. https://doi.org/10.1016/j.matcom.2024.08.015 doi: 10.1016/j.matcom.2024.08.015
[27]	R. M. May, Biological populations with nonoverlapping generations: Stable points, stable cycles, and chaos, Science, 186 (1974), 645–647.
[28]	J. Maynard-Smith, Models in ecology, Cambridge: Cambridge University Press, 1974.
[29]	W. W. Murdoch, C. J. Briggs, R. M. Nisbet, Consumer–resource dynamics, Princeton: Princeton University Press, 2003.
[30]	W. E. Ricker, Stock and recruitment, J. Fish. Res. Board Can., 11 (1954), 559–623.
[31]	S. Saha, G. Samanta, Analysis of a predator–prey model with herd behavior and disease in prey incorporating prey refuge, Int. J. Biomath., 12 (2019), 1950007. https://doi.org/10.1142/S1793524519500074 doi: 10.1142/S1793524519500074
[32]	A. Sih, Prey refuges and predator–prey stability, Theor. Popul. Biol., 31 (1987), 1–12.
[33]	D. Wu, H. Zhao, Global qualitative analysis of a discrete host–parasitoid model with refuge and strong Allee effects, Math. Method. Appl. Sci., 41 (2018), 2039–2062. https://doi.org/10.1002/mma.4731 doi: 10.1002/mma.4731

Reader Comments

Your name:*

Email:*
© 2026 the Author(s), licensee AIMS Press. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0)