
Energy operations and schedules are significantly impacted by load and energy forecasting systems. An effective system is a requirement for a sustainable and equitable environment. Additionally, a trustworthy forecasting management system enhances the resilience of power systems by cutting power and load-forecast flaws. However, due to the numerous inherent nonlinear properties of huge and diverse data, the classical statistical methodology cannot appropriately learn this non-linearity in data. Energy systems can appropriately evaluate data and regulate energy consumption because of advanced techniques. In comparison to machine learning, deep learning techniques have lately been used to predict energy consumption as well as to learn long-term dependencies. In this work, a fusion of novel multi-directional gated recurrent unit (MD-GRU) with convolutional neural network (CNN) using global average pooling (GAP) as hybridization is being proposed for load and energy forecasting. The spatial and temporal aspects, along with the high dimensionality of the data, are addressed by employing the capabilities of MD-GRU and CNN integration. The obtained results are compared to baseline algorithms including CNN, Long Short-Term Memory (LSTM), Bidirectional Long Short-Term Memory (Bi-LSTM), Gated Recurrent Unit (GRU), and Bidirectional Gated Recurrent Unit (Bi-GRU). The experimental findings indicate that the proposed approach surpasses conventional approaches in terms of accuracy, Mean Absolute Percentage Error (MAPE), and Root Mean Square Error (RSME).
Citation: Fazeel Abid, Muhammad Alam, Faten S. Alamri, Imran Siddique. Multi-directional gated recurrent unit and convolutional neural network for load and energy forecasting: A novel hybridization[J]. AIMS Mathematics, 2023, 8(9): 19993-20017. doi: 10.3934/math.20231019
[1] | Kimun Ryu, Wonlyul Ko . Stability and bifurcations in a delayed predator-prey system with prey-taxis and hunting cooperation functional response. AIMS Mathematics, 2025, 10(6): 12808-12840. doi: 10.3934/math.2025576 |
[2] | Ahmad Suleman, Rizwan Ahmed, Fehaid Salem Alshammari, Nehad Ali Shah . Dynamic complexity of a slow-fast predator-prey model with herd behavior. AIMS Mathematics, 2023, 8(10): 24446-24472. doi: 10.3934/math.20231247 |
[3] | Aeshah A. Raezah, Jahangir Chowdhury, Fahad Al Basir . Global stability of the interior equilibrium and the stability of Hopf bifurcating limit cycle in a model for crop pest control. AIMS Mathematics, 2024, 9(9): 24229-24246. doi: 10.3934/math.20241179 |
[4] | A. Q. Khan, Ibraheem M. Alsulami . Complicate dynamical analysis of a discrete predator-prey model with a prey refuge. AIMS Mathematics, 2023, 8(7): 15035-15057. doi: 10.3934/math.2023768 |
[5] | Jin Liao, André Zegeling, Wentao Huang . The uniqueness of limit cycles in a predator-prey system with Ivlev-type group defense. AIMS Mathematics, 2024, 9(12): 33610-33631. doi: 10.3934/math.20241604 |
[6] | Guilin Tang, Ning Li . Chaotic behavior and controlling chaos in a fast-slow plankton-fish model. AIMS Mathematics, 2024, 9(6): 14376-14404. doi: 10.3934/math.2024699 |
[7] | Weili Kong, Yuanfu Shao . The effects of fear and delay on a predator-prey model with Crowley-Martin functional response and stage structure for predator. AIMS Mathematics, 2023, 8(12): 29260-29289. doi: 10.3934/math.20231498 |
[8] | Nazmul Sk, Bapin Mondal, Abhijit Sarkar, Shyam Sundar Santra, Dumitru Baleanu, Mohamed Altanji . Chaos emergence and dissipation in a three-species food web model with intraguild predation and cooperative hunting. AIMS Mathematics, 2024, 9(1): 1023-1045. doi: 10.3934/math.2024051 |
[9] | Chenxuan Nie, Dan Jin, Ruizhi Yang . Hopf bifurcation analysis in a delayed diffusive predator-prey system with nonlocal competition and generalist predator. AIMS Mathematics, 2022, 7(7): 13344-13360. doi: 10.3934/math.2022737 |
[10] | Heping Jiang . Complex dynamics induced by harvesting rate and delay in a diffusive Leslie-Gower predator-prey model. AIMS Mathematics, 2023, 8(9): 20718-20730. doi: 10.3934/math.20231056 |
Energy operations and schedules are significantly impacted by load and energy forecasting systems. An effective system is a requirement for a sustainable and equitable environment. Additionally, a trustworthy forecasting management system enhances the resilience of power systems by cutting power and load-forecast flaws. However, due to the numerous inherent nonlinear properties of huge and diverse data, the classical statistical methodology cannot appropriately learn this non-linearity in data. Energy systems can appropriately evaluate data and regulate energy consumption because of advanced techniques. In comparison to machine learning, deep learning techniques have lately been used to predict energy consumption as well as to learn long-term dependencies. In this work, a fusion of novel multi-directional gated recurrent unit (MD-GRU) with convolutional neural network (CNN) using global average pooling (GAP) as hybridization is being proposed for load and energy forecasting. The spatial and temporal aspects, along with the high dimensionality of the data, are addressed by employing the capabilities of MD-GRU and CNN integration. The obtained results are compared to baseline algorithms including CNN, Long Short-Term Memory (LSTM), Bidirectional Long Short-Term Memory (Bi-LSTM), Gated Recurrent Unit (GRU), and Bidirectional Gated Recurrent Unit (Bi-GRU). The experimental findings indicate that the proposed approach surpasses conventional approaches in terms of accuracy, Mean Absolute Percentage Error (MAPE), and Root Mean Square Error (RSME).
Investigating the dynamic interaction and interplay between species is essential in mathematical ecology [1,2]. Modeling such systems and analyzing their dynamical behavior may give a prediction on the evolution of populations. Particularly, two-species predator-prey models have led to enthusiasm among many scholars [3,4,5]. The Gause type two-species predator-prey model is given by
dx(t)dt=rx(t)(1−x(t)K)−y(t)f(x(t)),dy(t)dt=−sy(t)+Yy(t)f(x(t)), | (1.1) |
where x(t) and y(t) denote the density of the prey and predator species at time t, respectively. Parameters r,K,s, and Y are positive constants, which denote the intrinsic reproduction rate of the prey, the carrying capacity for the prey species, the death rate of the predator species, and the growth yield constant for the conversion of prey to predator density, respectively [6,7].
The initial values are x(0)≥0,y(0)≥0 due to their biological meanings. In the absence of y(t) in the model (1.1), the prey increases according to the logistic growth ˙x(t)=rx(t)(1−x(t)K). The predator y(t) declined exponentially as ˙y(t)=−sy(t) and will eventually die in the long-term if the model lacks prey x(t).
The function f(x) represents the prey-dependent functional response, which is the Ivlev-type functional response [8,9], and takes the form
f(x)=α(1−e−βx), | (1.2) |
where α>0 is the consumption rate and β>0 is the physiological rate at which saturation is achieved. It is a monotone increasing function that saturates, that is, it has a finite positive limit α as x approaches infinity [1] (see Figure 1).
This type functional response is both monotonically increasing and uniformly bounded, which was classified to the Holling-Ⅱ functional response by Garvie [10,11]. Biologically, it was first proposed to describe the increase of the fish. Hence, our results are useful in designing fishing policies for the fishery industry. Other forms of functional responses can be seen in [12,13].
Considering the Ivlev-type trophic response (1.2) in system (1.1), it changes to
dx(t)dt=rx(t)(1−x(t)K)−αy(t)(1−e−βx(t)),dy(t)dt=−sy(t)+Yαy(t)(1−e−βx(t)). | (1.3) |
The dynamical behaviors of the model (1.3) have been investigated extensively. It has the only coexistence equilibrium (x∗,y∗) if
αY>s,1−e−Kβ<sαY, | (1.4) |
where
x∗=−1βln(1−sαY),y∗=rYsx∗(1−x∗K). |
After applying rescalings in x,y, and t, it can be assumed that K=α=Y=1. Under the assumption (1.4), if
β>−2s+(1−s)ln(1−s)s+(1−s)ln(1−s)ln(1−s), |
then there exists a unique stable limit cycle. Otherwise, it has no limit cycles. If (1.4) fails, then system (1.3) has no existence equilibrium. Therefore, no limit cycles of system (1.3) exist.
In 1925, to investigate fish population under harvesting, the predator-prey model with delay was proposed by Volterra. It is described by an integro-differential equation as
dx(t)dt=rx(t)[1−1K∫T−∞G(t−s)x(s)ds]. |
The above delayed equation is called an integro-differential equation, and such delays are called distributed delays. We can use the linear chain trick to convert systems into systems with discrete delay. Since then, delayed differential equations (DDEs) have been extensively used to model population dynamics [14], neural network [15,16], engineering, the life sciences, etc., including predator-prey interactions.
By [17], assume the growth rate of the predator species y(t) is proportional to the number of individuals in the population t−τ time units in the past that manage to survive until time t. In order to obtain an expression that describes how many predator individuals alive at time t−τ are still alive at time t, where τ is the delay due to the gestation of the y(t) [18], we need to solve the following first-order ordinary differential equation for y(t),
˙y(t)=−sy(t). |
It implies that
∫y(t)y(t−τ)1sy(t)dy=−∫tt−τdt, |
hence
y(t)=y(t−τ)e−sτ, | (1.5) |
where the factor e−sτ denotes the survival rate of the predator y(t) which was born at time t−τ and still remains alive at the time t. When the time delay τ=0, the right side of (1.5) reduces to its prototype y(t). The main difference between y(t−τ) and y(t−τ)e−sτ is shown in Figure 2.
When the time delay τ is small, they are close [19]. However, as the delay increases, the expression y(t−τ)e−sτ could describe practical problems better than the expression y(t−τ). Although the predator-prey interaction with y(t−τ) has been extensively investigated since its proposal, such systems with the delay term y(t−τ)e−sτ are scarce and are not frequently reported. Therefore, compared to existing studies on the predator-prey system [20,21,22], this is the main contribution and the novelty of this paper in the aspect of establishing the model.
Similarly, with the well-known Wangersky-Cunningham model, we assume that the change rate of predators depends on the number of prey and of predators present at τ previous time, that is, the delay τ in the interaction term y(t)(1−e−βx(t)) of the second equation. Therefore, we replace y(t) with the Eq (1.5) in model (1.3), and system (1.3) is reduced to
dx(t)dt=rx(t)(1−x(t)K)−αy(t)(1−e−βx(t)),dy(t)dt=−sy(t)+Yαy(t−τ)e−sτ(1−e−βx(t−τ)). | (1.6) |
System (1.6) has the initial data
x(η)=ϕ(η)≥0,y(η)=ψ(η)≥0,η∈[−τ,0],ϕ(0)>0,ψ(0)>0, | (1.7) |
where (ϕ(η),ψ(η))∈C([−τ,0],R2+0) is the Banach space of continuous functions mapping the interval [−τ,0] into R2+0, where R2+0={(x,y):x≥0,y≥0} [23]. By the fundamental theory of DDEs, system (1.6) has a unique solution x(t),y(t) satisfying initial data (1.7).
The main goal of this paper is to show how the delay τ affects the dynamics of model (1.6). This paper is organized as follows. In Section 2, we prove the positivity and boundedness for the solution of system (1.6). In Section 3, when time delay is accounted as a bifurcation parameter, the stability analysis is given for the coexistence equilibrium for model (1.6). We analytically prove that the local Hopf bifurcation critical values are neatly paired. In Section 4, numerical explorations using the numerical continuation software XPPAUT and DDE-Biftool are carried out in order to substantiate the obtained theoretical results. Simulations indicated that as the delay increases, the positive equilibrium loses its stability and bifurcates a family of orbitally asymptotically stable periodic solutions. The coexistence equilibrium undergoes stability switches. For large enough delay, the predator will die out. Before the extinction of the predator, rich dynamics such as Hopf bifurcation, period doubling bifurcation and strange attractor have been demonstrated when time delay is accounted as bifurcation parameter, and the abundance of steady-state chaotic solutions appears via a cascade of period-doubling bifurcations is also detected. The coexistence equilibrium undergos transcritical bifurcation at the die out critical value. We summarize our conclusions in Section 5, especially on the impact of time delay from the biological aspect.
For the system (1.6) with positive initial data (1.7), we first prove the following two theorems concerning the positivity and boundedness of the solution [24].
Theorem 2.1. Solutions of system (1.6) with positive initial data (1.7) remain positive for t>0.
Proof. Assume (x(t),y(t)) is a solution of system (1.6) satisfying initial data (1.7). By the Theorem 2.1 of [25], we solve the following ordinary differential equation (ODE):
dx(t)x(t)=[r(1−x(t)K)−α(1−e−βx(t))y(t)x(t)]dt. |
Integrating between the limit from 0 to t, the solution is
x(t)=ϕ(0)exp(∫t0[r(1−x(˜s)K)−α(1−e−βx(˜s))y(˜s)x(˜s)]d˜s). |
Obviously, the exponential function is always positive, regardless of the integrand. It implies that x(t) is positive for t>0 and ϕ(0)>0.
Next, we show that y(t) is positive on t∈[0,+∞). Based on the theory of Hale [26], it is obvious that y(t) is well-defined on [−τ,+∞) and
y(t)=φ(0)e−st+∫t0Yαφ(0)y(˜s−τ)e−s(t−˜s+τ)(1−e−βx(˜s−τ))d˜s. |
Since φ(0)>0 and initial data (1.7), we have y(t)>0 when t∈[0,τ], therefore y(t)>0 for t∈[0,+∞]. Positivity implies that the cone of the solutions is invariant in the system.
Theorem 2.2. Solutions of system (1.6) with positive initial data (1.7) are uniformly ultimately bounded.
Proof. Define the following function:
ω(t)=Ye−sτx(t)+y(t+τ). |
The derivative of ω(t) with respect to t is
˙ω(t)=Ye−sτ˙x(t)+˙y(t+τ). |
Substituting ˙x(t) and ˙y(t+τ) into the above expression, we obtain
˙ω(t)=Ye−sτ[rx(t)(1−x(t)K)−αy(t)(1−e−βx(t))]−sy(t+τ)+Yαy(t)e−sτ(1−e−βx(t))=Ye−sτrx(t)(1−x(t)K)−sy(t+τ)≤Ye−sτrx(t)−sy(t+τ)=2Ye−sτrx(t)−sy(t+τ)−Ye−sτrx(t)≤2Ye−sτr(x0+ε)−sy(t+τ)−Ye−sτrx(t)≤2Ye−sτr(x0+ε)−min{s,r}[y(t+τ)+Ye−sτx(t)]=2Ye−sτr(x0+ε)−min{s,r}ω(t), |
where x0 is the upper bound of x(t). By the Lemma 2.1 of [27,28], we obtain
ω(t)≤2Ye−sτr(x0+ε)min{s,r}, |
when t is sufficiently big. It implies that x(t) and y(t) are ultimately bounded. The boundedness of the model ensures that there is a restriction on the growth of the species due to limited resources in nature. This completes the proof.
To begin, we consider the possible equilibria of model (1.6).
Proposition 3.1. (i) System (1.6) has two distinct equilibria, the trivial equilibrium E0=(0,0) and the semi-trivial equilibrium ˉE=(K,0).
(ii) If
(H1)τ<τc=1slnαY(1−e−βK)s, | (3.1) |
holds, the τc is the critical value, then system (1.6) has a coexistence equilibrium E∗=(x∗,y∗), where
x∗=−1βln(1−sesταY),y∗=rYx∗sesτ(1−x∗K). |
The existence of E∗ ensures that 1−e−βK>0. Note that the equilibrium value depends on τ: x∗ is an increasing function with respect to the delay τ, while y∗ is a decreasing function when x∗>K2, that is: The larger the delay, the higher the number of the prey population, and the lower the number of predators at the equilibrium.
The characteristic equation corresponding to E0=(0,0) is
(λ−r)(λ+s−αYe−(λ+s)τ)=0, |
whose roots are obtained as λ1=r>0.
Lemma 3.1. For all τ≥0, the trivial equilibrium E0 is always unstable.
The characteristic equation with respect to ˉE=(K,0) is
(λ+r)[λ+s−αYe−(λ+s)τ(1−e−βK)]=0, |
implying that λ1=−r<0 and
λ+s−αYe−(λ+s)τ(1−e−βK)=0. |
Let
f(λ)=λ+s−αYe−(λ+s)τ(1−e−βK). |
Therefore,
f′(λ)=1+ταYe−(λ+s)τ(1−e−βK)>0,f(0)=s−αYe−sτ(1−e−βK),limλ→∞f(λ)=∞, |
for any τ≥0. Thus, if τ<τc, f(0)<0, and f(λ)=0 has at least one positive root. Thus, when τ<τc, the semi-trivial equilibrium is unstable.
Lemma 3.2. When τ<τc, ˉE is unstable.
In this part, assume that (3.1) is satisfied, then the interior (coexistence) equilibrium E∗ exists. The linearized system of (1.6) about E∗ is
˙X(t)=A0X(t)+A1X(t−τ), | (3.2) |
where X(t)=(x(t),y(t))T, X(t−τ)=(x(t−τ),y(t−τ))T, A0=[r(1−2x∗K)+αβy∗e−βx∗−α(1−e−βx∗)0−s], A1=[00αβYy∗e−sτ−βx∗αYe−sτ(1−e−βx∗)].
The linearization system (3.2) around E∗ has the following characteristic equation:
det[λI−A0−A1e−λτ]=0, |
that is,
λ2+p1(τ)λ+p2(τ)+e−(λ+s)τ[p3(τ)λ+p4(τ)]=0, | (3.3) |
where
p1(τ)=s−r(1−2x∗K)−αβy∗e−βx∗,p2(τ)=−s[r(1−2x∗K)+αβy∗e−βx∗],p3(τ)=αY(e−βx∗−1),p4(τ)=αY(1−e−βx∗)[r(1−2x∗K)+αβy∗(1+Y)e−βx∗]. | (3.4) |
Notice that if τ=0, Eq (3.3) reduces to the second-order polynomial equation
λ2+(p1(0)+p3(0))λ+p2(0)+p4(0)=0, | (3.5) |
and it follows that all eigenvalues of Eq (3.5) have negative real parts if, and only if,
p1(0)+p3(0)>0,p2(0)+p4(0)>0. | (3.6) |
The transcendental Eq (3.3) has infinitely many roots. Note that polynomials pi(τ)(i=1,2,3,4) are dependent on τ. The transcendental equation associated with (3.2) at E∗ is
D(λ):=P(λ,τ)+Q(λ,τ)e−λτ=0, | (3.7) |
where
P(λ,τ)=λ2+p1(τ)λ+p2(τ),Q(λ,τ)=e−sτ[p3(τ)λ+p4(τ)]. |
For the characteristic equation, before applying the criterion due to Beretta and Kuang [29] to evaluate the existence of a purely imaginary root, we first verify the following properties for τ∈[0,τc), where τc is the maximum value when E∗ exists.
(i)P(0,τ)+Q(0,τ)≠0;
(ii)P(iω,τ)+Q(iω,τ)≠0,∀ω∈R;
(iii)lim|λ|→∞sup{|Q(λ,τ)P(λ,τ)|;Reλ≥0}<1;
(iv)F(ω,τ):=|P(iω,τ)|2−|Q(iω,τ)|2 has a finite number of zeros;
(v) Each positive root ω(τ) of F(ω,τ)=0 is continuous and differentiable in τ whenever it exists [18].
Obviously,
P(0,τ)+Q(0,τ)=p2(τ)+e−sτp4(τ)≠0,∀τ∈[0,τc), |
(ⅰ) is satisfied. Assumption ensures that λ=0 is not the root of Eq (3.7).
Assume that p2(τ)+e−sτp4(τ)≠ω2,p1(τ)+e−sτp3(τ)≠0, then
P(iω,τ)+Q(iω,τ)≠0,∀ω∈R. |
It follows from (3.7) that
lim|λ|→∞|Q(λ,τ)P(λ,τ)|=lim|λ|→∞|e−sτ[p3(τ)λ+p4(τ)]λ2+p1(τ)λ+p2(τ)|=0, |
hence (ⅲ) follows.
For the function F defined in (ⅳ), which follows
|P(iω,τ)|2=ω4+[p21(τ)−2p2(τ)]ω2+p22(τ), |
and
|Q(iω,τ)|2=e−2sτ(p3(τ)2ω2+p4(τ)2), |
such that
F(ω,τ)=ω4+a1(τ)ω2+a2(τ), |
where
a1(τ)=p21(τ)−2p2(τ)−e−2sτp23(τ),a2(τ)=p22(τ)−e−2sτp24(τ). |
F(ω,τ) has at most four roots, therefore assumption (iv) is satisfied. Assume that (ω0,τ0) is a point in its domain such that F(ω0,τ0)=0. In a certain neighborhood of (ω0,τ0), the partial derivatives Fω and Fτ exist and are continuous, and Fω(ω0,τ0)≠0. Assumption (ⅴ) is satisfied by the implicit function theorem. Assumption (ⅳ) guarantees that Eq (3.7) has at most a finite number of purely imaginary roots [18], i.e., the roots cross the imaginary axis a finite number of times as τ varies.
Next, we assume that λ=iω(ω>0,i=√−1) is the pure imaginary root of expression (3.7), then λ=iω satisfies
|P(iω,τ)|2=|Q(iω,τ)|2, |
i.e., because |e−iωτ|=1, ω(τ) is the positive zero root of
F(ω,τ):=|P(iω,τ)|2−|Q(iω,τ)|2=0. |
Define the set
I={τ|τ≥0,F(ω,τ)=0has positive zero points}. |
Therefore,
F(ω,τ)=0, | (3.8) |
has positive root ω=ω(τ) if τ∈I. Otherwise, F(ω,τ)=0 does't have a positive zero point. Furthermore, we obtain
sin(ωτ)=Im(P(iω,τ)Q(iω,τ))=ωesτ[p3(τ)(ω2−p2(τ))−p1(τ)p4(τ)]ω2p32(τ)+p24(τ),cos(ωτ)=−Re(P(iω,τ)Q(iω,τ))=esτ[ω2p1(τ)p3(τ)+p4(τ)(p2(τ)−ω2)]ω2p32(τ)+p24(τ). | (3.9) |
In addition, define the function θ(τ)∈[0,2π], which satisfied (3.9) for τ∈I, i.e.,
sin(θ(τ))=ωesτ[p3(τ)(ω2−p2(τ))−p1(τ)p4(τ)]ω2p32(τ)+p24(τ),cos(θ(τ))=esτ[ω2p1(τ)p3(τ)+p4(τ)(p2(τ)−ω2)]ω2p32(τ)+p24(τ). | (3.10) |
The ω(τ)τ in (3.9) and θ(τ) in (3.10) have the following relationship:
ω(τ)τ=θ(τ)+2nτ,n∈N0. |
Introduce map τn:I→R+0:
τn(τ)=θ(τ)+2nτω(τ),n∈N0,τ∈I, |
where ω(τ) is the positive root of (3.8). From I to R, define the continuous and differential function Sn(τ) as
Sn(τ):=τ−τn(τ),n∈N0,τ∈I. | (3.11) |
Let λ(τ) be the eigenvalues satisfied by λ(τ∗)=iω(τ∗), and the transversality condition is obtained as
δ(τ∗):=sign{dReλ(τ)dτ|λ(τ∗)=iω(τ∗),τ=τ∗}=sign{∂F∂ω(ω(τ∗),τ∗)}×sign{dSn(τ)dτ|λ(τ∗)=iω(τ∗),τ=τ∗}. |
Theorem 3.1. (i) For model (1.6), if either the set I is empty or the function Sn(τ) has no positive zero in I, for 0<τ<τc, the positive equilibrium E∗ is asymptotically stable.
(ii) If Eq (3.11) has positive roots in I denoted by {τ1,τ2,⋯,τm} with τj<τj+1 and S′n(τ1)>0, the positive equilibrium E∗ is asymptotically stable for τ∈[0,τ1)∪(τm,τc) and unstable for τ∈(τ1,τm), with Hopf bifurcations occurring when τ=τj,j=1,2,⋯,m.
To illustrate the analytical local Hopf Bifurcation results, we shall present some numerical simulations in this section and will extend them further with the help of numerical bifurcation analysis. The graphs are mainly drawn using DDEBifTool [30,31]. Similar dynamics have been numerically detected in the discrete delay system with Holling type Ⅱ and Beddington-DeAngelis trophic response [19].
Hereafter, parameters are fixed at the following values,
r=1,K=1,α=5,s=0.02,Y=0.6 and β=0.1. | (4.1) |
According to the biological meaning of the parameters, because r is relatively large, it indicates that the prey has a high breeding rate. The s is relatively small which indicates that the predator has a low death rate. In addition, r is smaller than α to some extent, and it indicates that the changes in the number of prey are less influenced by their own birth rate and more influenced by their ability to evade natural enemies to prevent predation. Yα is larger than s, and it indicates that the changes of the number of predators are more influenced by their ability to prey on food.
Under (4.1), we consider
dx(t)dt=x(t)(1−x(t))−5y(t)(1−e−0.1x(t)),dy(t)dt=−0.02y(t)+3y(t−τ)e−0.02τ(1−e−0.1x(t−τ)),(ϕ(0),φ(0))=(0.1,0.1). | (4.2) |
The ϕ(0) is initial prey population, and it represents the number of prey at the start of the model (4.2). This value can affect the food supply available to predators. If the initial number of prey is low, predators may face a food shortage. In contrary, if the initial number of prey is high, predators may have an abundant food supply. Furthermore, the φ(0) is initial predator population, and it represents the number of predators at the start. This value can influence the initial pressure that predators exert on prey. If the initial number of predators is low, the pressure on prey may be relatively small; conversely, if the initial number of predators is high, the pressure on prey may be greater. The ϕ(0) and φ(0) are chosen as 0.1 here, and they are at the median level relatively. The growth and mortality parameters represent the biological characteristics of predators and prey, such as growth rates and mortality rates. These parameters can influence the population dynamics of predators and prey, thereby affecting the stability of the ecosystem.
System (4.2) has three equilibria: E0=(0,0), ˉE=(1,0), and the coexistence equilibrium E∗=(x∗,y∗) exists when τ<τc=250.
Consider Figures 3 and 4: The blue solid line (the red dotted line) represents stable equilibrium (unstable equilibrium) and the filled green circle (open blue circles) indicates stable periodic orbit (unstable periodic orbits).
Figure 3 indicates that the E0=(0,0) is unstable. When τ∈[0,τ3), ˉE=(1,0) is unstable. When τ>τ3, it is locally asymptotically stable, i.e., at τ=τ3 the predator goes extinct. The coexistence equilibrium E∗ is stable when τ∈[0,τ1)∪(τ2,τ3) while it's unstable when τ∈(τ1,τ2)∪(τ3,τc). At τ=τ3, the semi-trivial equilibrium ˉE=(1,0) and positive equilibrium E∗ exchange their stability, leading to the appearance of transcritical bifurcation. Note that τ1=4.4730, τ2=69.3061, and τ3=132.9233.
We produced a corresponding bifurcation diagram as Figure 4, using τ as the primary bifurcation parameter. Figure 4 shows the first critical value τ1 with ω1=0.1215, which the bifurcated Hopf bifurcation and the second critical value is τ2 with ω2=0.0289, generating the supercritical Hopf bifurcation at τ1 and τ2. Biologically, above phenomenon could be interpreted as there being an interval (τ1, τ2) of survival that may exist even though the positive equilibrium is unstable.
Figures 5–8 show the trajectories and phase graph of system (4.2) with τ=4.3, τ=4.5, τ=50, and τ=70.5, respectively. Figure 5 illustrates that the coexistence equilibrium E∗=(0.0669,1.8724) is locally asymptotically with τ=4.3<τ1. It will lose its stability and a bifurcating periodic solution occurs once τ=4.5>τ1 as the time delay increases, as shown in Figure 6. Figure 7 indicates that a stable periodic solution occurs with τ=50. Additionally, Figure 8 shows that the coexistence equilibrium E∗ is locally asymptotically stable with τ=70.5>τ2. The results are coincident with Figures 3 and 4.
The above simulations indicate that there exists a unique global Hopf bifurcation connecting τ1 and τ2. The global Hopf bifurcation is bounded, and each global Hopf branch connects a pair of Hopf bifurcation values. In the next subsection, we will detect the global Hopf bifurcation [32].
By the global Hopf bifurcation result of [33,34], it shows that for the following delayed Lotka-Volterra model,
˙x(t)=x(t)[r1−a11x(t−τ)−a12y(t)],˙y(t)=y(t)[−r2+a21x(t)−a22y(t)]. |
After the second critical value, the local Hopf bifurcation implies a global Hopf bifurcation. However, for the delayed model (1.6), it is not valid. We will show that as follows.
Parameters are fixed at the following values,
r=3.1,K=0.5,α=1.5,s=0.02,Y=0.4 and β=1.2. | (4.3) |
According to the biological meaning of the parameters, because r is relatively large, it indicates that the prey has a high breeding rate. The s is relatively small, which indicates that the predator has a low death rate. Because r is larger than α, to some extent, and it indicates that the changes in the number of prey are more influenced by their own birth rate. In addition, Yα is larger than s, and it indicates that the changes in the number of predator are more influenced by their ability to prey on food [35].
Under (4.3), we consider the following model:
dx(t)dt=3.1x(t)(1−2x(t))−1.5y(t)(1−e−1.2x(t)),dy(t)dt=−0.02y(t)+0.6y(t−τ)e−0.02τ(1−e−1.2x(t−τ)),(ϕ(0),φ(0))=(0.1,0.1). | (4.4) |
Consider Figures 9 and 10, where the open blue circles stand for unstable periodic orbits. Figure 9 indicates that the E0=(0,0) is always unstable. The ˉE=(1,0) is unstable when τ∈[0,τ3). When τ>τ3, it is locally asymptotically stable where τ3=130.2649. In τ∈[0,τ1)∪(τ2,τ3), the positive equilibrium E∗ is stable, and unstable when τ∈(τ1,τ2)∪(τ3,τc) where τ1=2.6330 and τ2=79.8515. By Figure 10, the unstable periodic orbits appear between τ4 and τ5, where τ4=67.2228 and τ5=70.4188. Biologically, since the appearance of unstable bifurcating periodic solutions, the two species could coexist in a chaotic mode.
To see the influence of delay τ on the dynamical behaviors of the model, we detect the complex dynamical behavior when τ∈(τ4,τ5) by Figures 11–14. By Figure 11, for the system (4.4), when τ=65.9, the system has a limit cycle whose period is approximately 250. The periodic orbits are always stable until τ<66.6. When τ>66.6, stable periodic solutions undergo period-doubling bifurcation; as Figure 12 shows, when τ=66.6, the system bifurcates twice the period. When τ=69.5, the system bifurcates with a sequence of period-doubling bifurcations. When τ continues to increase from 65.9 to 70, by Figure 14, the system (4.4) achieves chaotic oscillation through period-doubling bifurcation with a chaotic attractor. In a stable equilibrium, the periodic oscillation by 2, 22, 23⋯ cycles eventually lead to chaos. Eventually, a cascade of period doubling bifurcations leads to chaos, which resembles the chaotic attractor of the following Mackey-Glass equation [36]
dxdt=βx(t−τ)1+(x(t−τ))n−γx(t). |
The existence of chaotic solutions implies that even a small environmental or parameter perturbation can disrupt the dynamics of the system [37,38]. In current research on the existence of chaos, only the phase diagram or the time course diagram of the system is generally provided, with few discussions on the chaotic path. In fact, the chaotic path can clearly illustrate the dynamic transition process of the system under the influence of parameters. Therefore, compared with existing results on the dynamical behaviors of predator-prey systems [21,39,40], the detection of chaos and the analysis of the chaotic path are the main contributions of this paper in terms of dynamical behaviors.
Remark 4.1. Since chaos is sensitive to initial conditions, the strange attractor is not obvious under the parameter values as specified in (4.3), which results in the critical values τ4−τ6 in Figure 10 being not accurate enough. Furthermore, the interval from τ4 to τ6 is not long enough, and we did not detect the dynamical behaviors in detail within this interval. We hypothesize that within this interval, as the delay τ increases from 70 to τ6, the system (4.4) undergoes four cycle bifurcations, doubling the period twice, leading to a period doubling bifurcation and a limit cycle. The dynamic behavior of the system does not change substantially.
In this paper, a delayed prey-predator model with an Ivlev-type functional response is investigated, focusing on the effect of the delay on the dynamical behaviors of the model. The supercritical Hopf bifurcation and period doubling types of bifurcations, as well as a strange attractor, can occur at the positive equilibrium when time delay is considered as a bifurcation parameter. The chaotic attractor appears, followed by a sequence of period-doubling bifurcations for small enough of the death rate of the predator species. This study delves into the intricate interplay where time delays and nonlinear responses converge, offering a deeper insight into the chaotic behaviors that may arise within these complex systems.
From a biological perspective, there are intriguing explanations. If delay is minimal, predator and prey populations stabilize. However, as delay escalates, species exhibit asymptotic, periodic, or quasi-periodic fluctuations, suggesting an oscillatory coexistence of predator and prey. As the time delay continues to increase, the system will exhibit a chaotic phenomenon of 'lose a millimeter, miss a thousand miles'. Consequently, short-term observations can be deceptive in forecasting due to the presence of bifurcation and chaos, highlighting the complexity of long-term ecological dynamics. The results could be very essential for biologists who work with delayed prey-predator systems. In conclusion, this paper makes two contributions: the introduction of an exponential delay term and the detection of chaos.
In reality, the processing time delay rarely has the same length at every instance; instead, it follows a distribution with some mean value. Our follow-up work will investigate the dynamical behaviors of the model incorporating distributed delay and compare the dynamics resulting from using various distributions, including discrete delay.
Qinghui Liu: The data analysis and wrote the paper; Xin Zhang: The formal analysis and the validation. All authors have read and approved the final version of the manuscript for publication.
The authors declare they have not used Artificial Intelligence (AI) tools in the creation of this article.
This work was supported by the Basic Science (Natural Science) Research Project of Jiangsu Province (No. 24KJB110010), the Special Reform and Development Project of Nanjing University of Finance and Economics in 2023 (No. XGFB3202311), Teaching Reform Project of Nanjing University of Finance and Economics in 2023 (No. JG23902).
All authors declare no conflicts of interest in this paper.
[1] |
Y. Lu, G. Wang, A load forecasting model based on support vector regression with whale optimization algorithm, Multimed Tools Appl., 82 (2023), 9939–9959. https://doi.org/10.1007/s11042-022-13462-2 doi: 10.1007/s11042-022-13462-2
![]() |
[2] |
H. Habbak, M. Mahmoud, K. Metwally, M. M. Fouda, M. I. Ibrahem, Load forecasting techniques and their applications in smart grids, Energies, 16 (2023), 1480. https://doi.org/10.3390/en16031480 doi: 10.3390/en16031480
![]() |
[3] |
L. Zhang, J. Wen, Y. Li, J. Chen, Y. Ye, Y. Fu, et al., A review of machine learning in building load prediction, Appl. Energy, 285 (2021), 116452. https://doi.org/10.1016/j.apenergy.2021.116452 doi: 10.1016/j.apenergy.2021.116452
![]() |
[4] |
M. Zulfiqar, M. Kamran, M. B. Rasheed, T. Alquthami, A. H. Milyani, A short-term load forecasting model based on self-adaptive momentum factor and wavelet neural network in smart grid, IEEE Access, 10 (2022), 77587–77602. https://doi.org/10.1109/ACCESS.2022.3192433 doi: 10.1109/ACCESS.2022.3192433
![]() |
[5] |
R. Liu, T. Chen, G. Sun, S. M. Muyeen, S. Lin, Y. Mi, Short-term probabilistic building load forecasting based on feature integrated artificial intelligent approach, Electr. Pow. Syst. Res., 206 (2022), 107802. https://doi.org/10.1016/j.epsr.2022.107802 doi: 10.1016/j.epsr.2022.107802
![]() |
[6] |
I. Yazici, O. F Beyca, D. Delen, Deep-learning-based short-term electricity load forecasting: A real case application, Eng. Appl. Artif. Intell., 109 (2022), 104645. https://doi.org/10.1016/j.engappai.2021.104645 doi: 10.1016/j.engappai.2021.104645
![]() |
[7] |
A. Goia, C. May, G. Fusai, Functional clustering and linear regression for peak load forecasting, Int. J. Forecast, 26 (2010), 700–711. https://doi.org/10.1016/j.ijforecast.2009.05.015 doi: 10.1016/j.ijforecast.2009.05.015
![]() |
[8] |
A. H. Nury, K. Hasan, A. M. J. Bin, Comparative study of wavelet-ARIMA and wavelet-ANN models for temperature time series data in northeastern Bangladesh, J. King, Saud. Univ. Sci., 29 (2017), 47–61. https://doi.org/10.1016/j.jksus.2015.12.002 doi: 10.1016/j.jksus.2015.12.002
![]() |
[9] |
G. Y. Chen, M. Gan, G. L. Chen, Generalized exponential autoregressive models for nonlinear time series: Stationarity, estimation and applications, Inf. Sci., 438 (2018), 46–57. https://doi.org/10.1016/j.ins.2018.01.029 doi: 10.1016/j.ins.2018.01.029
![]() |
[10] |
S. Deng, F. Chen, X. Dong, G. Gao, X. Wu, Short-term load forecasting by using improved GEP and abnormal load recognition, ACM Trans. Inter. Technol., 21 (2021), 1–28. https://doi.org/10.1145/3447513 doi: 10.1145/3447513
![]() |
[11] |
J. Lee, Y. Cho, National-scale electricity peak load forecasting: Traditional, machine learning, or hybrid model? Energy, 239 (2022), 122366. https://doi.org/10.1016/j.energy.2021.122366 doi: 10.1016/j.energy.2021.122366
![]() |
[12] |
T. Alquthami, M. Zulfiqar, M. Kamran, A. H. Milyani, M. B. Rasheed, A performance comparison of machine learning algorithms for load forecasting in smart grid, IEEE Access, 10 (2022), 48419–48433. https://doi.org/10.1109/ACCESS.2022.3171270 doi: 10.1109/ACCESS.2022.3171270
![]() |
[13] |
Z. Li, J. Wang, J. Huang, M. Ding, Development and research of triangle-filter convolution neural network for fuel reloading optimization of block-type HTGRs, Appl. Soft Comput., 136 (2023), 110126. https://doi.org/10.1016/j.asoc.2023.110126 doi: 10.1016/j.asoc.2023.110126
![]() |
[14] |
S. Deng, F. Chen, D. Wu, Y. He, H. Ge, Y. Ge, Quantitative combination load forecasting model based on forecasting error optimization, Comput. Elec Engin, 101 (2022), 108125. https://doi.org/10.1016/j.compeleceng.2022.108125 doi: 10.1016/j.compeleceng.2022.108125
![]() |
[15] |
S. Sun, Y. Liu, Q. Li, T. Wang, F. Chu, Short-term multi-step wind power forecasting based on spatio-temporal correlations and transformer neural networks, Energy Convers. Manage., 283 (2023), 116916. https://doi.org/10.1016/j.enconman.2023.116916 doi: 10.1016/j.enconman.2023.116916
![]() |
[16] | Z. Xiao, S. J. Ye, B. Zhong, C. X. Sun, Short term load forecasting using neural network with rough set, Conference: Advances in Neural Networks-ISNN 2006, Third International Symposium on Neural Networks, Chengdu, China, May 28-June 1, 2006, Proceedings, Part Ⅱ. https://doi.org/10.1007/11760023_183 |
[17] | C. X. Li, D. X. Niu, L. M. Meng, Rough set combine BP neural network in next day load curve forcasting, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 5264 LNCS: 2008, 1–10. https://doi.org/10.1007/978-3-540-87734-9_1 |
[18] |
Z. Xiao, S. J. Ye, B. Zhong, C. X. Sun, BP neural network with rough set for short term load forecasting, Expert Syst. Appl., 36 (2009), 273–279. https://doi.org/10.1016/j.eswa.2007.09.031 doi: 10.1016/j.eswa.2007.09.031
![]() |
[19] |
D. Yi, S. Bu, I. Kim, An Enhanced Algorithm of RNN Using Trend in Time-Series, Symmetry, 11 (2019), 912. https://doi.org/10.3390/sym11070912 doi: 10.3390/sym11070912
![]() |
[20] |
V. Kusuma, A. Privadi, A. L. S. Budi, V. L. B. Putri, Photovoltaic Power Forecasting Using Recurrent Neural Network Based on Bayesian Regularization Algorithm. ICPEA 2021-2021 IEEE International Conference in Power Engineering Application, (2021), 109–114. https://doi.org/10.1109/ICPEA51500.2021.9417833 doi: 10.1109/ICPEA51500.2021.9417833
![]() |
[21] |
G. Li, H. Wang, S. Zhang, J. Xin, H. Liu, Recurrent neural networks based photovoltaic power forecasting approach, Energies, 12 (2019), 2538. https://doi.org/10.3390/en12132538 doi: 10.3390/en12132538
![]() |
[22] |
A. Buonanno, M. Caliano, A. Pontecorvo, G. Sforza, M. Valenti, G. Graditi, Global vs. local models for short‐term electricity demand prediction in a Residential/Lodging scenario, Energies, 15 (2022), 2037. https://doi.org/10.3390/en15062037 doi: 10.3390/en15062037
![]() |
[23] |
R. Quan, Z. Li, P. Liu, Y. Li, Y. Chang, H. Yan, Minimum hydrogen consumption-based energy management strategy for hybrid fuel cell unmanned aerial vehicles using direction prediction optimal foraging algorithm, Fuel Cells, 23 (2023), 221–236. https://doi.org/10.1002/fuce.202200121 doi: 10.1002/fuce.202200121
![]() |
[24] |
S. Hochreiter, J. Schmidhuber, Long short-term memory, Neural Comput., 9 (1997), 1735–1780. https://doi.org/10.1162/neco.1997.9.8.1735 doi: 10.1162/neco.1997.9.8.1735
![]() |
[25] | J. Chung, C. Gulcehre, K. H. Cho, Y. Bengio, Empirical evaluation of gated recurrent neural networks on sequence modeling, NIPS 2014 Deep Learning and Representation Learning Workshop, 2014. https://doi.org/10.48550/arXiv.1412.3555 |
[26] |
A. K. Tyagi, N. Sreenath, Cyber physical systems: Analyses, challenges and possible solutions, Int. Thing. Cyber-Physical Syst., 1 (2021), 22–33. https://doi.org/10.1016/j.iotcps.2021.12.002 doi: 10.1016/j.iotcps.2021.12.002
![]() |
[27] |
J. Moon, S. Park, S. Rho, E. Hwang, A comparative analysis of artificial neural network architectures for building energy consumption forecasting, Int. J. Distrib. Sens. N., 15 (2019). https://doi.org/10.1177/1550147719877616 doi: 10.1177/1550147719877616
![]() |
[28] |
T. Walser, A. Sauer, Typical load profile-supported convolutional neural network for short-term load forecasting in the industrial sector, Energy AI., 5 (2021), 100104. https://doi.org/10.1016/j.egyai.2021.100104 doi: 10.1016/j.egyai.2021.100104
![]() |
[29] | X. Ke, L. Shi, W. Guo, D. Chen, Multi-Dimensional traffic congestion detection based on fusion of visual features and convolutional neural network, IEEE T. Intell. Transp., 20 (2019), 2157–2170. http://www.ieee.org/publications_standards/publications/rights/index.html |
[30] |
P. H. Kuo, C. J. Huang, A high precision artificial neural networks model for short-term energy load forecasting, Energies, 11 (2018) 213. https://doi.org/10.3390/en11010213 doi: 10.3390/en11010213
![]() |
[31] |
J. Walther, D. Spanier, N. Panten, E. Abele, Very short-term load forecasting on factory level—A machine learning approach, Procedia CIRP, 80 (2019), 705–710. https://doi.org/10.1016/j.procir.2019.01.060 doi: 10.1016/j.procir.2019.01.060
![]() |
[32] |
T. Hong, J. Wilson, J. Xie, Long term probabilistic load forecasting and normalization with hourly information, IEEE T. Smart Grid, 5 (2014), 456–462. https://doi.org/10.1109/TSG.2013.2274373 doi: 10.1109/TSG.2013.2274373
![]() |
[33] |
B. M. Hodge, D. Lew, M. Milligan, Short-term load forecast error distributions and implications for renewable integration studies, IEEE Green Technologies Conference, (2013), 435–442. https://doi.org/10.1109/GreenTech.2013.73 doi: 10.1109/GreenTech.2013.73
![]() |
[34] | H. M. Al-Hamadi, S. A. Soliman, Long-term/mid-term electric load forecasting based on short-term correlation and annual growth, Electr. Pow. Syst. Res., 74 (2005), 353–361. |
[35] |
X. Sun, Z. Ouyang, D. Yue, Short-term load forecasting model based on multi-label and BPNN. Comm. Comp. Infor. Sci., 761 (2017), 263–272. https://doi.org/10.1007/978-981-10-6370-1_26 doi: 10.1007/978-981-10-6370-1_26
![]() |
[36] |
W. Tang, F. He, Y. Liu, YDTR: Infrared and visible image fusion via Y-shape dynamic transformer, IEEE T. Multimedia, (2022), 1–16. https://doi.org/10.1109/TMM.2022.3192661 doi: 10.1109/TMM.2022.3192661
![]() |
[37] |
A. A. Peñaloza, R. C. Leborgne, A. Balbinot, Comparative analysis of residential load forecasting with different levels of aggregation, Eng. Proc, 18 (2022), 29. https://doi.org/10.3390/engproc2022018029 doi: 10.3390/engproc2022018029
![]() |
[38] |
T. Bashir, C. Haoyong, M. F. Tahir, Z. Liqiang, Short term electricity load forecasting using hybrid prophet-LSTM model optimized by BPNN, Energy Rep., 8 (2022), 1678–1686. https://doi.org/10.1016/j.egyr.2021.12.067 doi: 10.1016/j.egyr.2021.12.067
![]() |
[39] |
Y. Song, F. He, Y. Duan, Y. Liang, X. Yan, A kernel correlation-based approach to adaptively acquire local features for learning 3D point clouds, Comput. Aided Design, 146 (2022), 103196. https://doi.org/10.1016/j.cad.2022.103196 doi: 10.1016/j.cad.2022.103196
![]() |
[40] |
A. H. Nury, K. Hasan, M. J. B. Alam, Comparative study of wavelet-ARIMA and wavelet-ANN models for temperature time series data in northeastern Bangladesh, J. King Saud. Univ. Sci., 29 (2017), 47–61. https://doi.org/10.1016/j.jksus.2015.12.002 doi: 10.1016/j.jksus.2015.12.002
![]() |
[41] |
C. M. Lee, C. N. Ko, Short-term load forecasting using lifting scheme and ARIMA models, Expert Syst. Appl., 38 (2011), 5902–5911. https://doi.org/10.1016/j.eswa.2010.11.033 doi: 10.1016/j.eswa.2010.11.033
![]() |
[42] |
A. Baliyan, K. Gaurav, S. K. Mishra, A Review of short term load forecasting using artificial neural network models, Procedia Comput. Sci., 48 (2015), 121–125. https://doi.org/10.1016/j.procs.2015.04.160 doi: 10.1016/j.procs.2015.04.160
![]() |
[43] |
J. P. Liu, C. L. Li, The short-term power load forecasting based on sperm whale algorithm and wavelet least square support vector machine with DWT-IR for feature selection, Sustainability, 9 (2017), 1188. https://doi.org/10.3390/su9071188 doi: 10.3390/su9071188
![]() |
[44] |
A. Jadidi, R. Menezes, N. D. Souza, A. C. D. C. Lima, Energies, E. Sciubba, Short-term electric power demand forecasting using NSGA Ⅱ-ANFIS model, Energies, 12 (2019), 1891. https://doi.org/10.3390/en12101891 doi: 10.3390/en12101891
![]() |
[45] |
J. Zhang, F. He, Y. Duan, Y. Duan, S. Yang, AIDEDNet: Anti-interference and detail enhancement dehazing network for real-world scenes, Front Comput. Sci., 17 (2023), 1–11. https://doi.org/10.1007/s11704-022-1523-9 doi: 10.1007/s11704-022-1523-9
![]() |
[46] |
S. Zhang, F. He, DRCDN: learning deep residual convolutional dehazing networks, Visual Comput., 36 (2020), 1797–1808. https://doi.org/10.1007/s00371-019-01774-8 doi: 10.1007/s00371-019-01774-8
![]() |
[47] |
D. Niu, Y. Wang, D. D. Wu, Power load forecasting using support vector machine and ant colony optimization, Expert Syst. Appl., 37 (2010), 2531–2539. https://doi.org/10.1016/j.eswa.2009.08.019 doi: 10.1016/j.eswa.2009.08.019
![]() |
[48] |
H. H. Çevik, M. Çunkaş, Short-term load forecasting using fuzzy logic and ANFIS, Neural Comput. Appl., 26 (2015), 1355–1367. https://doi.org/10.1007/s00521-014-1809-4 doi: 10.1007/s00521-014-1809-4
![]() |
[49] |
G. Li, H. Wang, S. Zhang, J. Xin, H. Liu, Recurrent neural networks based photovoltaic power forecasting approach, Energies, 12 (2019), 2538. https://doi.org/10.3390/en12132538 doi: 10.3390/en12132538
![]() |
[50] |
X. Xiong, P. Zhou, C. Ailian, Asymptotic normality of the local linear estimation of the conditional density for functional time-series data, Commum, Statis. Theory Meth., 47 (2017), 3418–3440. https://doi.org/10.1080/03610926.2017.1359292 doi: 10.1080/03610926.2017.1359292
![]() |
[51] | Deep Learning, Available from: https://mitpress.mit.edu/9780262035613/deep-learning/. |
[52] |
N. Ahmad, Y. Ghadi, M. Adnan, M. Ali, Load forecasting techniques for power system: Research challenges and survey, IEEE Access, 10 (2022), 71054–71090. https://doi.org/10.1109/ACCESS.2022.3187839 doi: 10.1109/ACCESS.2022.3187839
![]() |
[53] |
A. S. Santra, J. L. Lin, Integrating long short-term memory and genetic algorithm for short-term load forecasting, Energies, 12 (2019), 2040. https://doi.org/10.3390/en12112040 doi: 10.3390/en12112040
![]() |
[54] |
W. Li, T. Logenthiran, W. L Woo, Multi-GRU prediction system for electricity generation's planning and operation, IET Gener. Transm. Dis., 13 (2019), 1630–1637. https://doi.org/10.1049/iet-gtd.2018.6081 doi: 10.1049/iet-gtd.2018.6081
![]() |
[55] |
X. Gao, X. Li, B. Zhao, W. Ji, X. Jing, Y. He, Short-term electricity load forecasting model based on EMD-GRU with feature selection, Energies, 12 (2019), 1140. https://doi.org/10.3390/en12061140 doi: 10.3390/en12061140
![]() |
[56] | T. Mikolov, M. Karafiát, L. Burget, J. H. Cernocky, S. Khudanpur, Recurrent neural network based language model, Conference: INTERSPEECH 2010, 11th Annual Conference of the International Speech Communication Association, Makuhari, Chiba, Japan, September 26–30, 2010 |
[57] |
H. Salehinejad, S. Sankar, J. Barfett, E. Colak, S. Valaee, Recent advances in recurrent neural networks, Neural Evolu. Comput., (2018), 1–21. https://doi.org/10.48550/arXiv.1801.01078 doi: 10.48550/arXiv.1801.01078
![]() |
[58] |
M. Schuster, K. K. Paliwal, Bidirectional recurrent neural networks, IEEE T. Signal Proces., 45 (1997), 2673–2681. https://doi.org/10.1109/78.650093 doi: 10.1109/78.650093
![]() |
[59] | T. Mikolov, S. Kombrink, L. Burget, J. Černocký, S. Khudanpur, Extensions of recurrent neural network language model, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Prague, Czech Republic, (2011), 5528–5531. https://doi.org/10.1109/ICASSP.2011.5947611 |
[60] |
A. G. Ororbia, T. Mikolov, D. Reitter, Learning simpler language models with the differential state framework, Neural Comput., 29 (2017), 3327–3352. https://doi.org/10.1162/neco_a_01017 doi: 10.1162/neco_a_01017
![]() |
[61] |
S. Hochreiter, The vanishing gradient problem during learning recurrent neural nets and problem solutions, Int. J. Uncertain Fuzz., 6 (1998), 107–116. https://doi.org/10.1142/S0218488598000094 doi: 10.1142/S0218488598000094
![]() |
[62] | B. Y. Lin, F. F. Xu, Z. Luo, K. Zhu, Multi-channel BiLSTM-CRF model for emerging named entity recognition in social media, Proceedings of the 3rd Workshop on Noisy User-generated Text, Stroudsburg, PA, USA, Association for Computational Linguistics, (2018), 160–165. https://doi.org/10.18653/v1/W17-4421 |
[63] | C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, et al., Going deeper with convolutions, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA, (2015), 1–9. https://doi.org/10.1109/CVPR.2015.7298594 |
[64] |
K. He, J. Sun, Convolutional neural networks at constrained time cost, Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, (2015), 5353–5360. https://doi.org/10.48550/arXiv.1412.1710 doi: 10.48550/arXiv.1412.1710
![]() |
[65] |
F. Abid, M. Alam, M. Yasir, C. Li, Sentiment analysis through recurrent variants latterly on convolutional neural network of Twitter, Future Generation Computer Systems, 95 (2019), 292–308. https://doi.org/10.1016/j.future.2018.12.018 doi: 10.1016/j.future.2018.12.018
![]() |
[66] | S. Wang, J. Jiang, Learning natural language inference with LSTM, 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL HLT 2016-Proceedings of the Conference, (2016), 1442–1451. https://doi.org/10.18653/v1/N16-1170 |
[67] |
N. F. F. da Silva, E. R. Hruschka, E. R. Hruschka Jr., Tweet sentiment analysis with classifier ensembles, Decis. Support Syst., 66 (2014), 170–179. https://doi.org/10.1016/j.dss.2014.07.003 doi: 10.1016/j.dss.2014.07.003
![]() |
[68] | S. Makonin, F. Popowich, L. Bartram, B. Gill, I. V. Bajić, AMPds: A public dataset for load disaggregation and eco-feedback research, 2013 IEEE Electrical Power & Energy Conference, Halifax, NS, Canada, (2013) 1–6. https://doi.org/10.1109/EPEC.2013.6802949 |
[69] | Smart-Grid Smart-City Customer Trial Data |Datasets| data.gov.au-beta Available from: https://data.gov.au/dataset/ds-dga-4e21dea3-9b87-4610-94c7-15a8a77907ef/details |