A linearly convergent proximal ADMM with new iterative format for BPDN in compressed sensing problem

1.   Introduction

Recently, neural networks such as the Hopfield neural network, cellular neural network, Cohen-Grossberg neural network and bidirectional associative neural network have attracted much attention due to their significant promise for many practical applications^{[1,2,3,4,5,6]}. For example, in the field of signal processing, based on the theoretical results of discrete-time high-order switched neural networks synchronization, the encryption and decryption scheme of multi-channel audio signal design has good security ^[3]. In the field of fault diagnosis, by using deep parameter-free reconstruction-classification networks with parameter-free adaptively rectified linear units, the fault characteristics of vibration signals under the same fault state under different operating conditions can be better captured ^[5]. In the field of image processing, the theoretical results of random synchronization control framework based on semi-Markov switching quaternion-valued neural networks can be effectively applied to image encryption ^[6]. In particular, stability properties of the neural networks play a significant role in their design for solving practical problems. There are some different factors to influence the stability of neural networks. In particular, time delay is often unavoidable. Moreover, for the neural networks with time delay, there exists many techniques to reduce the conservatism of stability conditions, such as the improved bounding technique ^[7], free-weighting matrix theory ^[8], integral inequality technique ^[9] and so on.

It is well known that many dynamical systems may switch in different unpredictable modes, such as random failures ^[10]. As an effective tool, the Markovian jump process can be used to model these switching systems. Until now, there existed many literatures to investigate the stability, stabilization and observation for Markovian jump systems. For example, the authors investigated the adaptive sliding mode control problem of nonlinear Markovian jump systems with partly unknown transition probabilities, and obtained some conditions to guarantee the stochastic stability of the closed-loop system in ^[11]. The authors in ^[12] discussed the realization of $H_\infty$ finite-time control for a class of uncertain stochastic time-delay systems with unmeasured states through sliding mode control, and obtained some conditions to guarantee the system state was stabilized within a limited time interval. In ^[13], the authors established some passivity analysis criteria for Markovian jump singularly perturbed systems with partially unknown probabilities by using the hidden Markov model, and presented a unified controller design method to ensure the passivity of the system. Much more literatures can be found in ^[14,15,16].

In recent years, sliding mode control has become an effective robust control method because it is insensitive to model uncertainties, parameter variations and external disturbances. So, the sliding mode control has been used for lots of physical systems, such as robot manipulators, automotive engines and power systems. There are some existing results for linear or nonlinear systems^{[17,18,19,20,21,22]}. For example, the authors in ^[17] investigated the adaptive sliding mode control issue for switched nonlinear systems with matched and mismatched uncertainties, designed the switched adaptive sliding mode control law and estimated the upper bound parameters of the matched uncertainty. The authors in ^[18] considered the synchronization of delayed chaotic neural networks with unknown disturbance via the observer-based sliding mode control, where the sliding surface involves an integral structure and a discontinuous controller.

In addition, synchronization has received considerable attention from various research fields, such as secure communication ^[3], engineering ^[23] and chemistry ^[24]. Synchronization phenomenons can be observed in many real systems such as neural systems, lasers and electronic circuits ^{[25,26,27,28]}. For example, the authors in ^[25] dealt with chaos synchronization for master-slave piecewise linear systems and provided some new sufficient conditions by using a Lyapunov approach and the so-called S-procedure. In ^[26], the authors designed a proportional-derivative (PD) controller for the master-slave synchronization of chaotic Lurie systems and presented a new synchronization criterion based on Lyapunov functions with a quadratic form of states and nonlinear functions of the systems. In ^[27], the authors studied the finite-time lag synchronization issue of master-slave complex networks with unknown signal propagation delays by the linear and adaptive error state feedback approaches and discovered that the setting time was related to initial values.

Motivated by the above discussion, we will consider the master-slave synchronization for uncertain neural networks with time-delay by using the sliding mode control method. The main contributions of our paper are as follows: (1) The master-slave synchronization for uncertain Markov jump neural networks with time-delay is considered by using the sliding mode control method, (2) the effect of time-delay and uncertainty for the neural networks stability are considered, and the uncertain parts in the neural networks only need be bounded other than any structure condition and (3) the provided sliding mode controller is very general.

The rest of this letter is organized as follows. In Section 2, the considered neural network model and some preliminaries are given. In Section 3, some sufficient conditions are proposed by the sliding mode control. In Section 4, a numerical example is provided to illustrate the effectiveness of the method proposed. In the last section, conclusions are presented.

Notation:

$R^n$: the $n$-dimensional Euclidean space; $R^{n\times m}$: the set of all $n\times m$ real matrices; $||\cdot||$: the two-norm of a vector; $||\cdot||_1$: its one-norm; $I_n$: the $n$ order unit matrix; $\lambda_{min}(H)$: the minimum eigenvalues of matrix $H$; the notation $X > Y$, where $X, \, Y$ are symmetric matrices, meaning that $X-Y$ is a positive definite symmetric matrix. For a given matrix $A \in R^{n\times n}$, $A^T$ denotes its transpose. $sign(\cdot)$ is the sign function. $\ast$ in a symmetric matrix denotes the symmetric terms.

2.   Problem description and preliminaries

Let $(\Omega, \mathcal{F}, \mathcal{F}_t, \mathcal{P})$ be a probability space related to an increasing family $\{\mathcal{F}_t\}_{t\geq 0}$ of the $\sigma$-algebras $\mathcal{F}_t\subset \mathcal{F}$, where $\Omega$ is the sample space. $\mathcal{F}$ is the $\sigma$-algebras of the sample space and $\mathcal{P}$ is the probability measure defined on $\mathcal{F}$.

Consider the uncertain time delay neural networks with the Markovian jump defined on the probability space $(\Omega, \mathcal{F}, \mathcal{F}_t, \mathcal{P})$ as follows:

where $x_m(t) = (x_{m1}(t), x_{m2}(t), ..., x_{mn}(t))^T \in R^n$ is the state of neuron networks and $A(r(t)) \in R^{n\times n }$ and $B(r(t)) \in R^{n\times m }$ and $C(r(t))\in R^{n\times m }$ are coefficient matrices. $\Delta B(r(t))$ and $\Delta C(r(t))\in R^{n \times m }$ denote the system's uncertain parts and satisfy

where matrix $\mathcal{W}(t)$ satisfies $\mathcal{W}^T(t)\mathcal{W}(t)\leq I$, $M(r(t)), \, N_{1}(r(t)), \, N_{2}(r(t))$ are some known matrices with appropriate dimensions. $d(t)$ represents time delay and satisfies $0 \leq d(t) \leq d$ and $\dot{d}(t) \leq \mu \leq 1$. $f(x_m(t))$ and $g(x_m(t-d(t)))$ are the neuron activation functions, and $J \in R^n$ is a constant vector. $\{r(t), \, t \geq 0\}$ is a finite state Markov jumping process and represents the switching process among different modes, which takes values in a state space $L = \{1, 2, ..., l\}$, and $l$ is the number of modes. Let $\prod = [\pi_{ij}]_{l \times l}$ denote the transition rate matrix, where the mode transition probabilities are

where $\Delta t > 0$ and $lim_{\Delta t\rightarrow 0} \frac{o (\Delta t)}{\Delta t} = 0$, $\pi_{ij}$ satisfies $\pi_{ij} > 0$ with $i\neq j$ and $\pi_{ii} = - \sum^l_{j = 1, j\neq i}\pi_{ij}$ for each mode $i$.

In order to be notional convenience, for the $i$-th mode, system (2.1) can be rewritten as

Let (2.3) be the master system, then the slave system is

Definition 1. ^[29] Master system (2.3) and slave system (2.4) are said to be asymptotic synchronization if

for any initial conditions.

In this paper, our objective is to design a suit controller $u(t)$ such that the master system (2.3) and slave system (2.4) are in synchronization by using the sliding mode control method.

To the end, writing the state error $e(t) = x_s(t)-x_m(t)$, and the corresponding state error system can be described by

where $F(e(t)) = f(x_s(t))-f(x_m(t))$ and $G(e(t-d(t))) = g(x_s(t-d(t)))-g(x_m(t-d(t)))$.

First, we take the sliding mode surface as

Thus, the derivative of $\sigma_i(t)$ is

where $K_i (1\leq i \leq l)$ are some unknown matrices to be determined later. When the state trajectories reach the sliding mode surface, then $\dot{\sigma}_i(t) = 0$ and $\sigma_i(t) = 0$. So, we obtain the equivalent controller

Substituting (2.8) into (2.5), we have

In this paper, the following assumptions for the neuron activation functions are needed.

Assumption 1. ^[30] Assume that each component of the nonlinear function $f(\cdot)$ and $g(\cdot)$ are continuous and bounded and satisfy

for any $z_1, z_2 \in R$, where $\eta^-_k > 0, \, \eta^+_k > 0, \, \theta^-_k > 0, \, \theta^+_k > 0$ are some known positive constants.

From Assumption 1, it is easy to get the following inequalities

and

where $H = diag\{ h_1, h_2, ..., h_n \}$ is a positive definite diagonal matrix,

Assumption 2.^[31] Assume that each component of the nonlinear functions $f(\cdot)$ and $g(\cdot)$ are bounded, which means that there exists positive scalars $B_f$ and $B_g$ such that

for $k = 1, 2, ..., n$.

Remark 1. In fact, the activation functions of neural networks are usually bounded. For example, the Logistic Sigmoid function $h_1(x) = \{1+e^{-ax}\}^{-1}$ and the threshold value function

and so on.

Throughout the paper, we need the following lemmas.

Lemma 1.^[32] For any positive definite symmetric matrix $W \in R^{n\times n}$ and scalar $\tau > 0$, there is

Lemma 2.^[33] The linear matrix inequality

is equivalent to the following condition

where $S_{11}$ and $S_{22}$ are symmetric matrices.

3.   Main results

Now, we will analyze the synchronization condition and construct the sliding mode controller.

Theorem 1. Under Assumption 1, if there exists positive definite symmetric matrices $P_i, W_i, R_i \in R^{n\times n}$ such that

for $i = 1, 2, ..., l$, then the master system (2.1) and slave system (2.4) are in synchronization, where

Proof. Constructing the following Lyapunov function

The derivative of $V(t)$ along with the trajectories of system (2.9) is

Letting $\xi(t) = (e^T(t), e^T(t-d(t)), e^T(t-d), F^T(e(t))\; and\; G^T(e(t-d(t)))^T$, one yields

where

It is noted that

where

By using Lemma 2, we know that $\Phi_{3i} + d \Psi^T R_i \Psi < 0$ is equivalent to $\Phi_{1i} < 0$. Thus, one obtains $\dot{V}(t) < 0$ and system (2.9) is asymptotically stable, which shows that the master system (2.1) and slave system (2.4) are in synchronization. The proof is completed.

Theorem 2. Under Assumption 2 and the action of controller

master system (2.1) and slave system (2.4) are in synchronization, where

and $\alpha > 0$ is a positive scalar.

Proof. Constructing the following Lyapunov function

then

Because of

then

Thus, the state trajectories can attain the sliding mode surface in the finite time interval $[0, T^*]$, where $T^\ast \leq \frac{\sqrt{2U(0)}}{ 2\alpha }$. The proof is completed.

Remark 2. Compared with the uncertain system in ^[15], we especially considered the effect of time delay. From Theorems 1 and 2, we see that the designed sliding mode controller can realize the master-slave synchronization of the Markov jump neural networks.

Remark 3. The control gain $K_i$ can be obtained from matrix inequality (3.1). However, (3.1) is not a linear matrix inequality. In order to solve it, we can take $P_i = R_i$.

From Theorem 1, we can obtain the following useful corollary as $r(t) = 1$, which means that system (2.1) only has one mode.

Corollary 1. Under Assumption 1, if there exist positive definite symmetric matrices $P, W, R \in R^{n\times n}$ such that

then the master system

and slave system

are in synchronization, where

4.   A numerical example

Consider master system (2.1) and slave system (2.4) with the following parameters

By using the linear matrix inequality (LMI) toolbox in the MATLAB, we obtain the following solutions of inequality (3.1):

For the initial values $x_m(0) = (-25, 5, 25)^T$ and $x_s(0) = (30, -5, -25)^T$, Figure 1 is the Markovian jump process in different modes. Figure 2 is the state trajectories of error system (2.5), which shows that the error system is convergent and the master system synchronizes with the slave system. Figure 3 is the curve of the sliding mode surface, which shows that the state trajectories can arrive at the surface in a finite time interval.

5.   Conclusions

In this paper, the master-slave synchronization for uncertain neural networks with time delay by using the sliding mode control method has been studied. An integral sliding mode surface and sliding mode controller was designed. Moreover, the state trajectories of the neural networks can reach the sliding mode surface in finite time under the action of the controller. Sufficient conditions in terms of linear matrix inequalities were presented to guarantee the neural networks asymptotical stability. Finally, an example was provided to illustrate the validity of the proposed design method. In the future, we will consider how to solve some physical problems by applying the obtained theoretical results.

Use of AI tools declaration

The authors declare they have not used Artificial Intelligence (AI) tools in the creation of this article.

Acknowledgments

This work is supported by the National Natural Science Foundation (NNSF) of China under Grant 11602134.

Conflict of interest

The authors declare that they have no conflicts of interest.