Loading [MathJax]/jax/output/SVG/jax.js
Research article

Nonconvex high-order TV and 0 norm-based method for image restoration

  • Received: 10 March 2025 Revised: 15 May 2025 Accepted: 29 May 2025 Published: 03 June 2025
  • In order to obtain high-quality restoration outcomes, this paper proposed a new nonconvex variational model tailored for reconstructing blurred images corrupted by impulse noise. The newly designed optimization framework integrated nonconvex high-order total variation regularization with 0 norm data fidelity. This combination aided in overcoming the staircase artifacts and maintaining sharp contours while tackling the poor performance of 1 norm-based data fidelity in handling high-density impulse noise. To deal with the nonconvex optimization problem, we designed an efficient alternating direction method of multipliers by combining the variable splitting technique with the iteratively reweighted 1 algorithm. Finally, numerous experiments demonstrated that the suggested scheme achieves competitive performance in terms of objective metrics and visual quality.

    Citation: Ben Wang, Zijie Lan. Nonconvex high-order TV and 0 norm-based method for image restoration[J]. Electronic Research Archive, 2025, 33(6): 3431-3449. doi: 10.3934/era.2025152

    Related Papers:

    [1] Ruini Zhao . Nanocrystalline SEM image restoration based on fractional-order TV and nuclear norm. Electronic Research Archive, 2024, 32(8): 4954-4968. doi: 10.3934/era.2024228
    [2] Xuexiao You, Ning Cao, Wei Wang . An MTL1TV non-convex regularization model for MR Image reconstruction using the alternating direction method of multipliers. Electronic Research Archive, 2024, 32(5): 3433-3456. doi: 10.3934/era.2024159
    [3] Gonglin Yuan, Minjie Huang . An efficient modified HS conjugate gradient algorithm in machine learning. Electronic Research Archive, 2024, 32(11): 6175-6199. doi: 10.3934/era.2024287
    [4] Zhengyu Liu, Yufei Bao, Changhai Wang, Xiaoxiao Chen, Qing Liu . A fast matrix completion method based on truncated $ {\mathit{L}}_{2, 1} $ norm minimization. Electronic Research Archive, 2024, 32(3): 2099-2119. doi: 10.3934/era.2024095
    [5] Asma Maiza, Raouf Ziadi, Mohammed A. Saleh, Abdulgader Z. Almaymuni . An improved conjugate gradient algorithm by adapting a new line search technique. Electronic Research Archive, 2025, 33(4): 2148-2171. doi: 10.3934/era.2025094
    [6] Abdelmajid El Hakoume, Lekbir Afraites, Amine Laghrib . An improved coupled PDE system applied to the inverse image denoising problem. Electronic Research Archive, 2022, 30(7): 2618-2642. doi: 10.3934/era.2022134
    [7] Souad Ayadi, Ozgur Ege . Image restoration via Picard's and Mountain-pass Theorems. Electronic Research Archive, 2022, 30(3): 1052-1061. doi: 10.3934/era.2022055
    [8] Wenya Shi, Xinpeng Yan, Zhan Huan . Faster free pseudoinverse greedy block Kaczmarz method for image recovery. Electronic Research Archive, 2024, 32(6): 3973-3988. doi: 10.3934/era.2024178
    [9] Jye Ying Sia, Yong Kheng Goh, How Hui Liew, Yun Fah Chang . Constructing hidden differential equations using a data-driven approach with the alternating direction method of multipliers (ADMM). Electronic Research Archive, 2025, 33(2): 890-906. doi: 10.3934/era.2025040
    [10] Xiu Ye, Shangyou Zhang . A stabilizer free WG method for the Stokes equations with order two superconvergence on polytopal mesh. Electronic Research Archive, 2021, 29(6): 3609-3627. doi: 10.3934/era.2021053
  • In order to obtain high-quality restoration outcomes, this paper proposed a new nonconvex variational model tailored for reconstructing blurred images corrupted by impulse noise. The newly designed optimization framework integrated nonconvex high-order total variation regularization with 0 norm data fidelity. This combination aided in overcoming the staircase artifacts and maintaining sharp contours while tackling the poor performance of 1 norm-based data fidelity in handling high-density impulse noise. To deal with the nonconvex optimization problem, we designed an efficient alternating direction method of multipliers by combining the variable splitting technique with the iteratively reweighted 1 algorithm. Finally, numerous experiments demonstrated that the suggested scheme achieves competitive performance in terms of objective metrics and visual quality.



    For a long time, image restoration has been regarded as a fundamental yet challenging topic in the field of image processing. In numerous applications, it remains of significant importance as a crucial preprocessing step. Among them, restoring images corrupted by impulse noise and blur has become a prominent research direction. Impulse noise typically arises from electromagnetic interference, sensor inaccuracies, or imperfections in communication systems [1]. This type of noise generally manifests in two primary forms: salt-and-pepper noise and random-valued impulse noise. Both variants degrade image quality by altering the values of a randomly selected subset of pixels while leaving the remaining pixels unaffected [2]. As a consequence, developing effective methods to remove impulse noise and blur is of significant importance.

    In the field of variational methods for image restoration, the total variation (TV) regularization method, originally developed by Rudin et al. [3], has been proven effective in preserving edge details. Although the 2 norm data fitting used in their work demonstrates significant efficacy in removing Gaussian noise, its susceptibility to outliers often leads to artifacts during impulse noise removal. To better address this task, the studies [4,5] present an improved variational model, which combines the TV regularization with 1 norm fidelity, achieving better performance in impulse noise removal.

    The TV-based method excels at preserving image gradient sparsity and sharp edge details. However, it potentially assumes that images consist of piecewise constant regions, which may lead to undesirable staircase artifacts in the recovered results. In response to this constraint, researchers have developed various improved solvers. Notable methods include the high-order TV (HOTV) [6,7,8] and the total generalized variation (TGV) models [9,10], which utilize high-order derivatives to enhance their performance. Extensive research has shown that the techniques based on high-order derivatives can suppress the staircase artifacts, but their inherent diffusion properties often result in blurred edges. Besides, there are many other related improved methods, as shown in the references [11,12,13].

    As demonstrated in the studies [14,15], nonconvex potential functions exhibit distinct advantages in preserving sharp edges. This has prompted extensive research into nonconvex potential functions by numerous authors, aiming to achieve superior image restoration. For example, the works [16,17,18] have incorporated nonconvex potential functions into the TV regularizer, leading to the modified nonconvex TV (NTV) variants with improved performance. However, it can be observed that the staircase effect in NTV is more pronounced than in the TV-based methods. To better preserve edges while mitigating the staircase effect, nonconvex HOTV (NHOTV) [19,20,21], nonconvex fractional-order TV [22], and nonconvex TGV [23,24,25] models have been developed recently.

    The aforementioned image restoration approaches are primarily designed based on the 1 norm. Although they are effective for noise removal, the 1 norm often yields over-penalized reconstruction results [26]. Moreover, their performance significantly deteriorates under the high-intensity impulse noise cases, frequently resulting in image distortion. To address these limitations, Yuan et al. [27] proposed an 0TV model that incorporates the 0 norm fidelity, which demonstrates superior impulse noise removal while preserving image details. However, the TV regularization inevitably introduces the staircase artifacts in the reconstructed images.

    To achieve high-quality image restoration, this study proposes a novel nonconvex optimization model. The developed new model combines the advantages of the NHOTV regularizer and 0 norm fidelity, which can reduce the staircase artifacts while preserving edge details and improve the reconstruction accuracy for images corrupted by impulse noise.

    The main contributions of this study are threefold. First, by incorporating a nonconvex p function into the HOTV penalty, we propose a novel regularizer. This regularizer, combined with the 0 norm fidelity term, forms a new nonconvex model for image restoration under impulse noise. Second, to solve this optimization problem, we develop an adjusted alternating direction method of multipliers by integrating the iteratively reweighted 1 algorithm with the variable splitting technique. Finally, numerical experiments demonstrate that the proposed scheme outperforms some existing restoration methods in terms of both visual quality and objective evaluation metrics.

    The remainder of this paper is organized as follows. Section 2 introduces the detailed formulation of the proposed model. In Section 3, we have derived the solution process for each subproblem in detail. Section 4 demonstrates the effectiveness of our approach through comprehensive numerical experiments. Finally, Section 5 concludes the paper by summarizing our findings.

    As mentioned in the reference [27], the image restoration model based on TV regularization and 0 Norm fidelity can be expressed as

    minuTV(u)+λo|Kuf|0, (1)

    where TV(u)=u1 represents the TV regularization term, λ>0 is the weighting parameter, o{0,1}n with n=n1×n2 (the total number of pixels) is specified by the user. When oi=0, it indicates the pixel in position i is an outlier, while when oi=1, it indicates the pixel in position i is a potential outlier. In this paper, oi=0 when bi=umax or bi=umin, and otherwise oi=1 for the salt-and-pepper impulse noise. stands for element-wise multiplication, KRn×n is a linear blurring operator, u and f represent the normalized original image and the observed image, respectively, and 0 denotes the number of non-zero elements in a vector.

    To improve the quality of image restoration, this paper introduces a nonconvex p function into the HOTV and proposes an image restoration model based on NHOTV penalty and 0 norm fidelity. Specifically, the established mathematical model is

    minu2upp+λo|Kuf|0, (2)

    where 0<p<1, and υpp=ni=1|υi|p. The second-order gradient operator 2 is defined as

    2u=(uxxuxyuyxuyy),  |2u|=u2xx+u2xy+u2yx+u2yy.

    When p=1, model (2) degenerates into the classic second-order TV model. Therefore, the proposed nonconvex high-order penalty term combines the merits of both HOTV and nonconvex functions, enabling it to overcome the staircasing effect while preserving edge details of images.

    To support efficient numerical computations, for an image with dimensions of n1×n2 pixels, the discrete second-order gradient operator is defined as

    (2u)i,j=[Dx(D+xu)i,jD+x(D+yu)i,jD+y(D+xu)i,jDy(D+yu)i,j],

    where the forward and backward finite difference operators are respectively defined as

    (D+xu)i,j={ui,j+1ui,j,1j<n2,ui,1ui,n2,j=n2,(D+yu)i,j={ui+1,jui,j,1i<n1,u1,jun1,j,i=n1,(Dxu)i,j={ui,1ui,n2,j=1,ui,jui,j1,1<jn2,(Dyu)i,j={u1,jun1,j,i=1,ui,jui1,j,1<in1.

    where the relationship D+x(D+yu)i,j=Dy(Dxu)i,j holds. Note that the adjoint of 2, denoted by (2)T, satisfies the equality u,div2pX=2u,pY, where X denotes the Euclidean space Rn1×n2 and Y represents the matrix space Rn1×n2×Rn1×n2×Rn1×n2×Rn1×n2. Moreover, the second-order divergence operator can be expressed as

    (div2p)i,j=D+x(Dxp)i,j+Dx(Dyp)i,j+Dy(Dxp)i,j+D+y(Dyp)i,j.

    To solve the nonconvex model (2), we first present an important property of the 0 norm. According to the work [26], for ϑRn, the 0 norm possesses the following variational characteristic:

    ϑ0=min0z11,1z,  s.t. z|ϑ|=0. (3)

    Furthermore, ˜z=1sgn(|ϑ|) is the unique optimal solution to problem (3), with sgn being the sign function. Leveraging this property, the proposed new model can be transformed into the following easily solvable constrained optimization problem

    minu,0z12upp+λ1,1z, s.t. zo|Kuf|=0. (4)

    By utilizing the variable splitting technique and introducing two auxiliary variables, d and v, the optimization problem (4) can be transformed into

    minu,d,v,0z1dpp+λ1,1z, s.t. 2u=d, Kuf=v, zo|v|=0. (5)

    For the aforementioned constrained optimization problem, we employ the alternating direction method of multipliers (ADMM) to find the solution. As a consequence, this leads to the following iterative algorithm

    (uk+1,dk+1,vk+1,zk+1)= argminu,d,v,0z1dpp+λ1,1z+2ud,βk+γ122ud22+Kufv,δk+γ22Kufv22+zo|v|,ξk+γ32zo|v|22, (6)

    Note that in expression (6), γ1,γ2,γ3>0 are three penalty parameters. In addition, the update formula for the Lagrange multipliers is

    {βk+1=βk+γ1(2uk+1dk+1),δk+1=δk+γ2(Kuk+1fvk+1),ξk+1=ξk+γ3(zk+1o|vk+1|). (7)

    It should be noted that the four subproblems in problem (6) are all decoupled. Utilizing the idea of alternating minimization, the solutions to the subproblems for the variables u,d,v, and z can be written as the following iterative framework:

    {uk+1= argminu2udk,βk+γ122udk22+Kufvk,δk+γ22Kufvk22,dk+1= argminddpp+2uk+1d,βk+γ122uk+1d22,vk+1= argminvKuk+1fv,δk+γ22Kuk+1fv22+zko|v|,ξk+γ32zko|v|22,zk+1= argmin0z1λ1,1z+zo|vk+1|,ξk+γ32zo|vk+1|22. (8)

    Next, we will solve each subproblem in detail one by one. Firstly, for the u-subproblem, it can be equivalently written as

    uk+1=argminuγ122udk+βkγ122+γ22Kufvk+δkγ222. (9)

    Combining its first-order necessary condition for optimality, we can obtain the subdifferential with respect to the variable u and assign uuk+1, namely,

    (γ1(2)T2+γ2KTK)uk+1=γ1(2)T(dβkγ1)+γ2KT(f+vδkγ2), (10)

    where ΛT represents the adjoint operator of Λ. Under periodic boundary conditions, the operators (2)T2 and KTK are both block circulant matrices. Therefore, by utilizing the fast Fourier transform and its inverse, the solution to the u-subproblem can be described as

    uk+1=F1(γ1F(2)F(dβkγ1)+γ2F(K)F(f+vδkγ2)γ1F(2)F(2)+γ2F(K)F(K)). (11)

    In Eq (11), F and F1 represent the fast Fourier transform and its inverse transform, respectively, and denotes the complex conjugate.

    According to the second formula in Eq (8), the d-subproblem can be written as

    dk+1=argminddpp+γ122uk+1d+βkγ122. (12)

    Given that Eq (12) involves a nonconvex p norm penalty, direct solving is highly challenging. Here, by using the iteratively reweighted 1 algorithm, the convex approximation of the nonconvex optimization problem (12) can be expressed as

    dk+1=argmindwk+1d1+γ12d(2uk+1+βkγ1)22, (13)

    where w represents a positive weighting function, which is determined by the values from the (k+1)-th iteration. Its calculation formula is given by

    wk+1=p(|2uk+1|+τ)1p, (14)

    where τ>0 represents a very small positive number, intended to prevent division by zero in the denominator. Subsequently, by using the classical shrinkage operator, the solution to the d-subproblem can be described as

    dk+1=shrink(2uk+1+βkγ1,wk+1γ1), (15)

    where shrink denotes the shrinkage operator, defined as shrink(t,η)=sgn(t)max(t2η,0).

    As for the v-subproblem, it can be equivalently written as

    vk+1=argminvγ22v(Kuk+1f+δkγ2)22+γ32zko|v|+ξkγ322. (16)

    Let qk=Kuk+1f+δk/γ2 and tk=zko. The above equation can be simplified as

    vk+1=argminvγ22vqk22+γ32tk|v|+ξkγ322. (17)

    By utilizing the generalized shrinkage formula, the solution to the v-subproblem determined by Eq (17) is given by

    vk+1=shrink(γ2qkγ2+γ3(tk)2,tkξkγ2+γ3(tk)2). (18)

    Finally, we proceed to solve the z-subproblem. For computational convenience, it is equivalently rewritten as

    zk+1=argmin0z112γ3ovk+1vk+1z2+(ξko|vk+1|λ)z. (19)

    According to the projection formula, we obtain

    zk+1=min(1,max(0,ξko|vk+1|λγ3ovk+1vk+1)). (20)

    In summary, by combining the solution processes of each subproblem described above, a modified ADMM framework can be derived as follows.

    Here, we provide a concise overview of the computational complexity associated with Algorithm 1. The computation of the u-subproblem involves FFT and inverse FFT operations, resulting in a complexity of O(n1n2log(n1n2)) for an image of dimensions n1×n2. Additionally, it is worth noting that the d-subproblem and v-subproblem are tackled using the shrinkage operator and generalized shrinkage formula, respectively. Their computation costs are both linear with a complexity of O(n1n2). Finally, the z-subproblem is solved using a projection formula, which also costs linear time with O(n1n2).

    Algorithm 1. ADMM for image restoration
    Input: f and K.
    Initialization: u0,d0,v0,z0,β0,δ0,ξ0; Set: λ,p,γ1,γ2,γ3.
    while stopping criterion is not met, do
       Compute uk+1 by (11);
       Compute dk+1 by (15);
       Compute vk+1 by (18);
       Compute zk+1 by (20);
       Update βk+1,δk+1, and ξk+1 by (7);
    end while
    Output: u=uk+1.

    In what follows, we provide a brief analysis of the convergence properties of the designed algorithm. More precisely, we establish the global convergence of the proposed algorithm by verifying the three key conditions: sufficient decrease condition, relative error condition, and continuity condition of [28] under the Kurdyka–Lojasiewicz (KL) framework.

    Theorem 1. The sequence {(uk,dk,vk,zk)} generated by Algorithm 1 satisfies

    k=0(uk+1uk2+dk+1dk2+vk+1vk2+zk+1zk2)<,

    and converges to a critical point of the augmented Lagrangian function L.

    Proof. Let L(u,d,v,z)=dpp+λ1,1z+2ud,β+γ122ud22+Kufv, δ+γ22Kufv22+zo|v|, ξ+γ32zo|v|22 be the augmented Lagrangian function of problem (5). Since L is semi-algebraic, and thus it satisfies the KL property [29].

    First, for the u-subproblem (9), according to the strong convexity of the quadratic term, we derive that there exists a constant cu>0 such that L(uk+1,dk,vk,zk)Lkcuuk+1uk22 holds. Regarding the d-subproblem (12), by adopting the iteratively reweighted 1 approximation strategy, the weight update formula (14) ensures that the approximation errors are summable. Thus, there exists cd>0 such that L(uk+1,dk+1,vk,zk)L(uk+1,dk,vk,zk)cddk+1dk22 holds. For the v-subproblem (16), the contraction property of the generalized shrinkage operator guarantees the existence of cv>0, which satisfies L(uk+1,dk+1,vk+1,zk)L(uk+1,dk+1,vk,zk)cvvk+1vk22. For the z-subproblem (19), we have L(uk+1,dk+1,vk+1,zk+1)L(uk+1,dk+1,vk+1,zk)czzk+1zk22 due to the strong convexity and projection formula. By taking a=min{cu,cd,cv,cz}, we thereby obtain the global descent condition as Lk+1+at{u,d,v,z}tk+1tk22Lk.

    Second, we bound the subgradients by iteration increments. From the solution to the u-subproblem in the Fourier domain, it yields that there exists a constant Cu>0 such that uLk+12Cuuk+1uk2. Due to the characteristics of the shrink operator, we have dLk+12Cddk+1dk2 and vLk+12Cvvk+1vk2. By the Lipschitz continuity property of the projection formula (20), we have zLk+12Czzk+1zk2. Furthermore, setting b=max{Cu,Cd,Cv,Cz}, we obtain the relative error condition as dist(0,Lk+1)bt{u,d,v,z}tk+1tk2, where dist is the distance function.

    Finally, the coercivity of p norm (0<p<1) and 0 fidelity and box constraint z[0,1] ensure the boundedness of {(uk,dk,vk,zk)}. By using Bolzano–Weierstrass theorem, there exists a convergent subsequence (ukj,dkj,vkj,zkj)(ˉu,ˉd,ˉv,ˉz), This together with the lower semicontinuity of L, ensures that the function value matching at the corresponding limit point, namely, the following continuity condition limjL(ukj,dkj,vkj,zkj)=L(ˉu,ˉd,ˉv,ˉz) holds.

    By Theorem 2.9 [28], the above three conditions (sufficient decrease, relative error, and continuity) and the KL property of L imply that the sequence globally converges to a critical point.

    This section outlines numerous numerical experiments aimed at assessing the efficacy of the newly proposed model for image restoration. For comparative purposes, the introduced method is compared with three related models: TV1 [5], 0TV [27], and 0OGSTV [30] (abbreviated as 0OTV), which are all solved using the ADMM framework. All experiments are conducted using MATLAB R2023b software on a computer running Windows 10, with 4 GB of RAM and an Intel(R) Core(TM) i5-8250 CPU operating at 1.80 GHz.

    In the simulated experiments, we select several standard test images that are widely employed in the field of image processing, including four grayscale images (House, Man, Peppers, Einstein) and two color images (Bird, Monarch), as depicted in Figure 1. To validate the effectiveness of our model, we first conducted pure denoising tests. Next, we evaluated its robustness and adaptability using two different blur types: motion blur with a length of 15 and an angle of 45, and disk blur with a radius of 10. In each deblurring experiment, we further degraded the test images by adding three levels of salt-and-pepper noise (30%, 50% and 70%). This allowed us to assess performance under varying degrees of distortion.

    Figure 1.  Original test images. (a) House (256×256), (b) Man (512×512), (c) Peppers (256×256), (d) Einstein (256×256), (e) Bird (256×256), (f) Monarch (360×360).

    To ensure equitable comparison, the unified stopping criterion for all numerical methods in the experiments is set as

    uk+1uk2uk2<5×104. (21)

    To enable a clearer and more intuitive comparison of the performance of various methods, we adopt two widely-used metrics: peak signal-to-noise ratio (PSNR) and structural similarity (SSIM), and a modern subjective quality assessment metric: learned perceptual image patch similarity (LPIPS), which serve as three quantitative indicators of image restoration quality. More specifically, the PSNR is defined as follows

    PSNR=10log10(Max2n1n2u˜u22), (22)

    where u and ˜u represent the original clean image and the restored version, respectively, and Max denotes the maximum pixel value. Furthermore, the SSIM is formulated as follows:

    SSIM=(2μuμ˜u+c1)(2σu˜u+c2)(μ2u+μ2˜u+c1)(σ2u+σ2˜u+c2), (23)

    where μu and μ˜u are the means of the original and restored images, σu and σ˜u are their respective variances, and c1,c2>0 denote two constants. Moreover, σu˜u is the covariance of u and ˜u. Note that higher PSNR and SSIM values correspond to better image restoration quality. Conversely, a lower LPIPS value indicates that the two images are more perceptually similar from the human visual perspective.

    In this subsection, we focus on discussing the parameter settings for our developed algorithm. Namely, five parameters γ1,γ2,γ3,λ, and p, involved in model (2) need to be taken into account.

    Experimental results demonstrate that the parameters γ1, γ3, and p have relatively limited influence on restoration performance. Therefore, to streamline parameter configuration and ensure algorithm stability, we assign fixed values to these parameters. Specifically, we set γ1 to 5000 for image denoising tasks and 2000 for joint image denoising and deblurring tasks, with γ3=500 and p=0.9 being uniformly adopted across all configurations. This strategy allows us to achieve consistent restoration quality while focusing on optimizing other more influential parameters.

    The regularization parameter λ and the penalty parameter γ2 have a significant impact on the experimental results. More precisely, λ plays a key role in noise filtering, while γ2 directly affects the restoration performance and the convergence speed of the algorithm. The specific values of λ and γ2 depend on image characteristics, noise levels, and blur types. To achieve optimal restoration results, the regularization parameter λ is tested using the set {25,40,45,50,100,140,220} and the penalty parameter γ2 is selected from the set {400,500,600,1200,1400,100,000,110,000,120,000}.

    Note that in the designed algorithm, identical parameter settings are applied to all images degraded by the same type and level of blur and noise. Regarding the determination of these parameters for our comparative models, we have adopted a manual tuning approach, aiming to achieve the preset minimum relative error while simultaneously maximizing the PSNR and SSIM values. Meanwhile, we strive to minimize the number of iterations and reduce the CPU time.

    To validate the effectiveness of the proposed model, we first conducted denoising experiments on the House and Man test images by adding salt-and-pepper noise at three different intensities: 10%, 20%, and 30%. Figures 2 and 4 present the comparisons of denoising results obtained by TV1, 0TV and 0OTV, and our proposed method on the noisy images. The parameters used in our method remain consistent with the previously described settings. Additionally, Table 1 summarizes the quantitative evaluation metrics, including the number of iterations, CPU time (in seconds), PSNR, SSIM, and LPIPS values, to facilitate a comprehensive comparative analysis. Figure 3 demonstrates the numerical convergence characteristics of all compared methods, as evaluated through the relative errors.

    Figure 2.  The pure denoising outcomes of different approaches on House image. (a1)–(a3) Degraded images, (b1)–(b3) TV1, (c1)–(c3) 0TV, (d1)–(d3) 0OTV, (e1)–(e3) our method.
    Figure 3.  Relationships between relative error and iterations for all methods on House image at three noise levels. (a) Level of 10%, (b) level of 20%, (c) level of 30%.
    Figure 4.  The pure denoising outcomes of different approaches on Man image. (a1)–(a3) Degraded images, (b1)–(b3) TV1, (c1)–(c3) 0TV, (d1)–(d3) 0OTV, (e1)–(e3) our method.
    Table 1.  Quantitative evaluation results on House and Man images.
    Figure Model Noise level (10%) Noise level (20%) Noise level (30%)
    Iter Time PSNR SSIM LPIPS Iter Time PSNR SSIM LPIPS Iter Time PSNR SSIM LPIPS
    House TV1 47 0.47 33.6350 0.9275 0.1368 50 0.50 31.5120 0.8854 0.2026 57 0.56 29.8361 0.8446 0.2431
    0TV 36 0.32 37.3495 0.9770 0.0442 43 0.36 32.9898 0.9485 0.0703 54 0.42 30.1027 0.9208 0.1248
    0OTV 38 0.48 39.2052 0.9818 0.0248 42 0.53 34.0732 0.9578 0.0453 45 0.59 31.0431 0.9248 0.1177
    Ours 63 0.73 40.5528 0.9914 0.0179 63 0.81 35.3425 0.9777 0.0491 64 0.76 32.1056 0.9576 0.0924
    Man TV1 50 2.34 32, 6301 0.9298 0.0880 53 2, 71 30.2319 0.8733 0.1461 54 2.96 28.0754 0.7924 0.2369
    0TV 38 2.31 33.3991 0.9573 0.0634 47 2.40 30.1472 0.9135 0.1080 58 2.56 27.9136 0.8702 0.1557
    0OTV 40 3.89 35.0881 0.9694 0.0603 42 4.98 32.3171 0.9404 0.0734 46 5.02 30.2817 0.9047 0.1134
    Ours 71 5.61 36.6663 0.9833 0.0488 73 4.83 33.9404 0.9670 0.0697 72 5.14 31.2111 0.9413 0.1096

     | Show Table
    DownLoad: CSV

    The experimental results demonstrate that all four methods exhibit good denoising performance, but with notable differences. Traditional TV methods (including TV1 and 0TV) produce noticeable staircase artifacts in smooth image regions, which stem from the inherent theoretical limitations of the TV regularization term. While the 0OTV method shows some improvement in reducing the staircase artifacts, its performance enhancement remains limited. In contrast, our proposed method achieves the optimal reconstruction quality, effectively preserving both edge sharpness and texture details. This superiority is further confirmed by the quantitative evaluation results in Table 1, where all objective metrics consistently validate the effectiveness of our model.

    To validate the visual performance and generalization capability of the proposed model, some experiments are conducted in this subsection by adding noise and blur. Figures 5 and 7 present the degraded and restored results obtained by four different methods on the test images. Specifically, the experiments include the Peppers and Einstein images degraded by motion blur and noise. Note that to achieve satisfactory restoration results, all parameters in our proposed method are set within the ranges described previously. Furthermore, Table 2 summarizes the quantitative evaluation metrics. Figure 6 illustrates the relationship between relative error and iteration count, demonstrating the stability and convergence of the proposed algorithm in the simulation experiments.

    Figure 5.  Motion deblurring and denoising results by different methods on Peppers image. (a1)–(a3) Degraded images, (b1)–(b3) TV1, (c1)–(c3) 0TV, (d1)–(d3) 0OTV, (e1)–(e3) our method.
    Figure 6.  Relationships between relative error and iterations for all methods on Peppers image at three noise levels. (a) Level of 30%, (b) level of 50%, (c) level of 70%.
    Figure 7.  Motion deblurring and denoising results by different methods on Einstein image. (a1)–(a3) Degraded images, (b1)–(b3) TV1, (c1)–(c3) 0TV, (d1)–(d3) 0OTV, (e1)–(e3) our method.
    Table 2.  Quantitative evaluation results on Peppers and Einstein images.
    Figure Model Noise level (30%) Noise level (50%) Noise level (70%)
    Iter Time PSNR SSIM LPIPS Iter Time PSNR SSIM LPIPS Iter Time PSNR SSIM LPIPS
    Peppers TV1 82 0.82 32.0103 0.9174 0.0712 65 0.61 28.5368 0.8731 0.1406 64 0.59 24.1065 0.7618 0.2573
    0TV 108 1.47 34.9937 0.9485 0.0383 112 1.52 32.0728 0.9182 0.0680 140 1.64 29.5206 0.8849 0.1155
    0OTV 70 1.26 35.0728 0.9509 0.0683 108 1.75 33.0414 0.9382 0.1016 244 3.71 29.6258 0.9103 0.1395
    Ours 74 1.21 37.1069 0.9713 0.0311 78 1.27 34.3640 0.9502 0.0585 127 2.10 31.7865 0.9179 0.1102
    Einstein TV1 101 0.91 32.4040 0.8394 0.1388 78 0.80 29.5467 0.7567 0.2500 74 1.16 26.5724 0.6600 0.3749
    0TV 114 1.45 34.0789 0.8759 0.1229 119 1.48 31.8598 0.8168 0.1793 141 1.59 30.2060 0.7651 0.2294
    0OTV 61 1.08 33.6157 0.8666 0.1651 122 1.81 33.0590 0.8552 0.1748 258 3.90 31.1250 0.8246 0.1848
    Ours 64 1.21 35.9012 0.9302 0.0777 77 1.45 34.5785 0.9120 0.0926 123 2.31 32.3163 0.8664 0.1480

     | Show Table
    DownLoad: CSV

    The experimental results in Table 2 demonstrate that the proposed model outperforms TV1, 0TV, and 0OTV, as evidenced by higher PSNR and SSIM values and lower LPIPS values. As the intensity of salt-and-pepper noise increases, all tested methods exhibit a gradual decline in PSNR and SSIM metrics. Obviously, even under extreme conditions with 70% pixel corruption, the proposed approach maintains robust performance, consistently surpassing other methods in terms of quality assessment. Qualitative comparisons based on the visual results shown in Figures 5 and 7 further highlight the advantages of our method. Analysis reveals that the traditional TV-based approaches, including TV1 and 0TV, tend to produce noticeable staircase artifacts in smooth regions, which is a well-known limitation of TV regularization. The TV1 model exhibits significant performance degradation under high-noise conditions. As shown in (b3) of Figures 5 and 7, the restored images appear blurry and distorted, particularly in edge and texture regions. While the 0OTV method demonstrates some improvement in reducing the staircase artifacts, its restoration capability deteriorates considerably as the noise intensity increases. In contrast, the proposed method effectively prevents the staircase effect while preserving sharp edges in all test images, resulting in superior restoration quality.

    In this experiment, we specifically aimed to evaluate the efficacy of the proposed algorithm for restoring color images. To this end, we selected the images Bird and Monarch as our test subjects. The test images are degraded by disk blur and salt-and-pepper noise at the levels of 30%, 50%, and 70%. The degradation results are shown in (a1)–(a3) of Figures 8 and 9. It is important to note that all parameters of the proposed method are configured within the specified ranges mentioned earlier to ensure the optimal restoration outcomes. The corresponding reconstruction results are presented in columns 2 to 5 of Figures 8 and 9. For a more comprehensive and quantitative evaluation, we consider the performance metrics of four methods, which include the number of iterations, CPU time, PSNR, SSIM, and LPIPS values. These metrics are summarized in Table 3, providing a clear and concise comparison of the performance via four methods. It is worth noting that we adopt the channel-wise TV for a color image u=(ur,ug,ub), calculate TV independently for each color channel, and then sum them up, namely, TVchannel(u)=i{r,g,b}Ω|ui|dx.

    Figure 8.  Disk deblurring and denoising results of different methods on Bird image. (a1)–(a3) Degraded images, (b1)–(b3) TV1, (c1)–(c3) 0TV, (d1)–(d3) 0OTV, (e1)–(e3) our method.
    Figure 9.  Disk deblurring and denoising results of different methods on Monarch image. (a1)–(a3) Degraded images, (b1)–(b3) TV1, (c1)–(c3) 0TV, (d1)–(d3) 0OTV, (e1)–(e3) our method.
    Table 3.  Quantitative evaluation results on Bird and Monarch images.
    Figure Model Noise level (30%) Noise level (50%) Noise level (70%)
    Iter Time PSNR SSIM LPIPS Iter Time PSNR SSIM LPIPS Iter Time PSNR SSIM LPIPS
    Bird TV1 127 11.10 28.3599 0.8359 0.0893 119 8.22 27.2765 0.8061 0.1123 93 6.20 25.0749 0.7328 0.1713
    0TV 206 8.90 30.6692 0.8925 0.0615 213 9.04 29.3577 0.8654 0.0724 268 11.50 27.2654 0.8071 0.1032
    0OTV 142 11.60 31.5742 0.9071 0.0993 164 20.54 31.2876 0.9001 0.1064 281 22.86 28.1858 0.8325 0.1684
    Ours 134 9.68 33.7311 0.9549 0.0579 147 10.65 33.3500 0.9512 0.0640 296 21.52 32.1366 0.9179 0.0823
    Monarch TV1 141 22.28 26.7625 0.8823 0.1051 117 20.24 25.1302 0.8494 0.1304 91 13.40 22.3087 0.7713 0.1914
    0TV 191 16.33 28.2254 0.9051 0.0963 205 17.42 26.9361 0.8826 0.1116 250 21.28 24.7950 0.8364 0.1416
    0OTV 142 28.05 27.6660 0.9086 0.1490 162 27.36 26.2249 0.8803 0.1787 193 32.11 24.3332 0.8348 0.2266
    Ours 133 19.24 29.1173 0.9422 0.1120 161 23.20 28.7980 0.9373 0.1236 129 18.60 26.6280 0.9043 0.1678

     | Show Table
    DownLoad: CSV

    The experimental results confirm that the proposed method demonstrates significant advantages in color image restoration. Visual inspection of Figures 8 and 9 reveals that the TV1 method introduces noticeable staircase artifacts in the restored images, leading to suboptimal visual quality. This issue is particularly pronounced under 70% salt-and-pepper noise, where the method fails to preserve image features effectively, such as the wings of Monarch (Figure 9(b3)). Both the 0TV and 0OTV models perform better in edge preservation and noise suppression, but they still have some limitations. Specifically, the 0TV-based model suffers from a significant staircase effect caused by the TV regularization. On the other hand, the 0OTV model partially reduces this defect but still fails to achieve high restoration quality. The proposed method effectively eliminates the staircase artifacts through the joint optimization of nonconvex HOTV and nonconvex 0 norm fidelity terms, while also excelling in detail preservation, as clearly shown in (e1)–(e4) of Figures 8 and 9. Furthermore, quantitative results in Table 3 highlight the superiority of the proposed method, achieving the highest PSNR and SSIM values and demonstrating its exceptional performance in image denoising and deblurring.

    Finally, we assessed the effectiveness of our approach to the real-world data experiment. The real fluorescence microscopy image was acquired from the Imaging Center of the IGBMC, Illkirch, France. The input noisy image has the size of 378×313 pixels. After the restoration, Figure 10 presents the visual outputs obtained by using four different methods.

    Figure 10.  Real-data denoising results of color fluorescence microscopy image. (a) Real noise image, (b) TV1, (c) 0TV, (d) 0OTV, (e) our method.

    The experimental findings indicate that both the comparative denoising techniques and our newly proposed method are capable of effectively mitigating noise in real-world noisy images. As depicted in Figure 10, our strategy exhibits enhanced performance, resulting in superior denoising effects, which are reflected in terms of noise reduction and detail preservation.

    This paper introduced a novel nonconvex variational framework designed for high-quality image restoration under blur and impulse noise. The proposed method leveraged the strengths of nonconvex high-order total variation regularization and 0 norm data fidelity, enabling high-precision image recovery. To solve the designed optimization problem, we developed a modified alternating direction method of multipliers by incorporating the variable splitting method and the iteratively reweighted 1 algorithm. Experimental results validated that the proposed method outperforms some existing methods in terms of both quantitative metrics and perceptual quality. Moreover, by adjusting the data fidelity term, the framework has the potential for broader applications in denoising tasks involving diverse noise distributions. Furthermore, inspired by periodic plus smooth image decomposition [31], our proposed method can be improved to a more precise algorithm, which helps to overcome the periodization artifacts and preserve edge details.

    The authors declare they have not used Artificial Intelligence (AI) tools in the creation of this article.

    This work was supported by the Guangxi Natural Science Foundation (2025GXNSFAA069860), the Scientific Research Fund of Hunan Provincial Education Department (22A0339), and the Guangxi Minzu University Autonomous Regional-Level College Students' Innovation and Entrepreneurship Training Program (S202410608006).

    The authors declare there are no conflicts of interest.



    [1] T. Shongwe, A. J. H. Vinck, H. C. Ferreira, A study on impulse noise and its models, SAIEE Afr. Res. J., 106 (2015), 119–131. https://doi.org/10.23919/SAIEE.2015.8531938 doi: 10.23919/SAIEE.2015.8531938
    [2] B. Jahne, Digital Image Processing, Springer Science, Business Media, 2005. https://doi.org/10.1007/3-540-27563-0
    [3] L. I. Rudin, S. Osher, E. Fatemi, Nonlinear total variation based noise removal algorithms, Physica D, 60 (1992), 259–268. https://doi.org/10.1016/0167-2789(92)90242-F doi: 10.1016/0167-2789(92)90242-F
    [4] M. Nikolova, Minimizeers of cost-functions involving non-smooth data fidelity terms. Application to the processing of outliers, SIAM J. Numer. Anal., 40 (2002), 965–994. https://doi.org/10.2307/4100911 doi: 10.2307/4100911
    [5] J. Yang, Y. Zhang, W. Yin, An efficient TVL1 algorithm for deblurring multichannel images corrupted by impulsive noise, SIAM J. Sci. Comput., 31 (2009), 2842–2865. https://doi.org/10.1137/080732894 doi: 10.1137/080732894
    [6] T. Chan, A. Marquina, P. Mulet, High-order total variation-based image restoration, SIAM J. Sci. Comput., 22 (2000), 503–516. https://doi.org/10.1137/S1064827598344169 doi: 10.1137/S1064827598344169
    [7] K. Bredies, M. Holler, Higher-order total variation approaches and generalisations, Inverse Probl., 36 (2020), 123001. https://doi.org/10.1088/1361-6420/ab8f80 doi: 10.1088/1361-6420/ab8f80
    [8] M. Bergounioux, L. Piffet, A second-order model for image denoising, Set-Valued Var. Anal., 18 (2010), 277–306. https://doi.org/10.1007/s11228-010-0156-6 doi: 10.1007/s11228-010-0156-6
    [9] K. Bredies, K. Kunisch, T. Pock, Total generalized variation, SIAM J. Imaging Sci., 3 (2010), 492–526. https://doi.org/10.1137/090769521 doi: 10.1137/090769521
    [10] X. Liu, Augmented Lagrangian method for total generalized variation based Poissonian image restoration, Comput. Math. Appl., 71 (2016), 1694–1705. https://doi.org/10.1016/j.camwa.2016.03.005 doi: 10.1016/j.camwa.2016.03.005
    [11] H. Deng, G. Liu, L. Zhou, Ultrasonic logging image denoising algorithm based on variational Bayesian and sparse prior, J. Electron. Imaging, 32 (2023), 013004–013004. https://doi.org/10.1117/1.JEI.32.1.013004 doi: 10.1117/1.JEI.32.1.013004
    [12] L. Zhou, J. Tang, Fraction-order total variation blind image restoration based on L1-norm, Appl. Math. Model., 51 (2017), 469–476. https://doi.org/10.1016/j.apm.2017.07.009 doi: 10.1016/j.apm.2017.07.009
    [13] L. Zhou, T. Zhang, Y. Tian, H. Huang, Fraction-order total variation image blind restoration based on self-similarity features, IEEE Access, 8 (2020), 30436–30444. https://doi.org/10.1109/ACCESS.2020.2972269 doi: 10.1109/ACCESS.2020.2972269
    [14] M. Nikolova, M. K. Ng, C. P. Tam, Fast nonconvex nonsmooth minimization methods for image restoration and reconstruction, IEEE Trans. Image Process., 19 (2010), 3073–3088. https://doi.org/10.1109/TIP.2010.2052275 doi: 10.1109/TIP.2010.2052275
    [15] P. Ochs, A. Dosovitskiy, T. Brox, T. Pock, On iteratively reweighted algorithms for nonsmooth nonconvex optimization, SIAM J. Imaging Sci., 8 (2015), 331–372. https://doi.org/10.1137/140971518 doi: 10.1137/140971518
    [16] M. Nikolova, M. K. Ng, C. P. Tam, On 1 data fitting and concave regularization for image recovery, SIAM J. Sci. Comput., 35 (2013), A397–A430. https://doi.org/10.1137/10080172X doi: 10.1137/10080172X
    [17] I. Selesnick, A. Lanza, S. Morigi, F. Sgallari, Non-convex total variation regularization for convex denoising of signals, J. Math. Imaging Vis., 62 (2020), 825–841. https://doi.org/10.1007/s10851-019-00937-5 doi: 10.1007/s10851-019-00937-5
    [18] X. You, N. Cao, W. Wang, An MTL1TV non-convex regularization model for MR image reconstruction using the alternating direction method of multipliers, Electron. Res. Arch., 32 (2024), 3433–3456. https://doi.org/10.3934/era.2024159 doi: 10.3934/era.2024159
    [19] X. Liu, W. Lian, Non-convex high-order TV and 0-norm wavelet frame-based speckle noise reduction, IEEE Trans. Circuits Syst. II, Exp. Briefs., 69 (2022), 5174–5178. https://doi.org/10.1109/TCSII.2022.3197237 doi: 10.1109/TCSII.2022.3197237
    [20] T. Adam, R. Paramesran, K. Ratnavelu, A combined higher order non-convex total variation with overlapping group sparsity for Poisson noise removal, Comput. Appl. Math., 41 (2022), 130. https://doi.org/10.1007/s11042-021-10583-y doi: 10.1007/s11042-021-10583-y
    [21] X. Liu, T. Sun, Hybrid non-convex regularizers model for removing multiplicative noise, Comput. Math. Appl., 126 (2022), 182–195. https://doi.org/10.1016/j.camwa.2022.09.012 doi: 10.1016/j.camwa.2022.09.012
    [22] W. Lian, X. Liu, Non-convex fractional-order TV model for impulse noise removal, J. Comput. Appl. Math., 417 (2023), 114615. https://doi.org/10.1016/j.cam.2022.114615 doi: 10.1016/j.cam.2022.114615
    [23] L. Bai, A new nonconvex approach for image restoration with Gamma noise, Comput. Math. Appl., 77 (2019), 2627–2639. https://doi.org/10.1016/j.camwa.2018.12.045 doi: 10.1016/j.camwa.2018.12.045
    [24] H. Na, M. Kang, M. Jung, M. Kang, Nonconvex TGV regularization model for multiplicative noise removal with spatially varying parameters, Inverse Probl. Imaging, 13 (2019), 117–147. https://doi.org/10.3934/ipi.2019007 doi: 10.3934/ipi.2019007
    [25] T. Sun, X. Liu, Non-convex TGV regularized 0-norm fidelity model for impulse noise removal, Signal Process., 212 (2023), 109125. https://doi.org/10.1016/j.sigpro.2023.109125 doi: 10.1016/j.sigpro.2023.109125
    [26] S. Kuang, H. Chao, Q. Li, Matrix completion with capped nuclear norm via majorized proximal minimization, Neurocomputing, 316 (2018), 190–201. https://doi.org/10.1016/j.neucom.2018.07.066 doi: 10.1016/j.neucom.2018.07.066
    [27] G. Yuan, B. Ghanem, 0TV: A sparse optimization method for impulse noise image restoration, IEEE Trans. Pattern Anal. Mach. Intell., 41 (2017), 352–364. https://doi.org/10.1109/TPAMI.2017.2783936 doi: 10.1109/TPAMI.2017.2783936
    [28] H. Attouch, J. Bolte, B. F. Svaiter, Convergence of descent methods for semi-algebraic and tame problems: proximal algorithms, forward-backward splitting, and regularized Gauss-Seidel methods, Math. Program., 137 (2013), 91–129. https://doi.org/10.1007/s10107-011-0484-9 doi: 10.1007/s10107-011-0484-9
    [29] J. Bolte, S. Sabach, M. Teboulle, Proximal alternating linearized minimization for nonconvex and nonsmooth problems, Math. Program., 146 (2014), 459–494. https://doi.org/10.1007/s10107-013-0701-9 doi: 10.1007/s10107-013-0701-9
    [30] M. Yin, T. Adam, R. Paramesran, M. F. Hassan, An 0-overlapping group sparse total variation for impulse noise image restoration, Signal Process., Image Commun., 102 (2022), 116620. https://doi.org/10.1016/j.image.2021.116620 doi: 10.1016/j.image.2021.116620
    [31] L. Moisan, Periodic plus smooth image decomposition, J. Math. Imaging Vis., 39 (2011) 161–179. https://doi.org/10.1007/s10851-010-0227-1 doi: 10.1007/s10851-010-0227-1
  • Reader Comments
  • © 2025 the Author(s), licensee AIMS Press. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0)
通讯作者: 陈斌, bchen63@163.com
  • 1. 

    沈阳化工大学材料科学与工程学院 沈阳 110142

  1. 本站搜索
  2. 百度学术搜索
  3. 万方数据库搜索
  4. CNKI搜索

Metrics

Article views(144) PDF downloads(29) Cited by(0)

Figures and Tables

Figures(10)  /  Tables(3)

Other Articles By Authors

/

DownLoad:  Full-Size Img  PowerPoint
Return
Return

Catalog