Loading [MathJax]/jax/output/SVG/jax.js
Research article Special Issues

The parameter-Newton iteration for the second-order cone linear complementarity problem

  • In this paper, we propose the parameter-Newton (PN) method to solve the second-order linear complementarity problem (SOCLCP). The key idea of PN method is that we transfer the SOCLCP into a system of nonlinear equations by bringing in a parameter. Then we solve the system of nonlinear equations by Newton method. At last, we prove that the PN method has quadratic convergence. Compared with the bisection-Newton (BN) method, the PN method has less CPU time and higher accuracy in numerical tests.

    Citation: Peng Zhou, Teng Wang. The parameter-Newton iteration for the second-order cone linear complementarity problem[J]. Electronic Research Archive, 2022, 30(4): 1454-1462. doi: 10.3934/era.2022076

    Related Papers:

    [1] Xin Liu, Guang-Xin Huang . New error bounds for the tensor complementarity problem. Electronic Research Archive, 2022, 30(6): 2196-2204. doi: 10.3934/era.2022111
    [2] Dongmei Yu, Yifei Yuan, Yiming Zhang . A preconditioned new modulus-based matrix splitting method for solving linear complementarity problem of $ H_+ $-matrices. Electronic Research Archive, 2023, 31(1): 123-146. doi: 10.3934/era.2023007
    [3] Haiyan Song, Fei Sun . A numerical method for parabolic complementarity problem. Electronic Research Archive, 2023, 31(2): 1048-1064. doi: 10.3934/era.2023052
    [4] Shuaikang Wang, Yunzhi Jiang, Yongbin Ge . High-order compact difference methods for solving two-dimensional nonlinear wave equations. Electronic Research Archive, 2023, 31(6): 3145-3168. doi: 10.3934/era.2023159
    [5] Xuefei He, Kun Wang, Liwei Xu . Efficient finite difference methods for the nonlinear Helmholtz equation in Kerr medium. Electronic Research Archive, 2020, 28(4): 1503-1528. doi: 10.3934/era.2020079
    [6] Li-Bin Liu, Ying Liang, Jian Zhang, Xiaobing Bao . A robust adaptive grid method for singularly perturbed Burger-Huxley equations. Electronic Research Archive, 2020, 28(4): 1439-1457. doi: 10.3934/era.2020076
    [7] Dongdong Ruan, Xiaofeng Wang . A high-order Chebyshev-type method for solving nonlinear equations: local convergence and applications. Electronic Research Archive, 2025, 33(3): 1398-1413. doi: 10.3934/era.2025065
    [8] Yijun Chen, Yaning Xie . A kernel-free boundary integral method for reaction-diffusion equations. Electronic Research Archive, 2025, 33(2): 556-581. doi: 10.3934/era.2025026
    [9] Li Yu, Xiaofeng Wang . Semi-local convergence of a sixth-order iterative method for solving nonlinear systems. Electronic Research Archive, 2025, 33(6): 3794-3810. doi: 10.3934/era.2025168
    [10] Yantong Guo, Quansheng Wu, Xiaofeng Wang . An extension of high-order Kou's method for solving nonlinear systems and its stability analysis. Electronic Research Archive, 2025, 33(3): 1566-1588. doi: 10.3934/era.2025074
  • In this paper, we propose the parameter-Newton (PN) method to solve the second-order linear complementarity problem (SOCLCP). The key idea of PN method is that we transfer the SOCLCP into a system of nonlinear equations by bringing in a parameter. Then we solve the system of nonlinear equations by Newton method. At last, we prove that the PN method has quadratic convergence. Compared with the bisection-Newton (BN) method, the PN method has less CPU time and higher accuracy in numerical tests.



    The second-order cone linear complementarity problem (SOCLCP) is to find a vector xRn, such that

    xKn, z=Ax+qKn, xz=0, (1.1)

    where ARn×n, qRn and KnRn. Kn (second-order cone) is defined as following:

    Kn:={x | x=[x1,˜x]Rn: x1R+, ˜xRn1 and ˜x2x1}, (1.2)

    where 2 denotes the Euclidean norm. Specially, K1 is equal to the set of nonnegative reals R+. The SOCLCP is a kind of extension of linear complimentary problems(LCP). If you are interested in the LCP, please see[1,2,3]. The SOCLCP also could reduce to the nonlinear complementarity problem (NCP), please see [4,5,6].

    The SOCLCP plays a very important role in many research fields. For example: the problem of support vector machine with noisy data and missing data [7]; combination optimization problem [8]; engineering design [9,10]; convex network flow [11]; image processing [12,13]; array antenna design[14].

    What properties does the solution of the SOCLCP have? How to get the solution? These questions are very important. First of all, the problem about the unique of the solution should be solved. According to [15,16,17,18], we get the answer. If the matrix A has the globally uniquely solvable (GUS) property, the solution of the SOCLCP is unique. Hence, many researches about how to get the unique solution arised in recent years. Here, we mainly introduce some methods in numerical algebra and optimization. For example: Hayashi et al. give the combined smoothing and regularization method [19] in 2005; Xiang et al. give the smoothing method [20] in 2009; Wang et al. give the interior-point method [21,22,23,24,25] in 2010; Fang et al. give the one-step Newton method [26] in 2011; Tang et al. give the smoothing Newton method [27] and Zhang et al. give the bisection-Newton method [28] in 2013; Hao et al. give the power penalty method [29] in 2015.

    In this paper, we propose the parameter-Newton (PN) method to solve the SOCLCP. The key idea of PN method is that we transfer the SOCLCP into a system of nonlinear equations by bringing in a parameter (see Eq (3.1)). Then we solve the system of nonlinear equations by Newton method. The paper is organized as following. In Section 2, we introduce some notations and lemmas which will be used in the other sections. In Section 3, we give the details of PN method. In Section 4, we prove that the PN method has quadratic convergence. In Section 5, the numerical tests are presented. Finally, we state the conclusions and some future work in Section 6.

    In this section, we introduce some basic notations and lemmas which will be used in the other sections. First, we introduce the definition of Fréchet differentiability.

    Definition 2.1. Let V and W be normed linear spaces, and U be an open subset of V. A function F:UW is called Fréchet differentiable at xU, if there exists a bounded linear operator A:VW such that

    limh0F(x+h)F(x)Ahh=0. (2.1)

    Next, we give some lemmas about the norm of matrix.

    Lemma 2.1. Let F denote the Euclidean norm of the matrix. Assume that matrices A, BRn×n and A is nonsingular. If A1Fα, ABFβ and αβ<1, we yield that the matrix B is also nonsingular and B1Fα1αβ.

    Proof. Let the matrix C=IA1B. Then we have

    CF=IA1BF=A1(AB)FA1FABFαβ<1.

    It is clear that the matrix A1B=IC is nonsingular which means the matrix B being also nonsingular. Furthermore, we yield the following inequality as

    B1F=(IC)1A1F(IC)1FA1F=αlimn(I+C++Cn)Fαlimn(1+CF++CnF)=α1CFα1αβ.

    Here, we introduce some other notations which will be used in the following part of the paper. The bd(Kn) and the int(Kn) stand for the boundary and the interior of Kn. The matrix Jn=diag{1, 1, , 1}=diag{1,In1}.

    Lemma 2.2. [18] For the SOCLCP, the matrix A has the GUS property if and only if it satisfies the following assumptions:

    (i) The matrix AJn has nonnegative eigenvalues and there exists τ>0 such that all nonnegative eigenvalues of AJn are equal to τ. Moreover, rank(AJnτIn)=n1. There exists wint(Kn) such that w is the eigenvector of AJn associated with τ;

    (ii) There exists vint(Kn) such that v is the eigenvector of AJn associated with τ;

    iii)

    aAa0,abd(Kn);

    (iv)

    aA1a0,abd(Kn).

    According to the above lemma, the positive definite (not necessarily symmetric) matrix A has the GUS property. Next, we introduce two important conclusions of the solution to the SOCLCP when the matrix A has the GUS property.

    Lemma 2.3. [28] Suppose that A has the GUS property and τ>0 is the positive eigenvalue of AJn with the unit eigenvector vint(Kn). Then the solution x to the SOCLCP is locally a continuously differentiable function of q.

    Lemma 2.4. [28] Suppose that A has the GUS property and τ is the unique positive eigenvalue of AJn. Then for any 0<ρτ and for all nonzero vector abd(Kn), we have

    a(AρJn)1a{>0,if 0<ρ<τ,<0,if ρ>τ. (2.2)

    For a given A with the GUS property and a vector qRn, our main interest in this paper is to find the unique solution for the SOCCLP. There are two special cases that can be handled very easily: qKn and: qAKn. The former gives the solution x=0 whereas the latter leads to the solution x=A1q. The case qAKnKn is the main topic which will be dicussed in next section.

    In [18], Yang et al. prove that when qAKnKn, the exact solution x and z=Ax+q are belong to the bd(Kn). Adding xz=0, we yield that z=λJnx where λ is a positive parameter. The problem (1.1) could be transformed into the following system of nonlinear equations:

    F(x,λ):={(AλJn)x+q12xJnx=0 (3.1)

    Then we use Newton iteration to solve (3.1). It is easy to get the iteration equation:

    (AλkJnJnxkxkJn0)(xk+1λk+1)=(λkJnxkq12xkJnxk). (3.2)

    We combine our described techniques and present the complete PN algorithm in Algorithm 1.

    Algorithm 1 The parameter-Newton method (The PN method)
    INPUT: The matrix ARn×n with GUS property, a vector qRn, the initial vector x0=(1, 0, , 0), λ0=1 and a relative tolerance ϵ.
    OUTPUT: The solution x.
      Case 1: If qKn then
          x=0;
      Case 2: If A1qKn then
          x=A1q;
      Case 3: If qAKnKn then
          while (xk+1xk2xk2ϵ)
            Solve equation (3.2);
            If the first element of xk+1 is negative, then let it equal ˜xk+12;
            If λk+1<0, then let λk+1=λk+1;
          end while
    % We use GMRES in Case 3 to solve the Eq (3.2).

    In this section, we prove that the convergence of the PN method has quadratic convergence.

    Theorem 4.1. Suppose that the sequence {xk} is produced by the PN method, then the sequence has quadratic convergence.

    Proof. First of all, we need to prove the following conclusion.

    When A has the GUS property, then for any qAKnKn, the coefficient matrix of Eq (3.2) is nonsingular at the solution pair (x, λ).

    Suppose there exists a vector (a, b)Rn+1 satisfying

    (AλJnJnxxJn0)(ab)=0.

    In case λ=τ, Lemma 3 indicates (a, b)=0. If λτ, then it follows that AλJn is nonsingular and thus one has

    a=b(AλJn)1(Jnx), (4.1)

    and

    0=b(Jnx)(AλJn)1(Jnx). (4.2)

    This relation together with Lemma 4 implies b=0 which leads to a=0. Therefore, the conclusion follows.

    Furthermore, at the neighborhood of the solution pair (x, λ), the matrix

    F(x,λ):=(AλJnJnxxJn0)

    is nonsingular.

    Next, we prove the following inequality

    F(xk, λk)F(x, λ)Fn(xkx2F+(λkλ)2)12. (4.3)

    We yield that

    F(xk, λk)F(x, λ)F=(AλkJnJnxkxkJn0)(AλJnJnxxJn0)F=(λkJnλJnJnxkJnxxkJn+xJn0)F.

    Let

    M=(λkJnλJnJnxkJnxxkJn+xJn0),

    we get that

    F(xk, λk)F(x, λ)2F=M2F=tr(MM).

    By direct computing, we have that

    MM=(λkJnλJnJnxk+JnxxkJnxJn0)(λkJnλJnJnxkJnxxkJn+xJn0)=((λkJnλJn)2+(Jnxk+Jnx)(xkJn+xJn)(λkJnλJn)(JnxkJnx)(xkJnxJn)(λkJnλJn)(xkJnxJn)(JnxkJnx))=((λkλ)2In+(xk+x)(xk+x)(λkλ)(xkx)(λkλ)(xkx)(xkx)(xkx)).

    Therefore, we yield

    tr(MM)=tr[(λkλ)2In+(xk+x)(xk+x)]+(xkx)(xkx)=n(λkλ)2+tr[(xk+x)(xk+x)]+(xkx)(xkx)=n(λkλ)2+2(xkx)(xkx). (4.4)

    Similarly,

    xkx2F+(λkλ)2=(xkx)(xkx)+(λkλ)2. (4.5)

    Getting (4.4) and (4.5) together, we prove the inequality (4.3).

    Now, the proof of the theorem is finished.

    In this section, we will present the numerical experiments of the PN method. It is known that there exist various methods for solving the SOCLCP. In order to evaluate the numerical performance and demonstrate clearly the efficiency of the PN method for solving the SOCLCP, we will also present the numerical results from the bisection-Newton (BN) method [28]. All of our tests are carried out in MATLAB (R2015b) on a PC with Intel(R) Core(TM) m3-7Y30 CPU @ 1.00GHz and 4GB memory.

    Example 5.1. The matrix NRn×n is a large sparse random matrix. We set that the dimension n equals 1000, 3000, 5000. The density of matrix N is 0.5, 1 and 5%. The matrix A=NN has the GUS property. The vector q is also a random vector.

    We make the initial vector x0=(1, 0, , 0) and parameter λ0=1. We set the relative tolerance ϵ=106. The results of the numerical test are prensented in the Table 1. In this table, we summarize the average numbers of iterations (labelled as Iter) for every method. The corresponding CPU times (labelled as CPU, the unit as second) of each method are also summarized. To check the accuracy (labelled as Err) of the computed solution, we define

    ac=|xz|+|x1˜x2|+|z1˜z2|. (5.1)
    Table 1.  The results of PN method and BN method.
    n density Iter CPU(s) Err
    PN BN PN BN PN BN
    1000 0.5% 19 27 0.26 0.17 8.27e-10 3.11e-06
    1% 19 27 0.78 0.10 8.71e-10 7.81e-06
    5% 19 27 0.50 0.06 9.06e-13 7.16e-06
    3000 0.5% 19 31 2.23 6.18 1.43e-08 2.14e-06
    1% 20 31 2.04 5.20 7.37e-08 6.37e-06
    5% 19 31 1.85 3.20 5.87e-09 2.60e-06
    5000 0.5% 25 33 10.26 21.32 8.94e-08 1.56e-06
    1% 22 32 10.78 25.37 1.79e-08 8.40e-07
    5% 22 33 10.50 21.09 1.21e-07 6.92e-06

     | Show Table
    DownLoad: CSV

    In this paper, we propose the parameter-Newton method for solving the second-order cone linear complementarity problem. We prove that our algorithm has quadratic convergence at least. Numerical results also show that the PN method is more efficient when A is a large, sparse and symmetric positive definite matrix. Since the Eq (3.2) being the saddle point problem, we will use some other numerical methods to sovle it in future.

    The authors declare there is no conflicts of interest.



    [1] A. Alfred, Variational inequalities over the cone of semidefinite positive symmetric matrices and over the Lorentz cone, Optim. Method Softw., 18 (2003), 359–376. https://doi.org/10.1080/1055678031000122586 doi: 10.1080/1055678031000122586
    [2] M. Kojima, S. Shindoh, S. Hara, Interior-point methods for the monotone semidfinite linear complementarity problem in symmetric matrices, SIAM J. Optim., 7 (1997), 86–125. https://doi.org/10.1137/S1052623494269035 doi: 10.1137/S1052623494269035
    [3] A. Yoshise, Interior point trajectories and a homogeneous model for nonlinear complementarity problems over symmetric cones, SIAM J. Optim., 17 (2006), 1129–1153. https://doi.org/10.1137/04061427X doi: 10.1137/04061427X
    [4] S. Hayashi, N. Yamashita, M. Fukushima, Robust Nash equilibria and second-order cone complementarity problems, J. Nonlinear Convex Anal., 6 (2005), 283–296.
    [5] X. D. Chen, D. Sun, J. Sun, Complementarity functions and numerical experiments on some smoothing Newton methods for second-order-cone complementarity problems, Comput. Optim. Appl., 25 (2003), 39–56. https://doi.org/10.1023/A:1022996819381 doi: 10.1023/A:1022996819381
    [6] S. L. Miguel, V. Lieven, B. Stephen, L. Herve, Applications of second-order cone programming, Linear Algebra Appl., 284 (1998), 193–228. https://doi.org/10.1016/S0024-3795(98)10032-0 doi: 10.1016/S0024-3795(98)10032-0
    [7] P. K. Shivaswamy, C. Bhattacharyya, A. J. Smola, Second order cone programming approaches for handling missing and uncertain data, J. Mach. Learn. Res., 7 (2006), 1283–1314.
    [8] S. Kim, M. Kojima, M. Yamashita, Second order cone programming relaxation of a positive semidefinite constraint, Optim. Method Software, 18 (2003), 535–541. https://doi.org/10.1080/1055678031000148696 doi: 10.1080/1055678031000148696
    [9] T. Sasakawa, T. Tsuchiya, Optimal magnetic shield design with second-order cone programming, SIAM J. Sci. Comput., 24 (2003), 1930–1950. https://doi.org/10.1137/S1064827500380350 doi: 10.1137/S1064827500380350
    [10] S. Yan, Y. L. Ma, Optimal design and verification of temporal and spatial filters using second-order cone programming approach, Sci. China Ser. F Inf. Sci., 49 (2006), 235–253. https://doi.org/10.1007/s11432-006-0235-3 doi: 10.1007/s11432-006-0235-3
    [11] Y. Kanno, M. Ohsaki, Contact analysis of cable networks by using second-order cone programming, SIAM J. Sci. Comput., 27 (2006), 2032–2052. https://doi.org/10.1137/S1064827503431946 doi: 10.1137/S1064827503431946
    [12] X. Peng, I. King, Robust BMPM training based on second-order cone programming and its application in medical diagnosis, Neural Netw., 21 (2008), 450–457. https://doi.org/10.1016/j.neunet.2007.12.051 doi: 10.1016/j.neunet.2007.12.051
    [13] D. Goldfarb, W. T. Yin, Second-order cone programming methods for total variation-based image restoration, SIAM J. Sci. Comput., 27 (2005), 622–645. https://doi.org/10.1137/040608982 doi: 10.1137/040608982
    [14] S. Yan, Y. L. Ma, Robust supergain beamforming for circular array via second order cone programm, Appl. Acoust., 66 (2005), 1018–1032. https://doi.org/10.1016/j.apacoust.2005.01.003 doi: 10.1016/j.apacoust.2005.01.003
    [15] M. Fukushima, Z. Q. Luo, P. Tseng, Smoothing functions for second-order cone complementarity problems, SIAM J. Optim., 12 (2001), 436–460. https://doi.org/10.1137/S1052623400380365 doi: 10.1137/S1052623400380365
    [16] M. S. Gowda, Y. Song, On semidfinite linear complementarity problems, Math. Program., 88 (2000), 575–587. https://doi.org/10.1007/PL00011387 doi: 10.1007/PL00011387
    [17] M. S. Gowda, R. Sznajder, Automorphism invariance of P-matrix and GUS properties of linear transformations on Euclidean Jordan algebras, Math. Oper. Res., 31 (2006), 109–123. https://doi.org/10.1287/moor.1050.0182 doi: 10.1287/moor.1050.0182
    [18] W. H. Yang, Y. Yuan, The GUS-property of second-order cone linear complementarity problems, Math. Comput., 141 (2013), 295–317. https://doi.org/10.1007/s10107-012-0523-1 doi: 10.1007/s10107-012-0523-1
    [19] S. Hayashi, N. Yamashita, M. Fukushima, A combined smoothing and regularization method for monotone second-order cone complementarity problems, SIAM J. Optim., 15 (2005), 593–615. https://doi.org/10.1137/S1052623403421516 doi: 10.1137/S1052623403421516
    [20] S. Z. Xiang, Y. L. San, H. L. Zhen, A smoothing method for second order cone complementarity problem, J. Comput. Appl. Math., 228 (2009), 83–91. https://doi.org/10.1016/j.cam.2008.08.040 doi: 10.1016/j.cam.2008.08.040
    [21] B. Kheirfam, N. M. Amiri, A new interior-point algorithm based on modified Nesterov-Todd direction for symmetric cone linear complementarity problem, Optim. Lett., 8 (2014), 1017–1029. https://doi.org/10.1007/s11590-013-0618-5 doi: 10.1007/s11590-013-0618-5
    [22] G. Q. Wang, D. T. Zhu, A class of polynomial interior-point algorithms for the Cartesian P(κ) second-order cone linear complementarity problem, Nonlinear Anal., Theory, Methods Appl., 73 (2010), 3705–3722. https://doi.org/10.1007/s10957-011-9938-8 doi: 10.1007/s10957-011-9938-8
    [23] G. Q. Wang, Y. Q. Bai, A class of polynomial interior-point algorithms for the Cartesian P-matrix linear complementarity problem over symmetric cones, J. Optim. Theory Appl., 152 (2012), 739–772. https://doi.org/10.1007/s10957-011-9938-8 doi: 10.1007/s10957-011-9938-8
    [24] G. Lesaja, G. Q. Wang, D. T. Zhu, Interior-point methods for Cartesian P(κ)-linear complementarity problems over symmetric cones based on the eligible kernel functions, Optim. Methods Software, 27 (2012), 827–843. https://doi.org/10.1080/10556788.2012.670858 doi: 10.1080/10556788.2012.670858
    [25] G. Q. Wang, G. Lesaja, Full Nesterov-Todd step feasible interior-point method for the Cartesian P(κ)-SCLCP, Optim. Methods Software, 28 (2013), 600–618. https://doi.org/10.1080/10556788.2013.781600 doi: 10.1080/10556788.2013.781600
    [26] L. Fang, C. Y. Han, A new one-step smoothing newton method for the second-order cone complementarity problem, Math. Meth. Appl. Sci., 34 (2011), 347–359. https://doi.org/10.1002/mma.1366 doi: 10.1002/mma.1366
    [27] J. Y. Tang, G. P. He, D. Li, F. Liang, J. C. Zhou, A smoothing Newton method for the second-order cone complementarity problem, J. Optim. Theory Appl., 58 (2013), 223–247. https://doi.org/10.1007/s10492-013-0011-9 doi: 10.1007/s10492-013-0011-9
    [28] L. H Zhang, W. H. Yang, An efficient algorithm for second-order cone linear complementarity problems, Math. Comput., 83 (2013), 1701–1726. https://doi.org/10.1090/S0025-5718-2013-02795-0 doi: 10.1090/S0025-5718-2013-02795-0
    [29] Z. J. Hao, Z. P. Wan, X. N. Chi, A power penalty method for second-order cone linear complementarity problems, Oper. Res. Lett., 43 (2015), 137–142. https://doi.org/10.1016/j.orl.2014.12.012 doi: 10.1016/j.orl.2014.12.012
  • Reader Comments
  • © 2022 the Author(s), licensee AIMS Press. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0)
通讯作者: 陈斌, bchen63@163.com
  • 1. 

    沈阳化工大学材料科学与工程学院 沈阳 110142

  1. 本站搜索
  2. 百度学术搜索
  3. 万方数据库搜索
  4. CNKI搜索

Metrics

Article views(2039) PDF downloads(63) Cited by(0)

Figures and Tables

Tables(1)

Other Articles By Authors

/

DownLoad:  Full-Size Img  PowerPoint
Return
Return

Catalog