Research article

Cardinality-constrained maximal predictability portfolios with an $ \ell_2 $ regularization

  • Published: 20 May 2026
  • 90C11, 90C26, 90C06

  • The maximal predictability portfolio (MPP) is a portfolio optimization framework that explicitly incorporates return predictability into the objective function. While MPP has been shown to achieve favorable empirical performance, it is prone to overfitting when using rich sets of candidate assets and factors. To address this issue, we study a cardinality-constrained MPP formulation with an $ \ell_2 $ regularization term and investigate how regularization reshapes the structure and out-of-sample behavior of MPP. The resulting formulation leads to a challenging optimization problem involving binary variables and nonconvex constraints. We show that, through an appropriate bilevel reformulation, the problem can be handled within the cutting-plane algorithm (CPA) framework. In particular, by exploiting a globally optimal solution of the primal lower-level problem, we derive an equivalent convex formulation that preserves the finite termination and $ \varepsilon $-optimality guarantees of CPA. We also derive a subgradient expression tailored to the MPP structure, which enables the construction of valid cutting planes despite the nonconvexity of the original formulation. For practical large-scale computation, we further incorporate normalized linearization as a heuristic accelerator for the lower-level problem, which improves tractability. However, the exact finite termination and $ \varepsilon $-optimality guarantees of CPA no longer directly apply. Numerical experiments demonstrate that the proposed approach, combined with normalized linearization, can efficiently compute high-quality solutions for large-scale instances where exact methods become computationally impractical. The results further illustrate that moderate $ \ell_2 $ regularization improves out-of-sample predictability, whereas excessive regularization diminishes the predictive structure of MPP. Overall, our findings highlight the role of $ \ell_2 $ regularization in balancing predictability, stability, and practical feasibility within the MPP framework.

    Citation: Katsuhiro Tanaka, Rei Yamamoto. Cardinality-constrained maximal predictability portfolios with an $ \ell_2 $ regularization[J]. Journal of Industrial and Management Optimization, 2026, 22(6): 2755-2783. doi: 10.3934/jimo.2026101

    Related Papers:

  • The maximal predictability portfolio (MPP) is a portfolio optimization framework that explicitly incorporates return predictability into the objective function. While MPP has been shown to achieve favorable empirical performance, it is prone to overfitting when using rich sets of candidate assets and factors. To address this issue, we study a cardinality-constrained MPP formulation with an $ \ell_2 $ regularization term and investigate how regularization reshapes the structure and out-of-sample behavior of MPP. The resulting formulation leads to a challenging optimization problem involving binary variables and nonconvex constraints. We show that, through an appropriate bilevel reformulation, the problem can be handled within the cutting-plane algorithm (CPA) framework. In particular, by exploiting a globally optimal solution of the primal lower-level problem, we derive an equivalent convex formulation that preserves the finite termination and $ \varepsilon $-optimality guarantees of CPA. We also derive a subgradient expression tailored to the MPP structure, which enables the construction of valid cutting planes despite the nonconvexity of the original formulation. For practical large-scale computation, we further incorporate normalized linearization as a heuristic accelerator for the lower-level problem, which improves tractability. However, the exact finite termination and $ \varepsilon $-optimality guarantees of CPA no longer directly apply. Numerical experiments demonstrate that the proposed approach, combined with normalized linearization, can efficiently compute high-quality solutions for large-scale instances where exact methods become computationally impractical. The results further illustrate that moderate $ \ell_2 $ regularization improves out-of-sample predictability, whereas excessive regularization diminishes the predictive structure of MPP. Overall, our findings highlight the role of $ \ell_2 $ regularization in balancing predictability, stability, and practical feasibility within the MPP framework.



    加载中


    [1] A. Lo, K. MacKinlay, Maximizing predictability in the stock and bond markets, Macroecon. Dyn., 1 (1997), 102–134. https://doi.org/10.1017/S1365100597002046 doi: 10.1017/S1365100597002046
    [2] P. G. Coulombe, M. Göebel, Maximally machine-learnable portfolios, SSRN working paper, 2023. http://doi.org/10.2139/ssrn.4428178
    [3] R. Yamamoto, D. Ishii, H. Konno, A maximal predictability portfolio model: Algorithm and performance evaluation, Int. J. Theor. Appl. Finance, 10 (2007), 1095–1109. https://doi.org/10.1142/S0219024907004561 doi: 10.1142/S0219024907004561
    [4] R. D. Harris, J. Shen, F. Yilmaz, Maximally predictable currency portfolios, J. Int. Money Finance, 128 (2022), 102702. https://doi.org/10.1016/j.jimonfin.2022.102702 doi: 10.1016/j.jimonfin.2022.102702
    [5] B. Q. Ta, V. T. Huynh, K. Q. H. Nguyen, P. N. Nguyen, B. H. Ho, Maximal predictability portfolio optimization model and applications to vietnam stock market, in Credible Asset Allocation, Optimal Transport Methods, and Related Topics, vol. 429 of Studies in Systems, Decision and Control. Springer International Publishing, 2022,559–578. https://doi.org/10.1007/978-3-030-97273-8_37
    [6] K. Tanaka, R. Yamamoto, An efficient approach for maximal predictability portfolio with cardinality constraints (in Japanese), Trans. Oper. Res. Soc. Jpn., 66 (2023), 1–22. https://doi.org/10.15807/torsj.66.1 doi: 10.15807/torsj.66.1
    [7] H. Konno, Y. Morita, R. Yamamoto, A maximal predictability portfolio using absolute deviation reformulation, Comput. Manag. Sci., 7 (2010), 47–60. https://doi.org/10.1007/s10287-008-0075-2 doi: 10.1007/s10287-008-0075-2
    [8] H. Konno, Y. Takaya, R. Yamamoto, A maximal predictability portfolio using dynamic factor selection strategy, Int. J. Theor. Appl. Finance, 13 (2010), 355–366. https://doi.org/10.1142/S0219024910005802 doi: 10.1142/S0219024910005802
    [9] A. E. Hoerl, R. W. Kennard, Ridge regression: Biased estimation for nonorthogonal problems, Technometrics, 12 (1970), 55–67. https://doi.org/10.2307/1267351 doi: 10.2307/1267351
    [10] J. Gotoh, A. Takeda, On the role of norm constraints in portfolio selection, Comput. Manag. Sci., 8 (2011), 323–353. https://doi.org/10.1007/s10287-011-0130-2 doi: 10.1007/s10287-011-0130-2
    [11] B. Bruder, N. Gaussel, J. Richard, T. Roncalli, Regularization of portfolio allocation, SSRN working paper, 2013. http://doi.org/10.2139/ssrn.2767358
    [12] V. DeMiguel, L. Garlappi, F. Nogales, R. Uppal, A generalized approach to portfolio optimization: Improving performance by constraining portfolio norms, Manag. Sci., 55 (2009), 798–812. https://doi.org/10.1287/mnsc.1080.0986 doi: 10.1287/mnsc.1080.0986
    [13] A. Takeda, M. Niranjan, J. Gotoh, Y. Kawahara, Simultaneous pursuit of out-of-sample performance and sparsity in index tracking portfolios, Comput. Manag. Sci., 10 (2013), 21–49. https://doi.org/10.1007/s10287-012-0158-y doi: 10.1007/s10287-012-0158-y
    [14] D. Bertsimas, R. Cory-Wright, A scalable algorithm for sparse portfolio selection, INFORMS J. Comput., 34 (2022), 1489–1511. https://doi.org/10.1287/ijoc.2021.1127 doi: 10.1287/ijoc.2021.1127
    [15] K. Kobayashi, Y. Takano, K. Nakata, Bilevel cutting-plane algorithm for cardinality-constrained mean-CVaR portfolio optimization, J. Global Optim., 81 (2021), 498–528. https://doi.org/10.1007/s10898-021-01048-5 doi: 10.1007/s10898-021-01048-5
    [16] K. Kobayashi, Y. Takano, K. Nakata, Cardinality-constrained distributionally robust portfolio optimization, Eur. J. Oper. Res., 309 (2023), 1173–1182. https://doi.org/10.1016/j.ejor.2023.01.037 doi: 10.1016/j.ejor.2023.01.037
    [17] S. Wang, L. Pang, S. Wang, H. Zhang, Distributionally robust mean-CVaR portfolio optimization with cardinality constraint, J. Oper. Res. Soc. China, 14 (2026), 179–209. https://doi.org/10.1007/s40305-023-00512-1 doi: 10.1007/s40305-023-00512-1
    [18] D. Bertsimas, R. Cory-Wright, J. Pauphilet, Solving large-scale sparse PCA to certifiable (near) optimality, J. Mach. Learn. Res., 23 (2022), 1–35.
    [19] D. Bertsimas, J. Lamperski, J. Pauphilet, Certifiably optimal sparse inverse covariance estimation, Math. Program., 184 (2020), 491–530. https://doi.org/10.1007/s10107-019-01419-7 doi: 10.1007/s10107-019-01419-7
    [20] J. Gotoh, K. Fujisawa, Convex optimization approaches to maximally predictable portfolio selection, Optimization, 63 (2014), 1713–1735. https://doi.org/10.1080/02331934.2012.741237 doi: 10.1080/02331934.2012.741237
    [21] O. Ledoit, M. Wolf, Improved estimation of the covariance matrix of stock returns with an application to portfolio selection, J. Empir. Finance, 10 (2003), 603–621. https://doi.org/10.1016/S0927-5398(03)00007-0 doi: 10.1016/S0927-5398(03)00007-0
    [22] D. Bertsimas, J. Pauphilet, B. Van Parys, Sparse classification: a scalable discrete optimization perspective, Mach. Learn., 110 (2021), 3177–3209. https://doi.org/10.1007/s10994-021-06085-5 doi: 10.1007/s10994-021-06085-5
    [23] H. Saishu, K. Kudo, Y. Takano, Cutting-plane algorithm for estimation of sparse Cox proportional hazards models, TOP, 32 (2024), 57–82. https://doi.org/10.1007/s11750-023-00658-4 doi: 10.1007/s11750-023-00658-4
    [24] E. F. Fama, K. R. French, Common risk factors in the returns on stocks and bonds, J. Financ. Econ., 33 (1993), 3–56. https://doi.org/10.1016/0304-405X(93)90023-5 doi: 10.1016/0304-405X(93)90023-5
    [25] E. F. Fama, K. R. French, A five-factor asset pricing model, J. Financ. Econ., 116 (2015), 1–22. https://doi.org/10.1016/j.jfineco.2014.10.010 doi: 10.1016/j.jfineco.2014.10.010
    [26] M. M. Carhart, On persistence in mutual fund performance, J. Finance, 52 (1997), 57–82. https://doi.org/10.1111/j.1540-6261.1997.tb03808.x doi: 10.1111/j.1540-6261.1997.tb03808.x
    [27] K. Tanaka, R. Yamamoto, Ellipsoidal buffered area under the curve maximization model with variable selection in credit risk estimation, Comput. Manag. Sci., 20 (2023), 18. https://doi.org/10.1007/s10287-023-00450-6 doi: 10.1007/s10287-023-00450-6
  • jimo-22-06-101-s001.pdf
  • Reader Comments
  • © 2026 the Author(s), licensee AIMS Press. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0)
通讯作者: 陈斌, bchen63@163.com
  • 1. 

    沈阳化工大学材料科学与工程学院 沈阳 110142

  1. 本站搜索
  2. 百度学术搜索
  3. 万方数据库搜索
  4. CNKI搜索

Metrics

Article views(63) PDF downloads(9) Cited by(0)

Article outline

Figures and Tables

Figures(4)  /  Tables(12)

Other Articles By Authors

/

DownLoad:  Full-Size Img  PowerPoint
Return
Return

Catalog