The maximal predictability portfolio (MPP) is a portfolio optimization framework that explicitly incorporates return predictability into the objective function. While MPP has been shown to achieve favorable empirical performance, it is prone to overfitting when using rich sets of candidate assets and factors. To address this issue, we study a cardinality-constrained MPP formulation with an $ \ell_2 $ regularization term and investigate how regularization reshapes the structure and out-of-sample behavior of MPP. The resulting formulation leads to a challenging optimization problem involving binary variables and nonconvex constraints. We show that, through an appropriate bilevel reformulation, the problem can be handled within the cutting-plane algorithm (CPA) framework. In particular, by exploiting a globally optimal solution of the primal lower-level problem, we derive an equivalent convex formulation that preserves the finite termination and $ \varepsilon $-optimality guarantees of CPA. We also derive a subgradient expression tailored to the MPP structure, which enables the construction of valid cutting planes despite the nonconvexity of the original formulation. For practical large-scale computation, we further incorporate normalized linearization as a heuristic accelerator for the lower-level problem, which improves tractability. However, the exact finite termination and $ \varepsilon $-optimality guarantees of CPA no longer directly apply. Numerical experiments demonstrate that the proposed approach, combined with normalized linearization, can efficiently compute high-quality solutions for large-scale instances where exact methods become computationally impractical. The results further illustrate that moderate $ \ell_2 $ regularization improves out-of-sample predictability, whereas excessive regularization diminishes the predictive structure of MPP. Overall, our findings highlight the role of $ \ell_2 $ regularization in balancing predictability, stability, and practical feasibility within the MPP framework.
Citation: Katsuhiro Tanaka, Rei Yamamoto. Cardinality-constrained maximal predictability portfolios with an $ \ell_2 $ regularization[J]. Journal of Industrial and Management Optimization, 2026, 22(6): 2755-2783. doi: 10.3934/jimo.2026101
The maximal predictability portfolio (MPP) is a portfolio optimization framework that explicitly incorporates return predictability into the objective function. While MPP has been shown to achieve favorable empirical performance, it is prone to overfitting when using rich sets of candidate assets and factors. To address this issue, we study a cardinality-constrained MPP formulation with an $ \ell_2 $ regularization term and investigate how regularization reshapes the structure and out-of-sample behavior of MPP. The resulting formulation leads to a challenging optimization problem involving binary variables and nonconvex constraints. We show that, through an appropriate bilevel reformulation, the problem can be handled within the cutting-plane algorithm (CPA) framework. In particular, by exploiting a globally optimal solution of the primal lower-level problem, we derive an equivalent convex formulation that preserves the finite termination and $ \varepsilon $-optimality guarantees of CPA. We also derive a subgradient expression tailored to the MPP structure, which enables the construction of valid cutting planes despite the nonconvexity of the original formulation. For practical large-scale computation, we further incorporate normalized linearization as a heuristic accelerator for the lower-level problem, which improves tractability. However, the exact finite termination and $ \varepsilon $-optimality guarantees of CPA no longer directly apply. Numerical experiments demonstrate that the proposed approach, combined with normalized linearization, can efficiently compute high-quality solutions for large-scale instances where exact methods become computationally impractical. The results further illustrate that moderate $ \ell_2 $ regularization improves out-of-sample predictability, whereas excessive regularization diminishes the predictive structure of MPP. Overall, our findings highlight the role of $ \ell_2 $ regularization in balancing predictability, stability, and practical feasibility within the MPP framework.
| [1] |
A. Lo, K. MacKinlay, Maximizing predictability in the stock and bond markets, Macroecon. Dyn., 1 (1997), 102–134. https://doi.org/10.1017/S1365100597002046 doi: 10.1017/S1365100597002046
|
| [2] | P. G. Coulombe, M. Göebel, Maximally machine-learnable portfolios, SSRN working paper, 2023. http://doi.org/10.2139/ssrn.4428178 |
| [3] |
R. Yamamoto, D. Ishii, H. Konno, A maximal predictability portfolio model: Algorithm and performance evaluation, Int. J. Theor. Appl. Finance, 10 (2007), 1095–1109. https://doi.org/10.1142/S0219024907004561 doi: 10.1142/S0219024907004561
|
| [4] |
R. D. Harris, J. Shen, F. Yilmaz, Maximally predictable currency portfolios, J. Int. Money Finance, 128 (2022), 102702. https://doi.org/10.1016/j.jimonfin.2022.102702 doi: 10.1016/j.jimonfin.2022.102702
|
| [5] | B. Q. Ta, V. T. Huynh, K. Q. H. Nguyen, P. N. Nguyen, B. H. Ho, Maximal predictability portfolio optimization model and applications to vietnam stock market, in Credible Asset Allocation, Optimal Transport Methods, and Related Topics, vol. 429 of Studies in Systems, Decision and Control. Springer International Publishing, 2022,559–578. https://doi.org/10.1007/978-3-030-97273-8_37 |
| [6] |
K. Tanaka, R. Yamamoto, An efficient approach for maximal predictability portfolio with cardinality constraints (in Japanese), Trans. Oper. Res. Soc. Jpn., 66 (2023), 1–22. https://doi.org/10.15807/torsj.66.1 doi: 10.15807/torsj.66.1
|
| [7] |
H. Konno, Y. Morita, R. Yamamoto, A maximal predictability portfolio using absolute deviation reformulation, Comput. Manag. Sci., 7 (2010), 47–60. https://doi.org/10.1007/s10287-008-0075-2 doi: 10.1007/s10287-008-0075-2
|
| [8] |
H. Konno, Y. Takaya, R. Yamamoto, A maximal predictability portfolio using dynamic factor selection strategy, Int. J. Theor. Appl. Finance, 13 (2010), 355–366. https://doi.org/10.1142/S0219024910005802 doi: 10.1142/S0219024910005802
|
| [9] |
A. E. Hoerl, R. W. Kennard, Ridge regression: Biased estimation for nonorthogonal problems, Technometrics, 12 (1970), 55–67. https://doi.org/10.2307/1267351 doi: 10.2307/1267351
|
| [10] |
J. Gotoh, A. Takeda, On the role of norm constraints in portfolio selection, Comput. Manag. Sci., 8 (2011), 323–353. https://doi.org/10.1007/s10287-011-0130-2 doi: 10.1007/s10287-011-0130-2
|
| [11] | B. Bruder, N. Gaussel, J. Richard, T. Roncalli, Regularization of portfolio allocation, SSRN working paper, 2013. http://doi.org/10.2139/ssrn.2767358 |
| [12] |
V. DeMiguel, L. Garlappi, F. Nogales, R. Uppal, A generalized approach to portfolio optimization: Improving performance by constraining portfolio norms, Manag. Sci., 55 (2009), 798–812. https://doi.org/10.1287/mnsc.1080.0986 doi: 10.1287/mnsc.1080.0986
|
| [13] |
A. Takeda, M. Niranjan, J. Gotoh, Y. Kawahara, Simultaneous pursuit of out-of-sample performance and sparsity in index tracking portfolios, Comput. Manag. Sci., 10 (2013), 21–49. https://doi.org/10.1007/s10287-012-0158-y doi: 10.1007/s10287-012-0158-y
|
| [14] |
D. Bertsimas, R. Cory-Wright, A scalable algorithm for sparse portfolio selection, INFORMS J. Comput., 34 (2022), 1489–1511. https://doi.org/10.1287/ijoc.2021.1127 doi: 10.1287/ijoc.2021.1127
|
| [15] |
K. Kobayashi, Y. Takano, K. Nakata, Bilevel cutting-plane algorithm for cardinality-constrained mean-CVaR portfolio optimization, J. Global Optim., 81 (2021), 498–528. https://doi.org/10.1007/s10898-021-01048-5 doi: 10.1007/s10898-021-01048-5
|
| [16] |
K. Kobayashi, Y. Takano, K. Nakata, Cardinality-constrained distributionally robust portfolio optimization, Eur. J. Oper. Res., 309 (2023), 1173–1182. https://doi.org/10.1016/j.ejor.2023.01.037 doi: 10.1016/j.ejor.2023.01.037
|
| [17] |
S. Wang, L. Pang, S. Wang, H. Zhang, Distributionally robust mean-CVaR portfolio optimization with cardinality constraint, J. Oper. Res. Soc. China, 14 (2026), 179–209. https://doi.org/10.1007/s40305-023-00512-1 doi: 10.1007/s40305-023-00512-1
|
| [18] | D. Bertsimas, R. Cory-Wright, J. Pauphilet, Solving large-scale sparse PCA to certifiable (near) optimality, J. Mach. Learn. Res., 23 (2022), 1–35. |
| [19] |
D. Bertsimas, J. Lamperski, J. Pauphilet, Certifiably optimal sparse inverse covariance estimation, Math. Program., 184 (2020), 491–530. https://doi.org/10.1007/s10107-019-01419-7 doi: 10.1007/s10107-019-01419-7
|
| [20] |
J. Gotoh, K. Fujisawa, Convex optimization approaches to maximally predictable portfolio selection, Optimization, 63 (2014), 1713–1735. https://doi.org/10.1080/02331934.2012.741237 doi: 10.1080/02331934.2012.741237
|
| [21] |
O. Ledoit, M. Wolf, Improved estimation of the covariance matrix of stock returns with an application to portfolio selection, J. Empir. Finance, 10 (2003), 603–621. https://doi.org/10.1016/S0927-5398(03)00007-0 doi: 10.1016/S0927-5398(03)00007-0
|
| [22] |
D. Bertsimas, J. Pauphilet, B. Van Parys, Sparse classification: a scalable discrete optimization perspective, Mach. Learn., 110 (2021), 3177–3209. https://doi.org/10.1007/s10994-021-06085-5 doi: 10.1007/s10994-021-06085-5
|
| [23] |
H. Saishu, K. Kudo, Y. Takano, Cutting-plane algorithm for estimation of sparse Cox proportional hazards models, TOP, 32 (2024), 57–82. https://doi.org/10.1007/s11750-023-00658-4 doi: 10.1007/s11750-023-00658-4
|
| [24] |
E. F. Fama, K. R. French, Common risk factors in the returns on stocks and bonds, J. Financ. Econ., 33 (1993), 3–56. https://doi.org/10.1016/0304-405X(93)90023-5 doi: 10.1016/0304-405X(93)90023-5
|
| [25] |
E. F. Fama, K. R. French, A five-factor asset pricing model, J. Financ. Econ., 116 (2015), 1–22. https://doi.org/10.1016/j.jfineco.2014.10.010 doi: 10.1016/j.jfineco.2014.10.010
|
| [26] |
M. M. Carhart, On persistence in mutual fund performance, J. Finance, 52 (1997), 57–82. https://doi.org/10.1111/j.1540-6261.1997.tb03808.x doi: 10.1111/j.1540-6261.1997.tb03808.x
|
| [27] |
K. Tanaka, R. Yamamoto, Ellipsoidal buffered area under the curve maximization model with variable selection in credit risk estimation, Comput. Manag. Sci., 20 (2023), 18. https://doi.org/10.1007/s10287-023-00450-6 doi: 10.1007/s10287-023-00450-6
|
jimo-22-06-101-s001.pdf |
![]() |