Big Data Challenges of High‐Dimensional Continuous‐Time Mean‐Variance Portfolio Selection and a Remedy

Investors interested in the global financial market must analyze financial securities internationally. Making an optimal global investment decision involves processing a huge amount of data for a high-dimensional portfolio. This article investigates the big data challenges of two mean-variance optimal portfolios: continuous-time precommitment and constant-rebalancing strategies. We show that both optimized portfolios implemented with the traditional sample estimates converge to the worst performing portfolio when the portfolio size becomes large. The crux of the problem is the estimation error accumulated from the huge dimension of stock data. We then propose a linear programming optimal (LPO) portfolio framework, which applies a constrained ℓ1 minimization to the theoretical optimal control to mitigate the risk associated with the dimensionality issue. The resulting portfolio becomes a sparse portfolio that selects stocks with a data-driven procedure and hence offers a stable mean-variance portfolio in practice. When the number of observations becomes large, the LPO portfolio converges to the oracle optimal portfolio, which is free of estimation error, even though the number of stocks grows faster than the number of observations. Our numerical and empirical studies demonstrate the superiority of the proposed approach.

[1]  Mark Broadie,et al.  Computing efficient frontiers using estimated parameters , 1993, Ann. Oper. Res..

[2]  T. Cai,et al.  A Constrained ℓ1 Minimization Approach to Sparse Precision Matrix Estimation , 2011, 1102.2233.

[3]  Pietro Millossovich,et al.  Sensitivity Analysis Using Risk Measures , 2014, Risk analysis : an official publication of the Society for Risk Analysis.

[4]  Frank J. Fabozzi,et al.  60 Years of portfolio optimization: Practical challenges and current trends , 2014, Eur. J. Oper. Res..

[5]  P. Bickel,et al.  Some theory for Fisher''s linear discriminant function , 2004 .

[6]  Duan Li,et al.  Optimal Cardinality Constrained Portfolio Selection , 2013, Oper. Res..

[7]  Jianqing Fan,et al.  High dimensional covariance matrix estimation using a factor model , 2007, math/0701124.

[8]  Duan Li,et al.  Optimal Multiperiod Mean-Variance Policy Under No-Shorting Constraint , 2012 .

[9]  Noureddine El Karoui,et al.  On the Realized Risk of High-Dimensional Markowitz Portfolios , 2013, SIAM J. Financial Math..

[10]  Xiangyu Cui,et al.  MEAN‐VARIANCE POLICY FOR DISCRETE‐TIME CONE‐CONSTRAINED MARKETS: TIME CONSISTENCY IN EFFICIENCY AND THE MINIMUM‐VARIANCE SIGNED SUPERMARTINGALE MEASURE , 2014, 1403.0718.

[11]  Olivier Ledoit,et al.  Honey, I Shrunk the Sample Covariance Matrix , 2003 .

[12]  Chi Seng Pun,et al.  High-Dimensional Static and Dynamic Portfolio Selection Problems via ℓ1 Minimization , 2015 .

[13]  Duan Li,et al.  BETTER THAN DYNAMIC MEAN‐VARIANCE: TIME INCONSISTENCY AND FREE CASH FLOW STREAM , 2012 .

[14]  Dimitrina S Dimitrova,et al.  Modeling Finite-Time Failure Probabilities in Risk Analysis Applications. , 2015, Risk analysis : an official publication of the Society for Risk Analysis.

[15]  Jean-Pierre Fouque,et al.  Portfolio Optimization with Ambiguous Correlation and Stochastic Volatilities , 2014 .

[16]  Chi Seng Pun,et al.  Robust Investment-Reinsurance Optimization with Multiscale Stochastic Volatility , 2015 .

[17]  ohn,et al.  CONSUMPTION AND PORTFOLIO DECISIONS WHEN EXPECTED RETURNS ARE TIME VARYING * , 2004 .

[18]  Tsan-Ming Choi,et al.  Mean-variance analysis of a single supplier and retailer supply chain under a returns policy , 2008, Eur. J. Oper. Res..

[19]  Duan Li,et al.  Asset-Liability Management Under the Safety-First Principle , 2009 .

[20]  I. Daubechies,et al.  Sparse and stable Markowitz portfolios , 2007, Proceedings of the National Academy of Sciences.

[21]  Raman Uppal,et al.  A Generalized Approach to Portfolio Optimization: Improving Performance by Constraining Portfolio Norms , 2009, Manag. Sci..

[22]  Daniel Straub,et al.  Cost‐Benefit Analysis for Optimization of Risk Protection Under Budget Constraints , 2015, Risk analysis : an official publication of the Society for Risk Analysis.

[23]  W. Ziemba,et al.  The Effect of Errors in Means, Variances, and Covariances on Optimal Portfolio Choice , 1993 .

[24]  Richard O. Michaud.  The Markowitz Optimization Enigma: Is 'Optimized' Optimal? , 1989 .

[25]  Robert J. Vanderbei,et al.  Linear Programming: Foundations and Extensions , 1998, Kluwer international series in operations research and management service.

[26]  Chi Seng Pun,et al.  Resolution of Degeneracy in Merton's Portfolio Problem , 2016, SIAM J. Financial Math..

[27]  Ke Yu,et al.  Constraints , 2019, Sexual Selection.

[28]  Fei Zou,et al.  Convergence of Sample Eigenvalues, Eigenvectors, and Principal Component Scores for Ultra-High Dimensional Data. , 2014, Biometrika.

[29]  Duan Li,et al.  Asset and liability management under a continuous-time mean–variance optimization framework , 2006 .

[30]  Jianqing Fan,et al.  An Overview of the Estimation of Large Covariance and Precision Matrices , 2015, The Econometrics Journal.

[31]  Hoi Ying Wong,et al.  Mean-variance portfolio selection of cointegrated assets , 2011 .

[32]  Noureddine El Karoui,et al.  High-dimensionality effects in the Markowitz problem and other quadratic programs with linear constraints: Risk underestimation , 2010, 1211.2917.

[33]  Mei Choi Chiu,et al.  Roy’s Safety‐First Portfolio Principle in Financial Risk Management of Disastrous Events , 2012, Risk analysis : an official publication of the Society for Risk Analysis.

[34]  X. Zhou,et al.  Continuous-Time Mean-Variance Portfolio Selection: A Stochastic LQ Framework , 2000 .

[35]  Duan Li,et al.  Optimal Dynamic Portfolio Selection: Multiperiod Mean‐Variance Formulation , 2000 .

[36]  Lorenzo Garlappi,et al.  Portfolio Selection with Parameter and Model Uncertainty: A Multi-Prior Approach , 2004 .

[37]  Mark R Powell,et al.  Risk‐Based Sampling: I Don't Want to Weight in Vain , 2015, Risk analysis : an official publication of the Society for Risk Analysis.

[38]  Victor DeMiguel,et al.  Optimal Versus Naive Diversification: How Inefficient is the 1/N Portfolio Strategy? , 2009 .

[39]  Jianqing Fan,et al.  Large covariance estimation by thresholding principal orthogonal complements , 2011, Journal of the Royal Statistical Society. Series B, Statistical methodology.

[40]  T. Cai,et al.  A Direct Estimation Approach to Sparse Linear Discriminant Analysis , 2011, 1107.3442.

[41]  Duan Li,et al.  OPTIMAL LOT SOLUTION TO CARDINALITY CONSTRAINED MEAN–VARIANCE FORMULATION FOR PORTFOLIO SELECTION , 2006 .

[42]  R. Jagannathan,et al.  Risk Reduction in Large Portfolios: Why Imposing the Wrong Constraints Helps , 2002 .