Hybrid Approaches and Dimensionality Reduction for Portfolio Selection with Cardinality Constraints

A novel memetic algorithm that combines evolutionary algorithms, quadratic programming, and specially devised pruning heuristics is proposed for the selection of cardinality-constrained optimal portfolios. The framework used is the standard Markowitz mean-variance formulation for portfolio optimization with constraints of practical interest, such as minimum and maximum investments per asset and/or on groups of assets. Imposing limits on the number of different assets that can be included in the investment transforms portfolio selection into an NP-complete mixed-integer quadratic optimization problem that is difficult to solve by standard methods. An implementation of the algorithm that employs a genetic algorithm with a set representation, an appropriately defined mutation operator and Random Assortment Recombination for crossover (RAR-GA) is compared with implementations using Simulated Annealing (SA) and various Estimation of Distribution Algorithms (EDAs). An empirical investigation of the performance of the portfolios selected with these different methods using financial data shows that RAR-GA and SA are superior to the implementations with EDAs in terms of both accuracy and efficiency. The use of pruning heuristics that effectively reduce the dimensionality of the problem by identifying and eliminating from the universe of investment assets that are not expected to appear in the optimal portfolio leads to significant improvements in performance and makes EDAs competitive with RAR-GA and SA.

[1]  John E. Beasley,et al.  OR-Library: Distributing Test Problems by Electronic Mail , 1990 .

[2]  Gary G. Yen Evolutionary multiobjective optimization [Editor's remarks] , 2009, IEEE Comput. Intell. Mag..

[3]  Bernhard Sendhoff,et al.  Emergent Technology Technical Committee [Society Briefs] , 2007, IEEE Comput. Intell. Mag..

[4]  M. Gilli,et al.  A Global Optimization Heuristic for Portfolio Choice with VaR and Expected Shortfall , 2002 .

[5]  Jan van den Berg,et al.  Optimized index tracking using a hybrid genetic algorithm , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[6]  Yazid M. Sharaiha,et al.  Heuristics for cardinality constrained portfolio optimisation , 2000, Comput. Oper. Res..

[7]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[8]  Michael A. Saunders,et al.  Inertia-Controlling Methods for General Quadratic Programming , 1991, SIAM Rev..

[9]  Andreas Zell,et al.  Evaluating a hybrid encoding and three crossover operators on the constrained portfolio selection problem , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[10]  G. Mitra,et al.  Computational aspects of alternative portfolio selection models in the presence of discrete asset choice constraints , 2001 .

[11]  J. A. Lozano,et al.  Estimation of Distribution Algorithms: A New Tool for Evolutionary Computation , 2001 .

[12]  Yves Crama,et al.  Simulated annealing for complex portfolio selection problems , 2003, Eur. J. Oper. Res..

[13]  Alberto Suárez,et al.  Selection of Optimal Investment Portfolios with Cardinality Constraints , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[14]  Andrea Schaerf,et al.  Local Search Techniques for Constrained Portfolio Selection Problems , 2001, ArXiv.

[15]  Alberto Su Use of Heuristic Rules in Evolutionary Methods for the Selection of Optimal Investment Portfolios , 2007 .

[16]  Heinz Mühlenbein,et al.  The Equation for Response to Selection and Its Use for Prediction , 1997, Evolutionary Computation.

[17]  Olivier Ledoit,et al.  A well-conditioned estimator for large-dimensional covariance matrices , 2004 .

[18]  Nicholas J. Radcliffe,et al.  Genetic Set Recombination , 1992, FOGA.

[19]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[20]  Kuang Yu Huang,et al.  A hybrid model for stock market forecasting and portfolio selection based on ARX, grey system and RS theories , 2009, Expert Syst. Appl..

[21]  Lakhmi C. Jain,et al.  Evolutionary Multiobjective Optimization , 2005, Evolutionary Multiobjective Optimization.

[22]  Daniel Bienstock,et al.  Computational study of a family of mixed-integer quadratic programming problems , 1995, Math. Program..

[23]  R. Fletcher Practical Methods of Optimization , 1988 .

[24]  Michèle Sebag,et al.  Extending Population-Based Incremental Learning to Continuous Search Spaces , 1998, PPSN.

[25]  Shumeet Baluja,et al.  A Method for Integrating Genetic Search Based Function Optimization and Competitive Learning , 1994 .

[26]  Shoichi Hasegawa,et al.  Development and investigation of efficient GA/PSO-HYBRID algorithm applicable to real-world design optimization , 2009, IEEE Comput. Intell. Mag..

[27]  E. Takeda,et al.  Bicriteria Optimization Problem of Designing an Index Fund , 1995 .

[28]  Carlos A. Coello Coello,et al.  Evolutionary multi-objective optimization: a historical view of the field , 2006, IEEE Comput. Intell. Mag..

[29]  R. K. Shyamasundar,et al.  Introduction to algorithms , 1996 .

[30]  Stephen P. Boyd,et al.  Portfolio optimization with linear and fixed transaction costs , 2007, Ann. Oper. Res..

[31]  Pablo Moscato,et al.  Memetic algorithms: a short introduction , 1999 .

[32]  R. Jeurissen,et al.  Index tracking using a hybrid genetic algorithm , 2005, 2005 ICSC Congress on Computational Intelligence Methods and Applications.

[33]  Felix Streichert,et al.  The Effect of Local Search on the Constrained Portfolio Selection Problem , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[34]  Fred W. Glover,et al.  Future paths for integer programming and links to artificial intelligence , 1986, Comput. Oper. Res..

[35]  Zbigniew Michalewicz,et al.  Genetic Algorithms + Data Structures = Evolution Programs , 1992, Artificial Intelligence.

[36]  J. Shapcott Index Tracking : Genetic Algorithms for Investment Portfolio Selection , 2002 .

[37]  R. Fletcher,et al.  Practical Methods of Optimization: Fletcher/Practical Methods of Optimization , 2000 .

[38]  S. Bonissone,et al.  Evolutionary Multiobjective Optimization on a Chip , 2007, 2007 IEEE Workshop on Evolvable and Adaptive Hardware (WEAH2007).

[39]  Rich Caruana,et al.  Removing the Genetics from the Standard Genetic Algorithm , 1995, ICML.

[40]  Eckart Zitzler,et al.  Evolutionary multi-objective optimization , 2007, Eur. J. Oper. Res..