A memetic model of evolutionary PSO for computational finance applications

Motivated by the compensatory property of EA and PSO, where the latter can enhance solutions generated from the evolutionary operations by exploiting their individual memory and social knowledge of the swarm, this paper examines the implementation of PSO as a local optimizer for fine tuning in evolutionary search. The proposed approach is evaluated on applications from the field of computational finance, namely portfolio optimization and time series forecasting. Exploiting the structural similarity between these two problems and the non-linear fractional knapsack problem, an instance of the latter is generalized and implemented as the preliminary test platform for the proposed EA-PSO hybrid model. The experimental results demonstrate the positive effects of this memetic synergy and reveal general design guidelines for the implementation of PSO as a local optimizer. Algorithmic performance improvements are similarly evident when extending to the real-world optimization problems under the appropriate integration of PSO with EA.

[1]  Y. Rahmat-Samii,et al.  Genetic algorithm (GA) and particle swarm optimization (PSO) in engineering electromagnetics , 2003, 17th International Conference on Applied Electromagnetics and Communications, 2003. ICECom 2003..

[2]  Hisao Ishibuchi,et al.  Balance between genetic search and local search in memetic algorithms for multiobjective permutation flowshop scheduling , 2003, IEEE Trans. Evol. Comput..

[3]  Paulo Cortez,et al.  A Meta-Genetic Algorithm for Time Series Forecasting , 2001 .

[4]  Xin Yao,et al.  A new evolutionary system for evolving artificial neural networks , 1997, IEEE Trans. Neural Networks.

[5]  Hiroaki Kitano,et al.  Empirical Studies on the Speed of Convergence of Neural Network Training Using Genetic Algorithms , 1990, AAAI.

[6]  P. Pirinoli,et al.  Genetical Swarm Optimization (GSO): a class of Population-based Algorithms for Antenna Design , 2006, 2006 First International Conference on Communications and Electronics.

[7]  R. French,et al.  Genes, Phenes and the Baldwin Effect: Learning and Evolution in a Simulated Population , 1994 .

[8]  Y. Rahmat-Samii,et al.  Particle swarm, genetic algorithm, and their hybrids: optimization of a profiled corrugated horn antenna , 2002, IEEE Antennas and Propagation Society International Symposium (IEEE Cat. No.02CH37313).

[9]  Yan Su,et al.  A Particle Swarm Optimisation Approach in the Construction of Optimal Risky Portfolios , 2005, Artificial Intelligence and Applications.

[10]  Ajith Abraham,et al.  Performance tuning of evolutionary algorithms using particle sub swarms , 2005, Seventh International Symposium on Symbolic and Numeric Algorithms for Scientific Computing (SYNASC'05).

[11]  Lothar Thiele,et al.  Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach , 1999, IEEE Trans. Evol. Comput..

[12]  Abdullah Al Mamun,et al.  A realistic approach to evolutionary multiobjective portfolio optimization , 2007, 2007 IEEE Congress on Evolutionary Computation.

[13]  Germano Lambert-Torres,et al.  Hybrid Evolutionary Algorithm Based on PSO and GA Mutation , 2006, 2006 Sixth International Conference on Hybrid Intelligent Systems (HIS'06).

[14]  John E. Beasley,et al.  OR-Library: Distributing Test Problems by Electronic Mail , 1990 .

[15]  Peter M. Todd,et al.  Designing Neural Networks using Genetic Algorithms , 1989, ICGA.

[16]  Lawrence Davis,et al.  Training Feedforward Neural Networks Using Genetic Algorithms , 1989, IJCAI.

[17]  Kiyoshi Tanaka,et al.  Controlling Dominance Area of Solutions and Its Impact on the Performance of MOEAs , 2007, EMO.

[18]  Natalio Krasnogor,et al.  Studies on the theory and design space of memetic algorithms , 2002 .

[19]  Kevin Kok Wai Wong,et al.  Classification of adaptive memetic algorithms: a comparative study , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[20]  Piero P. Bonissone,et al.  Multiobjective financial portfolio design: a hybrid evolutionary approach , 2005, 2005 IEEE Congress on Evolutionary Computation.

[21]  Abdullah Al Mamun,et al.  Multiobjective Evolutionary Neural Networks for Time Series Forecasting , 2006, EMO.

[22]  Ning Xu,et al.  Application of an EACS algorithm to obstacle detour routing in VLSI physical design , 2003, Proceedings of the 2003 International Conference on Machine Learning and Cybernetics (IEEE Cat. No.03EX693).

[23]  Andreas Zell,et al.  Evolutionary Algorithms and the Cardinality Constrained Portfolio Optimization Problem , 2004 .

[24]  W. Hart.  Adaptive global optimization with local search , 1994 .

[25]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[26]  Aimo A. Törn,et al.  Global Optimization , 1999, Science.

[27]  Michael P. SanSoucie,et al.  Evolving High-Performance Evolutionary Computations for Space Vehicle Design , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[28]  P. J. Angeline,et al.  Using selection to improve particle swarm optimization , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[29]  Minqiang Li,et al.  A Genetic Algorithm for Solving Portfolio Optimization Problems with Transaction Costs and Minimum Transaction Lots , 2005, ICNC.

[30]  Fred L. Collopy,et al.  Error Measures for Generalizing About Forecasting Methods: Empirical Comparisons , 1992 .

[31]  Peter G. Korning,et al.  Training neural networks by means of genetic algorithms working on very long chromosomes , 1995, Int. J. Neural Syst..

[32]  Xin Yao,et al.  Evolving artificial neural networks , 1999, Proc. IEEE.

[33]  P. Pirinoli,et al.  Genetical Swarm Optimization: a New Hybrid Evolutionary Algorithm for Electromagnetic Applications , 2005, 2005 18th International Conference on Applied Electromagnetics and Communications.

[34]  Kim W. C. Ku,et al.  Approaches to combining local and evolutionary search for training neural networks: a review and some new results , 2003 .

[35]  René Thomsen,et al.  A comparative study of differential evolution, particle swarm optimization, and evolutionary algorithms on numerical benchmark problems , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[36]  Chia-Feng Juang,et al.  On the hybrid of genetic algorithm and particle swarm optimization for evolving recurrent neural network , 2004, 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541).

[37]  Wei Liu,et al.  An Ant Colony Optimization Algorithm with Evolutionary Operator for Traveling Salesman Problem , 2006, Sixth International Conference on Intelligent Systems Design and Applications.

[38]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[39]  P. Pirinoli,et al.  Optimization of a reflectarray antenna via hybrid evolutionary algorithms , 2006, 2006 17th International Zurich Symposium on Electromagnetic Compatibility.

[40]  J.A. Ramirez,et al.  Optimization of Cost Functions Using Evolutionary Algorithms With Local Learning and Local Search , 2006, IEEE Transactions on Magnetics.

[41]  Bala Shetty,et al.  The nonlinear knapsack problem - algorithms and applications , 2002, Eur. J. Oper. Res..

[42]  Geoffrey E. Hinton,et al.  How Learning Can Guide Evolution , 1996, Complex Syst..

[43]  Heinz Mühlenbein,et al.  The parallel genetic algorithm as function optimizer , 1991, Parallel Comput..

[44]  Saeid Nahavandi,et al.  Hybrid ant colony algorithm for texture classification , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[45]  L. Darrell Whitley,et al.  Lamarckian Evolution, The Baldwin Effect and Function Optimization , 1994, PPSN.

[46]  Yingtao Jiang,et al.  A novel evolutionary algorithm for analog VLSI layout placement design , 2004, The 2nd Annual IEEE Northeast Workshop on Circuits and Systems, 2004. NEWCAS 2004..

[47]  Jonathan E. Fieldsend,et al.  Pareto evolutionary neural networks , 2005, IEEE Transactions on Neural Networks.

[48]  Marco Laumanns,et al.  Performance assessment of multiobjective optimizers: an analysis and review , 2003, IEEE Trans. Evol. Comput..

[49]  J. Basterrechea,et al.  Comparison of Different Heuristic Optimization Methods for Near-Field Antenna Measurements , 2007, IEEE Transactions on Antennas and Propagation.

[50]  David G. Stork,et al.  Evolution and Learning in Neural Networks: The Number and Distribution of Learning Trials Affect the Rate of Evolution , 1990, NIPS 1990.

[51]  Paulo Cortez,et al.  Evolving Time Series Forecasting Neural Network Models , 2001 .

[52]  Andy J. Keane,et al.  Combining Global and Local Surrogate Models to Accelerate Evolutionary Optimization , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[53]  David H. Ackley,et al.  Interactions between learning and evolution , 1991 .

[54]  Bu-Sung Lee,et al.  Memetic algorithm using multi-surrogates for computationally expensive optimization problems , 2007, Soft Comput..

[55]  Lawrence Davis,et al.  Shall We Repair? Genetic AlgorithmsCombinatorial Optimizationand Feasibility Constraints , 1993, ICGA.

[56]  R. Belew,et al.  Evolutionary algorithms with local search for combinatorial optimization , 1998 .

[57]  K.Y. Lee,et al.  Multi-objective VAr Planning with SVC for a Large Power System Using PSO and GA , 2006, 2006 IEEE PES Power Systems Conference and Exposition.

[58]  A. Skinner,et al.  Neural networks in computational materials science: training algorithms , 1995 .

[59]  Andy J. Keane,et al.  Meta-Lamarckian learning in memetic algorithms , 2004, IEEE Transactions on Evolutionary Computation.

[60]  Chia-Feng Juang,et al.  TSK-type recurrent fuzzy network design by the hybrid of genetic algorithm and particle swarm optimization , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[61]  Pinaki Mazumder,et al.  A genetic approach to standard cell placement using meta-genetic parameter optimization , 1990, IEEE Trans. Comput. Aided Des. Integr. Circuits Syst..

[62]  Heinrich Braun,et al.  ENZO-M - A Hybrid Approach for Optimizing Neural Networks by Evolution and Learning , 1994, PPSN.

[63]  Chia-Feng Juang,et al.  A hybrid of genetic algorithm and particle swarm optimization for recurrent network design , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[64]  A. Stuart,et al.  Portfolio Selection: Efficient Diversification of Investments , 1959 .

[65]  Luiz Eduardo Soares de Oliveira,et al.  Multi-objective Genetic Algorithms to Create Ensemble of Classifiers , 2005, EMO.

[66]  Nian Zhang,et al.  Time series prediction with recurrent neural networks trained by a hybrid PSO-EA algorithm , 2004, Neurocomputing.