Evolutionary method combining Particle Swarm Optimisation and Genetic Algorithms using fuzzy logic for parameter adaptation and aggregation: the case neural network optimisation for face recognition

We describe in this paper a new hybrid approach for optimisation combining Particle Swarm Optimisation (PSO) and Genetic Algorithms (GAs) using Fuzzy Logic for parameter adaptation and to integrate the results. The new evolutionary method combines the advantages of PSO and GA to give us an improved FPSO + FGA hybrid method. Fuzzy Logic is used to combine the results of the PSO and GA in the best way possible. Also, fuzzy logic is used to adjust parameters in the FPSO and FGA. The new hybrid FPSO + FGA approach is compared with the PSO and GA methods with a set of benchmark mathematical functions. The proposed hybrid method is also tested with the problem of neural network architecture optimisation. The new hybrid FPSO + FGA method is shown to be superior with respect to the individual evolutionary methods. The tests were made with 2, 4, 8 and 16 variables.

[1]  Oscar Castillo,et al.  Human evolutionary model: A new approach to optimization , 2007, Inf. Sci..

[2]  Peter J. Angeline,et al.  Evolutionary Optimization Versus Particle Swarm Optimization: Philosophy and Performance Differences , 1998, Evolutionary Programming.

[3]  K. S. Tang,et al.  Genetic Algorithms: Concepts and Designs with Disk , 1999 .

[4]  Claus Emmeche,et al.  The garden in the machine: the emerging science of artificial life , 1994 .

[5]  Zheru Chi,et al.  Wavelet-based Illumination Compensation for Face Recognition using Eigenface Method , 2006, 2006 6th World Congress on Intelligent Control and Automation.

[6]  Chuanyi Ji,et al.  Performance and efficiency: recent advances in supervised learning , 1999, Proc. IEEE.

[7]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[8]  Sam Kwong,et al.  Genetic Algorithms : Concepts and Designs , 1998 .

[9]  Oscar Castillo,et al.  Evolutionary Computing for Fuzzy System Optimization in Intelligent Control , 2004, IC-AI.

[10]  Goldberg,et al.  Genetic algorithms , 1993, Robust Control Systems with Genetic Algorithms.

[11]  David B. Fogel,et al.  An introduction to simulated evolutionary optimization , 1994, IEEE Trans. Neural Networks.

[12]  Kalyan Veeramachaneni,et al.  Improving Classifier Fusion Using Particle Swarm Optimization , 2007, 2007 IEEE Symposium on Computational Intelligence in Multi-Criteria Decision-Making.

[13]  Oscar Castillo,et al.  Evolutionary Computing for the Optimization of Mathematical Functions , 2007, Analysis and Design of Intelligent Systems using Soft Computing Techniques.

[14]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[15]  Zbigniew Michalewicz,et al.  Handbook of Evolutionary Computation , 1997 .

[16]  P. Melin,et al.  Comparative Study of Particle Swarm Optimization and Genetic Algorithms for Complex Mathematical Functions , 2008 .

[17]  J. Kennedy,et al.  Population structure and particle swarm performance , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[18]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[19]  Oscar Castillo,et al.  Hierarchical genetic algorithms for topology optimization in fuzzy control systems , 2007, Int. J. Gen. Syst..

[20]  Oscar Castillo,et al.  Hybrid intelligent systems for time series prediction using neural networks, fuzzy logic, and fractal theory , 2002, IEEE Trans. Neural Networks.

[21]  Ian Paul McCarthy.  Simulating Sequential Search Models with Genetic Algorithms: Analysis of Price Ceilings, Taxes, Advertising and Welfare , 2008 .

[22]  P. J. Angeline,et al.  Using selection to improve particle swarm optimization , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[23]  P. Melin,et al.  Parallel Evolutionary Computing using a cluster for Mathematical Function Optimization , 2007, NAFIPS 2007 - 2007 Annual Meeting of the North American Fuzzy Information Processing Society.

[24]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..