Multi-Objective Hierarchical Genetic Algorithm for Modular Granular Neural Network Optimization

In this paper we propose a multi-objective hierarchical genetic algorithm (MOHGA) for modular neural network optimization. A granular approach is used due to the fact that the dataset is divided into granules or sub modules. The main objective of this method is to know the optimal number of sub modules or granules, but also allow the optimization of the number of hidden layers, number of neurons per hidden layer, error goal and learning algorithms per module. The proposed MOHGA is based on the Micro genetic algorithm and was tested for a pattern recognition application. Simulation results show that the proposed modular neural network approach offers advantages over existing neural network models.

[1]  Oscar Castillo,et al.  Face Recognition With an Improved Interval Type-2 Fuzzy Logic Sugeno Integral and Modular Neural Networks , 2011, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[2]  Yiyu Yao,et al.  A Partition Model of Granular Computing , 2004, Trans. Rough Sets.

[3]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems , 2002, Genetic Algorithms and Evolutionary Computation.

[4]  JingTao Yao.  A Ten-year Review of Granular Computing , 2007 .

[5]  Witold Pedrycz,et al.  The design of fuzzy information granules: Tradeoffs between specificity and experimental evidence , 2009, Appl. Soft Comput..

[6]  Oscar Castillo,et al.  Interval type-2 fuzzy logic and modular neural networks for face recognition applications , 2009, Appl. Soft Comput..

[7]  S. Pratishthananda,et al.  Fuzzy supervisory PI controller using hierarchical genetic algorithms , 2004, 2004 5th Asian Control Conference (IEEE Cat. No.04EX904).

[8]  David Coley,et al.  Introduction to Genetic Algorithms for Scientists and Engineers , 1999 .

[9]  Oscar Castillo,et al.  Hybrid Intelligent Systems for Pattern Recognition Using Soft Computing - An Evolutionary Approach for Neural Networks and Fuzzy Systems , 2005, Studies in Fuzziness and Soft Computing.

[10]  Farooq Azam,et al.  Biologically Inspired Modular Neural Networks , 2000 .

[11]  Jingtao Yao,et al.  Information granulation and granular relationships , 2005, 2005 IEEE International Conference on Granular Computing.

[12]  Andrzej Bargiela,et al.  The roots of granular computing , 2006, 2006 IEEE International Conference on Granular Computing.

[13]  Patricia Melin,et al.  Modular Neural Network with Fuzzy Integration and Its Optimization Using Genetic Algorithms for Human Recognition Based on Iris, Ear and Voice Biometrics , 2010, Soft Computing for Recognition Based on Biometrics.

[14]  Patricia Melin,et al.  Bio-inspired Hybrid Intelligent Systems for Image Analysis and Pattern Recognition , 2009, Bio-inspired Hybrid Intelligent Systems for Image Analysis and Pattern Recognition.

[15]  Oscar Castillo,et al.  Genetic optimization of modular neural networks with fuzzy response integration for human recognition , 2012, Inf. Sci..

[16]  Asif Ullah Khan,et al.  Classification of Stocks Using Self Organizing Map , 2009 .

[17]  Luís A. Alexandre,et al.  Modular Neural Network Task Decomposition Via Entropic Clustering , 2006, Sixth International Conference on Intelligent Systems Design and Applications.

[18]  Kim-Fung Man,et al.  Minimal fuzzy memberships and rules using hierarchical genetic algorithms , 1998, IEEE Trans. Ind. Electron..

[19]  Mohamed S. Kamel,et al.  Modular neural networks: a survey. , 1999, International journal of neural systems.

[20]  Peter J. Fleming,et al.  Genetic Algorithms for Multiobjective Optimization: FormulationDiscussion and Generalization , 1993, ICGA.

[21]  Christine M. Anderson-Cook.  Practical Genetic Algorithms (2nd ed.) , 2005 .

[22]  P. Szczepaniak,et al.  E-Commerce and Intelligent Methods , 2002 .

[23]  Yoshiki Uchikawa,et al.  A study on the discovery of relevant fuzzy rules using pseudobacterial genetic algorithm , 1999, IEEE Trans. Ind. Electron..

[24]  Oscar Castillo,et al.  Type-1 and Type-2 Fuzzy Inference Systems as Integration Methods in Modular Neural Networks for Multimodal Biometry and Its Optimization with Genetic Algorithms , 2009, Soft Computing for Hybrid Intelligent Systems.

[25]  Yiyu Yao,et al.  On modeling data mining with granular computing , 2001, 25th Annual International Computer Software and Applications Conference. COMPSAC 2001.

[26]  William Y. C. Soh,et al.  A hierarchical genetic algorithm for path planning in a static environment with obstacles , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[27]  Samir Kouro,et al.  Unidimensional Modulation Technique for Cascaded Multilevel Converters , 2009, IEEE Transactions on Industrial Electronics.

[28]  Oscar Castillo,et al.  An improved method for edge detection based on interval type-2 fuzzy logic , 2010, Expert Syst. Appl..

[29]  Salvatore Greco,et al.  Evolutionary Multi-Criterion Optimization , 2011, Lecture Notes in Computer Science.

[30]  Jian Yu,et al.  A New Improved K-Means Algorithm with Penalized Term , 2007 .

[31]  Yiyu Yao,et al.  Granular Computing: basic issues and possible solutions , 2007 .

[32]  Carlos A. Coello Coello,et al.  A Micro-Genetic Algorithm for Multiobjective Optimization , 2001, EMO.

[33]  Patricia Melin,et al.  A hybrid approach for image recognition combining type-2 fuzzy logic, modular neural networks and the Sugeno integral , 2009, Inf. Sci..

[34]  Yiyu Yao,et al.  Perspectives of granular computing , 2005, 2005 IEEE International Conference on Granular Computing.

[35]  Jerzy W. Grzymala-Busse,et al.  Transactions on Rough Sets I , 2004, Lecture Notes in Computer Science.