A classification method using a hybrid genetic algorithm combined with an adaptive procedure for the pool of ellipsoids

This paper presents a hybrid classification method that utilizes genetic algorithms (GAs) and adaptive operations of ellipsoidal regions for multidimensional pattern classification problems with continuous features. The classification method fits a finite number of the ellipsoidal regions to data pattern by using hybrid GAs, the combination of local improvement procedures and GAs. The local improvement method adaptively expands, rotates, shrinks, and/or moves the ellipsoids while each ellipsoid is separately handled with a fitness value assigned during the GA operations. A set of significant features for the ellipsoids are automatically determined in the hybrid GA procedure by introducing “don’t care” bits to encode the chromosomes. The performance of the method is evaluated on well-known data sets and a real field classification problem originated from a deflection yoke production line. The evaluation results show that the proposed method can exert superior performance to other classification methods such as k nearest neighbor, decision trees, or neural networks.

[1]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[2]  Myung-Kuk Park,et al.  Using case based reasoning for problem solving in a complex production process , 1998 .

[3]  Wan Chul Yoon,et al.  Automating the Diagnosis and Rectification of Deflection Yoke Production Using Hybrid Knowledge Acquisition and Case-Based Reasoning , 2001, Applied Intelligence.

[4]  P. K. Simpson Fuzzy Min-Max Neural Networks-Part 1 : Classification , 1992 .

[5]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[6]  Shigeo Abe,et al.  A neural-network-based fuzzy classifier , 1995, IEEE Trans. Syst. Man Cybern..

[7]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[8]  Jean-Michel Renders,et al.  Hybrid methods using genetic algorithms for global optimization , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[9]  Qiuming Zhu,et al.  A multiple hyper-ellipsoidal subclass model for an evolutionary classifier , 2001, Pattern Recognit..

[10]  Patrick K. Simpson,et al.  Fuzzy min-max neural networks. I. Classification , 1992, IEEE Trans. Neural Networks.

[11]  Nostrand Reinhold,et al.  the utility of using the genetic algorithm approach on the problem of Davis, L. (1991), Handbook of Genetic Algorithms. Van Nostrand Reinhold, New York. , 1991 .

[12]  James R. Wilson,et al.  Empirical Investigation of the Benefits of Partial Lamarckianism , 1997, Evolutionary Computation.

[13]  Roy George,et al.  A variable-length genetic algorithm for clustering and classification , 1995, Pattern Recognit. Lett..

[14]  Sanghamitra Bandyopadhyay,et al.  Genetic algorithms for generation of class boundaries , 1998, IEEE Trans. Syst. Man Cybern. Part B.

[15]  Shigeo Abe,et al.  A fuzzy classifier with ellipsoidal regions , 1997, IEEE Trans. Fuzzy Syst..

[16]  Shigeo Abe,et al.  A fuzzy classifier with ellipsoidal regions for diagnosis problems , 1999, IEEE Trans. Syst. Man Cybern. Part C.

[17]  Mitsuo Gen,et al.  Genetic algorithms and engineering design , 1997 .

[18]  Wan Chul Yoon,et al.  Adaptive classification with ellipsoidal regions for multidimensional pattern classification problems , 2005, Pattern Recognit. Lett..

[19]  James R. Nolan,et al.  Computer Systems That Learn: an Empirical Study of the Effect of Noise on the Performance of Three Classification Methods Computer Systems That Learn: an Empirical Study of the Effect of Noise on the Performance of Three Classification Methods , 2022 .

[20]  Shigeo Abe,et al.  A method for fuzzy rules extraction directly from numerical data and its application to pattern classification , 1995, IEEE Trans. Fuzzy Syst..

[21]  Sholom M. Weiss,et al.  Computer Systems That Learn , 1990 .

[22]  Mineichi Kudo,et al.  Comparison of algorithms that select features for pattern classifiers , 2000, Pattern Recognit..

[23]  Yoram Baram,et al.  A geometric approach to consistent classification , 2000, Pattern Recognit..

[24]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[25]  Lawrence. Davis,et al.  Handbook Of Genetic Algorithms , 1990 .

[26]  Larry J. Eshelman,et al.  The CHC Adaptive Search Algorithm: How to Have Safe Search When Engaging in Nontraditional Genetic Recombination , 1990, FOGA.

[27]  Sanghamitra Bandyopadhyay,et al.  Pattern classification using genetic algorithms: Determination of H , 1998, Pattern Recognit. Lett..

[28]  Anil K. Jain,et al.  Statistical Pattern Recognition: A Review , 2000, IEEE Trans. Pattern Anal. Mach. Intell..