Recursive Learning of Genetic Algorithm Featuring Incremental Attribute Learning for Higher Dimensional Classification Problems

Rule-based classifiers trained by Genetic Algorithms (GAs) have been one of the most prevailing solutions for pattern classification problem. This paper introduces an algorithm named Recursive Learning of Genetic Algorithms featuring Incremental Attribute Learning (RLGA-IAL) developed from the Recursive Learning of Genetic Algorithms with Task Decomposition and Varied Rule Set (RLGA). Instead of training all the attributes in a batch, RLGA-IAL integrates the attributes sequentially. By projecting a large multidimensional search space to single-dimensional space spaces with integration, it reduces the difficulty in deriving the classification rules.Though a series of experiments, RLGA-IAL shows a successful and promising performance in classification problems with the dimension of the datasets ranging from 5 to 60.

[1]  Lior Rokach,et al.  Top-down induction of decision trees classifiers - a survey , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[2]  Steven Guan,et al.  Incremental Learning with Respect to New Incoming Input Attributes , 2004, Neural Processing Letters.

[3]  Jun Liu,et al.  Incremental Ordered Neural Network Training , 2002 .

[4]  Kishan G. Mehrotra,et al.  Efficient classification for multiclass problems using modular neural networks , 1995, IEEE Trans. Neural Networks.

[5]  Sandip Sen,et al.  Using real-valued genetic algorithms to evolve rule sets for classification , 1994, Proceedings of the First IEEE Conference on Evolutionary Computation. IEEE World Congress on Computational Intelligence.

[6]  Steven Guan,et al.  Recursive hybrid decomposition with reduced pattern training , 2009, Int. J. Hybrid Intell. Syst..

[7]  Sheng-Uei Guan,et al.  Class decomposition for GA-based classifier agents - a Pitt approach , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[8]  Steven Guan,et al.  Reduced Pattern Training In Pattern Distributor Networks , 2007, J. Res. Pract. Inf. Technol..

[9]  Abdullah Al Mamun,et al.  Interference-less neural network training , 2008, Neurocomputing.

[10]  Rich Caruana,et al.  An empirical comparison of supervised learning algorithms , 2006, ICML.

[11]  César Hervás-Martínez,et al.  Multi-objective cooperative coevolution of artificial neural networks (multi-objective cooperative networks) , 2002, Neural Networks.

[12]  Kiruthika Ramanathan,et al.  Percentage-Based Hybrid Pattern Training with Neural Network Specific Cross Over , 2007 .

[13]  Hisao Ishibuchi,et al.  Performance evaluation of fuzzy classifier systems for multidimensional pattern classification problems , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[14]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[15]  Steven Guan,et al.  Recursive Learning of Genetic Algorithms with Task Decomposition and Varied Rule Set , 2011, Int. J. Appl. Evol. Comput..

[16]  Fangming Zhu,et al.  A new approach to mining fuzzy databases using nearest neighbor classification by exploiting attribute hierarchies , 2004 .

[17]  Steven Guan,et al.  Ordered incremental training with genetic algorithms , 2004, Int. J. Intell. Syst..

[18]  Steven Guan,et al.  Recursive Pattern based Hybrid Supervised Training , 2008, Engineering Evolutionary Intelligent Systems.