A Function-Based Classifier Learning Scheme Using Genetic Programming

Classification is an important research topic in knowledge discovery and data mining. Many different classifiers have been motivated and developed of late years. In this paper, we propose an effective scheme for learning multicategory classifiers based on genetic programming. For a k-class classification problem, a training strategy called adaptive incremental learning strategy and a new fitness function are used to generate k discriminant functions. We urge the discriminant functions to map the domains of training data into a specified interval, and thus data will be assigned into one of the classes by the values of functions. Furthermore, a Z-value measure is developed for resolving the conflicts. The experimental results show that the proposed GP-based classification learning approach is effective and performs a high accuracy of classification.

[1]  Chih-Ming Chen,et al.  An efficient fuzzy classifier with feature selection based on fuzzy entropy , 2001, IEEE Trans. Syst. Man Cybern. Part B.

[2]  Hahn-Ming Lee,et al.  A neural network classifier with disjunctive fuzzy information , 1998, Neural Networks.

[3]  Manabu Kotani,et al.  Emergence of feature extraction function using genetic programming , 1999, 1999 Third International Conference on Knowledge-Based Intelligent Information Engineering Systems. Proceedings (Cat. No.99TH8410).

[4]  Sanjeev R. Kulkarni,et al.  Learning Pattern Classification - A Survey , 1998, IEEE Trans. Inf. Theory.

[5]  Tzung-Pei Hong,et al.  Integrating fuzzy knowledge by genetic algorithms , 1998, IEEE Trans. Evol. Comput..

[6]  Julian F. Miller,et al.  Genetic and Evolutionary Computation — GECCO 2003 , 2003, Lecture Notes in Computer Science.

[7]  Judea Pearl,et al.  Bayesian Networks , 1998, Encyclopedia of Social Network Analysis and Mining. 2nd Ed..

[8]  Hahn-Ming Lee,et al.  A multiclass neural network classifier with fuzzy teaching inputs , 1997, Fuzzy Sets Syst..

[9]  Tzung-Pei Hong,et al.  Automatically integrating multiple rule sets in a distributed-knowledge environment , 1998, IEEE Trans. Syst. Man Cybern. Part C.

[10]  Patrick K. Simpson,et al.  Fuzzy min-max neural networks. I. Classification , 1992, IEEE Trans. Neural Networks.

[11]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[12]  Huan Liu,et al.  Neural-network feature selector , 1997, IEEE Trans. Neural Networks.

[13]  Vipin Kumar,et al.  Text Categorization Using Weight Adjusted k-Nearest Neighbor Classification , 2001, PAKDD.

[14]  Philip J. Stone,et al.  Experiments in induction , 1966 .

[15]  Guoqiang Peter Zhang,et al.  Neural networks for classification: a survey , 2000, IEEE Trans. Syst. Man Cybern. Part C.

[16]  P. K. Simpson Fuzzy Min-Max Neural Networks-Part 1 : Classification , 1992 .

[17]  R. Fisher THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS , 1936 .

[18]  J. Ross Quinlan,et al.  Induction of Decision Trees , 1986, Machine Learning.

[19]  Abdesselam Bouzerdoum,et al.  Automatic selection of features for classification using genetic programming , 1996, 1996 Australian New Zealand Conference on Intelligent Information Systems. Proceedings. ANZIIS 96.

[20]  Rudolf Kruse,et al.  A neuro-fuzzy method to learn fuzzy classification rules from data , 1997, Fuzzy Sets Syst..

[21]  Lalit M. Patnaik,et al.  Application of genetic programming for multicategory pattern classification , 2000, IEEE Trans. Evol. Comput..

[22]  Alex A. Freitas,et al.  A Genetic Programming Framework for Two Data Mining Tasks: Classification and Generalized Rule Induction , 1997 .

[23]  Brian C. Lovell,et al.  The Multiscale Classifier , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Sigeru Omatu,et al.  Neural network approach to land cover mapping , 1994, IEEE Trans. Geosci. Remote. Sens..

[25]  Tzung-Pei Hong,et al.  A fuzzy inductive learning strategy for modular rules , 1999, Fuzzy Sets Syst..

[26]  Alex Alves Freitas,et al.  Discovering comprehensible classification rules by using Genetic Programming: a case study in a medical domain , 1999, GECCO.

[27]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.