An evolutionary fuzzy genetic and Naïve Bayesian approach for multivariate data classification

Over past few decades, statistical and soft-computing techniques have become an emerging research area for machine learning problems. Fuzzy logic with better generalization capability and rapport with reality is being used in classification problems immensely. In this paper a fuzzy rule based classification system is modeled as a combinatorial optimization problem. Thus the optimization power of Genetic Algorithm has been applied to select a small number of significant fuzzy rules for a compact classification system applied to multivariate dataset classification. The hybrid algorithm is used here to predict cellular localization sites of proteins in yeast. Two different fitness measures were taken to evaluate the rules generated by the algorithm during evolution process. Than the performance of Fuzzy Genetic algorithm with better fitness measure is compared to the performance of Naïve Bayesian approach to accurately detect and classify patterns. The performance analysis includes testing on train as well as test dataset, created from original dataset. It is found that the fuzzy genetic algorithm with the fitness measure based on data mining support-confidence framework performs better compared to other fitness measure but in terms of classification Naïve Bayesian technique is much more reliable.

[1]  C. Lucas,et al.  Intrusion detection using a fuzzy genetics-based learning algorithm , 2007, J. Netw. Comput. Appl..

[2]  Mohammad Zulkernine,et al.  An anomaly intrusion detection method using the CSI-KNN algorithm , 2008, SAC '08.

[3]  Kwong-Sak Leung,et al.  Data Mining Using Grammar Based Genetic Programming and Applications , 2000 .

[4]  Brian Oduor,et al.  Evolving fuzzy systems , 2004 .

[5]  OlaruCristina,et al.  A complete fuzzy decision tree technique , 2003 .

[6]  Daphne Koller,et al.  Support Vector Machine Active Learning with Applications to Text Classification , 2000, J. Mach. Learn. Res..

[7]  Germano Lambert-Torres,et al.  Evolutionary computation based fuzzy membership functions optimization , 2007, 2007 IEEE International Conference on Systems, Man and Cybernetics.

[8]  Russell C. Eberhart,et al.  Implementation of evolutionary fuzzy systems , 1999, IEEE Trans. Fuzzy Syst..

[9]  Md. Al Mehedi Hasan,et al.  Support Vector Machine and Random Forest Modeling for Intrusion Detection System (IDS) , 2014 .

[10]  Hisao Ishibuchi,et al.  Selecting fuzzy if-then rules for classification problems using genetic algorithms , 1995, IEEE Trans. Fuzzy Syst..

[11]  Zbigniew Michalewicz,et al.  Learning Fuzzy Rules with Evolutionary Algorithms - An Analytic Approach , 2008, PPSN.

[12]  Patrick Haffner,et al.  Support vector machines for histogram-based image classification , 1999, IEEE Trans. Neural Networks.

[13]  M. A. M. Hasan,et al.  Neural network & genetic algorithm based approach to network intrusion detection & comparative analysis of performance , 2012, 2012 15th International Conference on Computer and Information Technology (ICCIT).

[14]  Louis Wehenkel,et al.  A complete fuzzy decision tree technique , 2003, Fuzzy Sets Syst..

[15]  Rudolf Kruse,et al.  A neuro-fuzzy method to learn fuzzy classification rules from data , 1997, Fuzzy Sets Syst..

[16]  Ian Witten,et al.  Data Mining , 2000 .