Feature selection and classification using flexible neural tree

Abstract The purpose of this research is to develop effective machine learning or data mining techniques based on flexible neural tree FNT. Based on the pre-defined instruction/operator sets, a flexible neural tree model can be created and evolved. This framework allows input variables selection, over-layer connections and different activation functions for the various nodes involved. The FNT structure is developed using genetic programming (GP) and the parameters are optimized by a memetic algorithm (MA). The proposed approach was applied for two real-world problems involving designing intrusion detection system (IDS) and for breast cancer classification. The IDS data has 41 inputs/features and the breast cancer classification problem has 30 inputs/features. Empirical results indicate that the proposed method is efficient for both input feature selection and improved classification rate.

[1]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[2]  B. Hulka,et al.  Breast cancer: hormones and other risk factors. , 2001, Maturitas.

[3]  AbrahamAjith,et al.  Feature deduction and ensemble design of intrusion detection systems , 2005 .

[4]  Yianni Attikiouzel,et al.  Artificial Neural Networks and Breast Cancer Prognosis , 1994, Aust. Comput. J..

[5]  Ravi Jain,et al.  A Comparative Study of Fuzzy Classifiers on Breast Cancer Data , 2009, IWANN.

[6]  Kumar Chellapilla,et al.  Evolving computer programs without subtree crossover , 1997, IEEE Trans. Evol. Comput..

[7]  Jiwen Dong,et al.  Time-series forecasting using flexible neural tree model , 2005, Inf. Sci..

[8]  A. Dickson On Evolution , 1884, Science.

[9]  W. Hart Adaptive global optimization with local search , 1994 .

[10]  Lakhmi C. Jain,et al.  Innovations in intelligent systems , 2004 .

[11]  T Suzuki,et al.  An expert system for early detection of cancer of the breast. , 1989, Computers in biology and medicine.

[12]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[13]  Jiwen Dong,et al.  Nonlinear System Modelling Via Optimal Design Of Neural Trees , 2004, Int. J. Neural Syst..

[14]  Hervé Debar,et al.  A neural network component for an intrusion detection system , 1992, Proceedings 1992 IEEE Computer Society Symposium on Research in Security and Privacy.

[15]  Corso Elvezia Probabilistic Incremental Program Evolution , 1997 .

[16]  P Haddawy,et al.  Construction of a Bayesian network for mammographic diagnosis of breast cancer , 1997, Comput. Biol. Medicine.

[17]  D. E. Goldberg,et al.  Genetic Algorithms in Search , 1989 .

[18]  E C Wasson,et al.  A step toward computer-assisted mammography using evolutionary programming and neural networks. , 1997, Cancer letters.

[19]  Andrew H. Sung,et al.  Intrusion detection using an ensemble of intelligent paradigms , 2005, J. Netw. Comput. Appl..

[20]  Sugata Sanyal,et al.  Adaptive neuro-fuzzy intrusion detection systems , 2004, International Conference on Information Technology: Coding and Computing, 2004. Proceedings. ITCC 2004..

[21]  Pablo Moscato,et al.  On Evolution, Search, Optimization, Genetic Algorithms and Martial Arts : Towards Memetic Algorithms , 1989 .