A new feature selection method based on association rules for diagnosis of erythemato-squamous diseases

In this paper, a new feature selection method based on Association Rules (AR) and Neural Network (NN) is presented for the diagnosis of erythemato-squamous diseases. AR is used for reducing the dimension of erythemato-squamous diseases dataset and NN is used for efficient classification. The proposed AR+NN system performance is compared with that of other feature selection algorithms+NN. The dimension of input feature space is reduced from thirty four to twenty four by using AR. In test stage, 3-fold cross validation method is applied to the erythemato-squamous diseases dataset to evaluate the proposed system performances. The correct classification rate of proposed system is 98.61%. This research demonstrated that the AR can be used for reducing the dimension of feature space and proposed AR+NN model can be used to obtain fast automatic diagnostic systems for other diseases.

[1]  Davut Hanbay,et al.  An expert system based on wavelet decomposition and neural network for modeling Chua's circuit , 2008, Expert Syst. Appl..

[2]  Abdulkadir Sengur.  An expert system based on principal component analysis, artificial immune system and fuzzy k-NN for diagnosis of valvular heart diseases , 2008 .

[3]  Loris Nanni,et al.  An ensemble of classifiers for the diagnosis of erythemato-squamous diseases , 2006, Neurocomputing.

[4]  Christopher M. Bishop,et al.  Neural networks for pattern recognition , 1995 .

[5]  Tomasz Imielinski,et al.  Mining association rules between sets of items in large databases , 1993, SIGMOD Conference.

[6]  R. Grinold.  Mathematical Programming Methods of Pattern Classification , 1972 .

[7]  Sara J. Graves,et al.  Image segmentation using association rule features , 2002, IEEE Trans. Image Process..

[8]  O. Mangasarian,et al.  Robust linear programming discrimination of two linearly inseparable sets , 1992 .

[9]  Josef Kittler,et al.  Floating search methods for feature selection with nonmonotonic criterion functions , 1994, Proceedings of the 12th IAPR International Conference on Pattern Recognition, Vol. 3 - Conference C: Signal Processing (Cat. No.94CH3440-5).

[10]  David G. Stork,et al.  Pattern Classification , 1973 .

[11]  FRED W. SMITH,et al.  Pattern Classifier Design by Linear Programming , 1968, IEEE Transactions on Computers.

[12]  Varghese S. Jacob,et al.  Computing, Artificial Intelligence and Information Management Breast cancer prediction using the isotonic separation technique , 2007 .

[13]  Jack Sklansky,et al.  A note on genetic algorithms for large-scale feature selection , 1989, Pattern Recognit. Lett..

[14]  Yuehjen E. Shao,et al.  Mining the breast cancer pattern using artificial neural networks and multivariate adaptive regression splines , 2004, Expert Syst. Appl..

[15]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[16]  M. Cevdet Ince,et al.  An expert system for detection of breast cancer based on association rules and neural network , 2009, Expert Syst. Appl..

[17]  Aapo Hyvärinen,et al.  Fast and robust fixed-point algorithms for independent component analysis , 1999, IEEE Trans. Neural Networks.

[18]  Huan Liu,et al.  Book review: Machine Learning, Neural and Statistical Classification Edited by D. Michie, D.J. Spiegelhalter and C.C. Taylor (Ellis Horwood Limited, 1994) , 1996, SGAR.

[19]  H. Altay Güvenir,et al.  Learning differential diagnosis of erythemato-squamous diseases using voting feature intervals , 1998, Artif. Intell. Medicine.

[20]  Keinosuke Fukunaga,et al.  A Branch and Bound Algorithm for Feature Subset Selection , 1977, IEEE Transactions on Computers.

[21]  David J. Spiegelhalter,et al.  Machine Learning, Neural and Statistical Classification , 2009 .

[22]  Erkki Oja,et al.  Independent component analysis: algorithms and applications , 2000, Neural Networks.

[23]  Ramakrishnan Srikant,et al.  Fast Algorithms for Mining Association Rules in Large Databases , 1994, VLDB.

[24]  H. A Güvenir,et al.  An expert system for the differential diagnosis of erythemato-squamous diseases , 2000 .

[25]  Fred Glover,et al.  Applications and Implementation , 1981 .

[26]  Baozong Yuan,et al.  A more efficient branch and bound algorithm for feature selection , 1993, Pattern Recognit..

[27]  Abdulkadir Sengur,et al.  An expert system based on linear discriminant analysis and adaptive neuro-fuzzy inference system to diagnosis heart valve diseases , 2008 .

[28]  Elif Derya Übeyli,et al.  Automatic detection of erythemato-squamous diseases using adaptive neuro-fuzzy inference systems , 2004, Comput. Biol. Medicine.

[29]  E. Oja,et al.  Independent Component Analysis , 2013 .

[30]  Edwin K. P. Chong,et al.  On relative convergence properties of principal component analysis algorithms , 1998, IEEE Trans. Neural Networks.

[31]  Kemal Polat,et al.  The effect to diagnostic accuracy of decision tree classifier of fuzzy and k-NN based weighted pre-processing methods to diagnosis of erythemato-squamous diseases , 2006, Digit. Signal Process..

[32]  M. Karabatak,et al.  Texture Classification Using Edge Detection and Association Rules , 2006, 2006 IEEE 14th Signal Processing and Communications Applications.

[33]  Mark Richard Vriesenga.  Genetic selection and neural modeling for designing pattern classifiers , 1996 .