Joint Optimization of Feature Selection and Parameters for Multi-class SVM in Skin Symptomatic Recognition

Automatic recognition of skin symptom plays an importance role in the skin diagnosis and treatment. Feature selection is to increase the classification performance of skin symptom. In this paper, the effects of feature selection on the classification of 4-class skin symptoms (chloasma, blackhead, freckled and comedone) are analyzed. Support vector machine (SVM) is employed to construct classifier, the parameters setting is very crucial to the learning results and generalization ability of SVM, and many irrelevant and redundant features degrade the performance of classification, furthermore, the choice of SVM parameters is influenced by the feature subset taken into account and vice versa. So a joint optimization method for selecting features and SVM parameters is proposed. Genetic algorithms, which have a lot of improvements about fitness, crossover and mutation in comparison with simple genetic algorithms, is to achieve a balance between the classification accuracy and the size of the feature subsets selected and have a fast convergence rate. Furthermore, ‘one-against-one’ approach is used to solve multi-class classification problems and a comparison of the model performances is made among the results of the joint optimization and the single optimization of features or SVM parameters in the experiments. The simulation result shows that our approach can find subsets of features for 4-class skin symptoms classification with higher average cross validation accuracy and a higher rate of convergence compared with single optimization of features or SVM parameters.

[1]  Chih-Jen Lin,et al.  The analysis of decomposition methods for support vector machines , 2000, IEEE Trans. Neural Networks Learn. Syst..

[2]  Chih-Jen Lin,et al.  A comparison of methods for multiclass support vector machines , 2002, IEEE Trans. Neural Networks.

[3]  R. Suganya,et al.  Data Mining Concepts and Techniques , 2010 .

[4]  Lalit M. Patnaik,et al.  Adaptive probabilities of crossover and mutation in genetic algorithms , 1994, IEEE Trans. Syst. Man Cybern..

[5]  Anil K. Jain,et al.  Dimensionality reduction using genetic algorithms , 2000, IEEE Trans. Evol. Comput..

[6]  Léon Personnaz,et al.  On Cross Validation for Model Selection , 1999, Neural Computation.

[7]  Jihoon Yang,et al.  Feature Subset Selection Using a Genetic Algorithm , 1998, IEEE Intell. Syst..

[8]  Michael I. Jordan,et al.  Feature selection for high-dimensional genomic microarray data , 2001, ICML.

[9]  Vladimir Vapnik,et al.  An overview of statistical learning theory , 1999, IEEE Trans. Neural Networks.

[10]  Anil K. Jain,et al.  Statistical Pattern Recognition: A Review , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Bao-Liang Lu,et al.  Fast recognition of multi-view faces with feature selection , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[12]  Shutao Li,et al.  Gene Selection Using Wilcoxon Rank Sum Test and Support Vector Machine for Cancer Classification , 2007, CIS.

[13]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[14]  Zhiyuan Luo,et al.  Gene Selection for Cancer Classification using Wilcoxon Rank Sum Test and Support Vector Machine , 2006, 2006 International Conference on Computational Intelligence and Security.

[15]  George Bebis,et al.  Neural-network-based gender classification using genetic search for eigen-feature selection , 2002, Proceedings of the 2002 International Joint Conference on Neural Networks. IJCNN'02 (Cat. No.02CH37290).

[16]  Thorsten Joachims,et al.  Making large scale SVM learning practical , 1998 .

[17]  Mineichi Kudo,et al.  Comparison of Classifier-Specific Feature Selection Algorithms , 2000, SSPR/SPR.