K-mean and Double Cross-Validation Algorithm for LS-SVM in Sasang Typology Classification

The Sasang typology is the traditional typology theory in Oriental Medicine. The medical typology distributes people into four types based on their traits: Tae-Yang, So-Yang, Tae-Eum and So-Eum type. In the paper, we design a model for Sasang typology classification based on the least squares support vector machines (LS-SVM). We use k-mean algorithm for decision the feature index from the side face, then we add the side face ratios into our feature space for improvement. The choice of resample method is very important for parameters' optimization in SVM and it will influence the system's stability. We propose a novel resampling algorithm called double cross-validation through comparing the cross-validation with bootstrap approach. The result shows that the established model under double cross- validation algorithm based on LS-SVM is more robust with high performance and suffices for the requirements of control and optimization for classification processes.

[1]  Browne,et al.  Cross-Validation Methods. , 2000, Journal of mathematical psychology.

[2]  Johan A. K. Suykens,et al.  Least Squares Support Vector Machine Classifiers , 1999, Neural Processing Letters.

[3]  John Platt,et al.  Large Margin DAG's for Multiclass Classification , 1999 .

[4]  Léopold Simar,et al.  Computer Intensive Methods in Statistics , 1994 .

[5]  A. Fischer A special newton-type optimization method , 1992 .

[6]  André Elisseeff,et al.  Stability and Generalization , 2002, J. Mach. Learn. Res..

[7]  Sajal K. Das,et al.  Neural network-based heuristic algorithms for hypergraph coloring problems with applications , 2003, J. Parallel Distributed Comput..

[8]  Xin Yao,et al.  A review of evolutionary artificial neural networks , 1993, Int. J. Intell. Syst..

[9]  Ryan M. Rifkin,et al.  In Defense of One-Vs-All Classification , 2004, J. Mach. Learn. Res..

[10]  P. Djurić,et al.  Model selection by cross-validation , 1990, IEEE International Symposium on Circuits and Systems.

[11]  Rameswar Debnath,et al.  A decision based one-against-one method for multi-class support vector machine , 2004, Pattern Analysis and Applications.

[12]  M. Giger,et al.  Computerized analysis of lesions in US images of the breast. , 1999, Academic radiology.

[13]  B. Fei,et al.  Binary tree of SVM: a new fast multiclass training and classification algorithm , 2006, IEEE Transactions on Neural Networks.

[14]  Eddy Mayoraz,et al.  Improved Pairwise Coupling Classification with Correcting Classifiers , 1998, ECML.

[15]  Nello Cristianini,et al.  Large Margin DAGs for Multiclass Classification , 1999, NIPS.