A Novel Handwritten Digits Recognition Method based on Subclass Low Variances Guided Support Vector Machine

Handwritten Digits Recognition (HWDR) is one of the very popular application in computer vision and it has always been a challenging task in pattern recognition. But it is very hard practical problem and many problems are still unresolved. To develop a high performance automatic HWDR, several learning algorithms have been proposed, studied and modified. Much of the effort involved in Handwritten digits classification with Support Vector Machine (SVM). More specifically, in the current study we are focusing on one-class SVM (OSVM) approaches which are of huge interest for our problem. Covariance Guided OSVM (COSVM) algorithm improves up on the OSVM method, by emphasizing the low variance directions. However, COSVM does not handle multi-modal target class data. Thus, we design a new subclass algorithm based on COSVM, which takes advantage of the target class clusters variance information. To investigate the effectiveness of the novel Subclass COSVM (SCOSVM), we compared our proposed approach with other methods based on other contemporary one-class classifiers, on well-known standard MNIST benchmark datasets and Optical Recognition of Handwritten Digits datasets. The experimental results verify the significant superiority of our

[1]  William H. Press,et al.  Numerical Recipes 3rd Edition: The Art of Scientific Computing , 2007 .

[2]  Masakazu Suzuki,et al.  Mathematical symbol recognition with support vector machines , 2007, Pattern Recognit. Lett..

[3]  Mahdi Jampour,et al.  Efficient Handwritten Digit Recognition based on Histogram of Oriented Gradients and SVM , 2014 .

[4]  L. Deng,et al.  The MNIST Database of Handwritten Digit Images for Machine Learning Research [Best of the Web] , 2012, IEEE Signal Processing Magazine.

[5]  C. Micchelli Interpolation of scattered data: Distance matrices and conditionally positive definite functions , 1986 .

[6]  Andrés Larroza,et al.  Support vector machine classification of brain metastasis and radiation necrosis based on texture analysis in MRI , 2015, Journal of magnetic resonance imaging : JMRI.

[7]  Shengrui Wang,et al.  An objective approach to cluster validation , 2006, Pattern Recognit. Lett..

[8]  Robert P. W. Duin,et al.  Uniform Object Generation for Optimizing One-class Classifiers , 2002, J. Mach. Learn. Res..

[9]  V. Radha,et al.  Performance Evaluation of Face Recognition Based on PCA, LDA, ICA and Hidden Markov Model , 2010, ICDEM.

[10]  Tom Fawcett,et al.  ROC Graphs: Notes and Practical Considerations for Researchers , 2007 .

[11]  Adriano Lorena Inácio de Oliveira,et al.  A novel one-class classification method based on feature analysis and prototype reduction , 2011, 2011 IEEE International Conference on Systems, Man, and Cybernetics.

[12]  N. Krishnan,et al.  License plate Character Segmentation using horizontal and vertical projection with dynamic thresholding , 2013, 2013 IEEE International Conference ON Emerging Trends in Computing, Communication and Nanotechnology (ICECCN).

[13]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[14]  Yudong Zhang,et al.  Binary PSO with mutation operator for feature selection using decision tree applied to spam detection , 2014, Knowl. Based Syst..

[15]  Saburou Saitoh,et al.  Theory of Reproducing Kernels and Its Applications , 1988 .

[16]  Ivor W. Tsang,et al.  Learning the Kernel in Mahalanobis One-Class Support Vector Machines , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[17]  Xin Li,et al.  An Optimal SVM-Based Text Classification Algorithm , 2006, 2006 International Conference on Machine Learning and Cybernetics.

[18]  Bernhard Schölkopf,et al.  Estimating the Support of a High-Dimensional Distribution , 2001, Neural Computation.

[19]  D. Gorgevik,et al.  An efficient three-stage classifier for handwritten digit recognition , 2004, ICPR 2004.

[20]  J. Hanley,et al.  A method of comparing the areas under receiver operating characteristic curves derived from the same cases. , 1983, Radiology.

[21]  Ching Y. Suen,et al.  A novel hybrid CNN-SVM classifier for recognizing handwritten digits , 2012, Pattern Recognit..

[22]  Wasfi G. Al-Khatib,et al.  Recognition of Arabic (Indian) bank check digits using log-gabor filters , 2011, Applied Intelligence.

[23]  Ching Y. Suen,et al.  A trainable feature extractor for handwritten digit recognition , 2007, Pattern Recognit..

[24]  M. M. Moya,et al.  One-class classifier networks for target recognition applications , 1993 .

[25]  Milan Tuba,et al.  Handwritten digit recognition by support vector machine optimized by Bat algorithm , 2016 .

[26]  Ling Guan,et al.  Covariance-guided One-Class Support Vector Machine , 2014, Pattern Recognit..