Color image classification and retrieval through ternary decision structure based multi-category TWSVM

In this paper, we propose Ternary Decision Structure based multi-category twin support vector machines (TDS-TWSVM) classifier. Twin support vector machines (TWSVM) formulation deals with finding non-parallel plane classifier which is obtained by solving two related Quadratic Programming Problems (QPPs). The proposed TDS-TWSVM classifier is an extension of TWSVM so as to handle multi-class data and is more efficient in terms of training and testing time of classifiers. For a K-class problem, a balanced ternary structure requires Â? log 3 K Â? comparisons for evaluating a test sample. The experimental results depict that TDS-TWSVM outperforms One-Against-All TWSVM (OAA-TWSVM) and binary tree-based TWSVM (TB-TWSVM) in terms of classification accuracy. We have shown the efficacy of the proposed algorithm via image classification and further for image retrieval. Experiments are performed on a varied range of benchmark image databases with 5-fold cross validation.

[1]  Yuan-Hai Shao,et al.  The Best Separating Decision Tree Twin Support Vector Machine for Multi-Class Classification , 2013, ITQM.

[2]  Madan Gopal,et al.  Application of smoothing technique on twin support vector machines , 2008, Pattern Recognit. Lett..

[3]  N. Subhash Chandra,et al.  Local oppugnant color space extrema patterns for content based natural and texture image retrieval , 2015 .

[4]  J. MacQueen.  Some methods for classification and analysis of multivariate observations , 1967 .

[5]  Madan Gopal,et al.  Least squares twin support vector machines for pattern classification , 2009, Expert Syst. Appl..

[6]  Zhenhua Guo,et al.  A Completed Modeling of Local Binary Pattern Operator for Texture Classification , 2010, IEEE Transactions on Image Processing.

[7]  Olvi L. Mangasarian,et al.  Multisurface proximal support vector machine classification via generalized eigenvalues , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Weixin Xie,et al.  Extending twin support vector machine classifier for multi-category classification problems , 2013, Intell. Data Anal..

[9]  James Ze Wang,et al.  SIMPLIcity: Semantics-Sensitive Integrated Matching for Picture LIbraries , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Yang Zhao,et al.  Completed robust local binary pattern for texture classification , 2013, Neurocomputing.

[11]  Rui Guo,et al.  A Twin Multi-Class Classification Support Vector Machine , 2012, Cognitive Computation.

[12]  Venu Govindaraju,et al.  Half-Against-Half Multi-class Support Vector Machines , 2005, Multiple Classifier Systems.

[13]  Q. M. Jonathan Wu,et al.  Modified color motif co-occurrence matrix for image indexing and retrieval , 2013, Comput. Electr. Eng..

[14]  M. Esmel ElAlami,et al.  A novel image retrieval model based on the most relevant features , 2011, Knowl. Based Syst..

[15]  Subrahmanyam Murala,et al.  Expert content-based image retrieval system using robust local patterns , 2014, J. Vis. Commun. Image Represent..

[16]  Johan A. K. Suykens,et al.  Least Squares Support Vector Machine Classifiers , 1999, Neural Processing Letters.

[17]  Lei Zhang,et al.  Contents lists available at ScienceDirect Pattern Recognition , 2022 .

[18]  Reshma Khemchandani,et al.  Twin Support Vector Machines for Pattern Classification , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Yuh-Jye Lee,et al.  SSVM: A Smooth Support Vector Machine for Classification , 2001, Comput. Optim. Appl..

[20]  Thorsten Joachims,et al.  Text Categorization with Support Vector Machines: Learning with Many Relevant Features , 1998, ECML.

[21]  Chih-Jen Lin,et al.  A comparison of methods for multiclass support vector machines , 2002, IEEE Trans. Neural Networks.

[22]  Madan Gopal,et al.  Fast Multiclass SVM Classification Using Decision Tree Based One-Against-All Method , 2010, Neural Processing Letters.

[23]  Subrahmanyam Murala,et al.  Directional local extrema patterns: a new descriptor for content based image retrieval , 2012, International Journal of Multimedia Information Retrieval.

[24]  Aman Pal,et al.  VARIANT OF COMPLETED ROBUST LBP FOR TWO-LEVEL PROBABILISTIC CONTENT BASED IMAGE RETRIEVAL , 2014 .

[25]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  P. Rajesh Kumar,et al.  Color and Local Maximum Edge Patterns Histogram for Content Based Image Retrieval , 2014 .

[27]  B. S. Manjunath,et al.  Color and texture descriptors , 2001, IEEE Trans. Circuits Syst. Video Technol..

[28]  Guodong Guo,et al.  Face recognition by support vector machines , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[29]  Christopher J. C. Burges,et al.  A Tutorial on Support Vector Machines for Pattern Recognition , 1998, Data Mining and Knowledge Discovery.

[30]  David R. Musicant,et al.  Lagrangian Support Vector Machines , 2001, J. Mach. Learn. Res..

[31]  Reshma Khemchandani,et al.  Fuzzy linear proximal support vector machines for multi-category data classification , 2005, Neurocomputing.

[32]  Glenn Fung,et al.  Proximal support vector machine classifiers , 2001, KDD '01.

[33]  Zhenyu He,et al.  Texture image retrieval based on non-tensor product wavelet filter banks , 2009, Signal Process..

[34]  Nello Cristianini,et al.  Large Margin DAGs for Multiclass Classification , 1999, NIPS.

[35]  Antonios Gasteratos,et al.  Evaluation of shape descriptors for shape-based image retrieval , 2011 .

[36]  Bao-Liang Lu,et al.  Feature Selection for Fast Image Classification with Support Vector Machines , 2004, ICONIP.

[37]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[38]  Kuang-Yao Lee,et al.  Multiclass support vector classification via coding and regression , 2010, Neurocomputing.

[39]  採編典藏組.  Society for Industrial and Applied Mathematics(SIAM) , 2008 .

[40]  Ying Liu,et al.  A survey of content-based image retrieval with high-level semantics , 2007, Pattern Recognit..