An Exploration of Mixture Models to Maximize between Class Scatter for Object Classification in Large Image Datasets

This paper presents a method for determining the significant features of an image within a maximum likelihood framework by remarkably reducing the semantic gap between high level and low level features. With this concern, we propose a FLD-Mixture Models and analyzed the effect of different distance metrics for Image Retrieval System. In this method, first Expectation Maximization (EM) algorithm method is applied to learn mixture of Gaussian distributions to obtain best possible maximum likelihood clusters. Gaussian Mixture Models is used for clustering data in unsupervised context. Further, Fisher’s Linear Discriminant Analysis( FLDA) is applied for K = 4 mixtures to preserve useful discriminatory information in reduced feature space. Finally, six different distance measures are used for classification purpose to obtain an average classification rate. We examined our proposed model on Caltech-101, Caltech-256 & Corel-1k datasets and achieved state-of-the-art classification rates compared to several well known benchmarking techniques on the same datasets.

[1]  James Ze Wang,et al.  SIMPLIcity: Semantics-Sensitive Integrated Matching for Picture LIbraries , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[3]  David G. Lowe,et al.  Local Naive Bayes Nearest Neighbor for image classification , 2011, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Yen-Jen Chang,et al.  Fast color-spatial feature based image retrieval methods , 2011, Expert Syst. Appl..

[5]  Wei-Ying Ma,et al.  Benchmarking of image features for content-based retrieval , 1998, Conference Record of Thirty-Second Asilomar Conference on Signals, Systems and Computers (Cat. No.98CH36284).

[6]  Eli Shechtman,et al.  In defense of Nearest-Neighbor based image classification , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  G. Griffin,et al.  Caltech-256 Object Category Dataset , 2007 .

[8]  R. Krishnamoorthi,et al.  Image retrieval using edge based shape similarity with multiresolution enhanced orthogonal polynomials model , 2013, Digit. Signal Process..

[9]  Horace H. S. Ip,et al.  Image categorization by learning with context and consistency , 2009, CVPR.

[10]  Liang-Tien Chia,et al.  Local features are not lonely – Laplacian sparse coding for image classification , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[11]  Jitendra Malik,et al.  SVM-KNN: Discriminative Nearest Neighbor Classification for Visual Category Recognition , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[12]  Markus A. Stricker,et al.  Similarity of color images , 1995, Electronic Imaging.

[13]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[14]  Thomas Serre,et al.  Object recognition with features inspired by visual cortex , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[15]  Hyun-Chul Kim,et al.  Face recognition using LDA mixture model , 2003, Pattern Recognit. Lett..

[16]  Nello Cristianini,et al.  Learning the Kernel Matrix with Semidefinite Programming , 2002, J. Mach. Learn. Res..

[17]  Michael J. Swain,et al.  Indexing via color histograms , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[18]  Michael I. Jordan,et al.  Hierarchical Mixtures of Experts and the EM Algorithm , 1994, Neural Computation.

[19]  Xingyuan Wang,et al.  A novel method for image retrieval based on structure elements' descriptor , 2013, J. Vis. Commun. Image Represent..

[20]  Cordelia Schmid,et al.  Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[21]  Yihong Gong,et al.  Locality-constrained Linear Coding for image classification , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[22]  Ramin Zabih,et al.  Comparing images using color coherence vectors , 1997, MULTIMEDIA '96.

[23]  Jing Huang,et al.  Combining supervised learning with color correlograms for content-based image retrieval , 1997, MULTIMEDIA '97.

[24]  Pietro Perona,et al.  Learning Generative Visual Models from Few Training Examples: An Incremental Bayesian Approach Tested on 101 Object Categories , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[25]  Avinash C. Kak,et al.  PCA versus LDA , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Chin-Chen Chang,et al.  Color image retrieval technique based on color features and image bitmap , 2007, Inf. Process. Manag..

[27]  Alex Holub,et al.  Exploiting Unlabelled Data for Hybrid Object Classification , 2005 .

[28]  Dieter Fox,et al.  Multipath Sparse Coding Using Hierarchical Matching Pursuit , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[29]  Nasser M. Nasrabadi,et al.  Pattern Recognition and Machine Learning , 2006, Technometrics.

[30]  Yihong Gong,et al.  Linear spatial pyramid matching using sparse coding for image classification , 2009, CVPR.

[31]  Michael J. Swain,et al.  Color indexing , 1991, International Journal of Computer Vision.

[32]  Xing-Yuan Wang,et al.  An effective method for color image retrieval based on texture , 2012, Comput. Stand. Interfaces.

[33]  R. Fisher THE STATISTICAL UTILIZATION OF MULTIPLE MEASUREMENTS , 1938 .