Feature selection based image clustering using local discriminant model and global integration

It is well known that parameter optimization and dimension reduction strategies play an important role in improving the performance of clustering algorithms. Recently, Yang et at. (2011) proposed an interesting and effective local discriminant model and global integration (LDMGI) clustering algorithm for image databases. We observed this LDMGI approach suffers from the curse of dimensionality. We then show that the effectiveness of this approach could be substantially enhanced with parameter selection and dimensionality reduction approach. We thus experimentally observed the enhanced performance of LDMGI algorithm in terms of clustering accuracy (ACC) and normalized mutual information (NMI). In the first stage, the optimal values of the clustering parameters, nearest neighbours (k) and regularization parameter (λ) are computed. In the second stage, minimum Redundancy and maximum-Relevance (mRMR) technique is utilized to select discriminant image features. During simulation, mRMR based LDMGI model have given an overall 18.7% (ACC) and 11.8% (NMI) higher performance than LDMGI model.

[1]  Yi Yang,et al.  Image Clustering Using Local Discriminant Models and Global Integration , 2010, IEEE Transactions on Image Processing.

[2]  David J. Kriegman,et al.  From Few to Many: Illumination Cone Models for Face Recognition under Variable Lighting and Pose , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Lawrence K. Saul,et al.  Think Globally, Fit Locally: Unsupervised Learning of Low Dimensional Manifold , 2003, J. Mach. Learn. Res..

[4]  Stephen Lin,et al.  Marginal Fisher Analysis and Its Variants for Human Gait Recognition and Content- Based Image Retrieval , 2007, IEEE Transactions on Image Processing.

[5]  Jieping Ye,et al.  Discriminative K-means for Clustering , 2007, NIPS.

[6]  Sudeep Sarkar,et al.  The humanID gait challenge problem: data sets, performance, and analysis , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Michael J. Lyons,et al.  Automatic Classification of Single Facial Images , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[9]  Stephen Lin,et al.  Reconstruction and Recognition of Tensor-Based Objects With Concurrent Subspaces Analysis , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[10]  Mikhail Belkin,et al.  Laplacian Eigenmaps for Dimensionality Reduction and Data Representation , 2003, Neural Computation.

[11]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[12]  J. Crowley,et al.  Estimating Face orientation from Robust Detection of Salient Facial Structures , 2004 .

[13]  Jianbo Shi,et al.  Multiclass spectral clustering , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[14]  Fuhui Long,et al.  Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy , 2003, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Mário A. T. Figueiredo,et al.  Similarity-based classification of sequences using hidden Markov models , 2004, Pattern Recognit..

[16]  Dong Xu,et al.  Face and Human Gait Recognition Using Image-to-Class Distance , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[17]  Ninad Thakoor,et al.  Hidden Markov Model-Based Weighted Likelihood Discriminant for 2-D Shape Classification , 2007, IEEE Transactions on Image Processing.

[18]  Takeo Kanade,et al.  Discriminative cluster analysis , 2006, ICML.

[19]  Bernhard Schölkopf,et al.  A Local Learning Approach for Clustering , 2006, NIPS.