Performance Analysis of Deterministic Centroid Initialization Method for Partitional Algorithms in Image Block Clustering

Image block clustering is important in several exploratory applications such as image segmentation, image pattern classification, image compression and the like. Clustering the blocks of an image into meaningful groups to reveal useful information is a challenging problem. This paper uses Partitional algorithm for image block clustering and also clusters are arranged in a hierarchical structure to explore the different aspects of the data. K Means algorithm is a widely used Partitional algorithm. But due to its gradient descent nature, the result of this algorithm is very sensitive to the initial cluster centroids which do not produce unique clustering results every time for the same input. Many initialization methods have been proposed to address this problem, but it produces results at the cost of high computational time. A Deterministic Centroid Initialization Method (DCIM) was proposed in our earlier work for K means Clustering algorithm which was used to cluster the image blocks for content adaptive image compression. In this paper, we extend the performance analysis part of DCIM in conventional K Means and Fuzzy C Means algorithm. The performance analysis has been done with the measures such as Root Mean Square Error (RMSE), Number of iterations and CPU time. The strength of this DCIM method is that the clustering algorithms require less number of iterations to attain convergence and in producing the unique better clustering result in a single run. Clustering algorithms with DCIM was tested on a variety of images to show its strength. The experimental results show that the clustering algorithm with DCIM outperforms the clustering algorithms with Random Centroid Initialization Method (RCIM) in terms of RMSE and number of iterations. From an average performance view, K Means with DCIM produces a decrease of 20.87% in RMSE with marginal increase of 0.27 seconds at CPU time than K Means with RCIM. The validation results prove that the DCIM guarantees unique better results within a lesser number of iterations with less computational effort.

[1]  K. Vivekanandan,et al.  Discrete wavelet transformation of an image based on genetic-algorithm clustering , 2008 .

[2]  Patricio A. Vela,et al.  A Comparative Study of Efficient Initialization Methods for the K-Means Clustering Algorithm , 2012, Expert Syst. Appl..

[3]  Similarity Measurement in Recent Biased Time Series Databases using Different Clustering Methods , 2013 .

[4]  Maoguo Gong,et al.  Image change detection based on an improved rough fuzzy c-means clustering algorithm , 2013, International Journal of Machine Learning and Cybernetics.

[5]  Mohd Aizaini Maarof,et al.  Efficient image duplicated region detection model using sequential block clustering , 2013, Digit. Investig..

[6]  Jun Wang,et al.  Single point iterative weighted fuzzy C-means clustering algorithm for remote sensing image segmentation , 2009, Pattern Recognit..

[7]  Jianfei Cai,et al.  Content-Based Image Compression for Arbitrary-Resolution Display Devices , 2011, 2011 IEEE International Conference on Communications (ICC).

[8]  D.M. Mount,et al.  An Efficient k-Means Clustering Algorithm: Analysis and Implementation , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  N. A. Abu,et al.  A generic psychovisual error threshold for the quantization table generation on JPEG image compression , 2013, 2013 IEEE 9th International Colloquium on Signal Processing and its Applications.

[10]  Sharlee Climer,et al.  Image database indexing using JPEG coefficients , 2002, Pattern Recognit..

[11]  Mohd Aizaini Maarof,et al.  Sequential Straightforward Clustering for Local Image Block Matching , 2011 .

[12]  M. Zhao,et al.  Content adaptive image de-blocking , 2004, IEEE International Symposium on Consumer Electronics, 2004.

[13]  Jianmin Jiang,et al.  Direct content access and extraction from JPEG compressed images , 2002, Pattern Recognit..

[14]  Guojun Gan,et al.  The k-means Algorithm , 2011 .

[15]  Qiuju Zhang,et al.  Research on cultural-based multi-objective particle swarm optimization in image compression quality assessment , 2013 .

[16]  Beatrice Lazzerini,et al.  A multi-objective evolutionary approach to image quality/compression trade-off in JPEG baseline algorithm , 2010, Appl. Soft Comput..

[17]  Jiawei Han,et al.  Data Mining: Concepts and Techniques , 2000 .

[18]  Chong-Wah Ngo,et al.  Exploiting image indexing techniques in DCT domain , 1998, Pattern Recognit..

[19]  Hossein Nezamabadi-pour,et al.  Object-Based Image Indexing and Retrieval in DCT Domain using Clustering Techniques , 2007 .

[20]  Vinoth Kumar Balasubramanian,et al.  Knowledge-based genetic algorithm approach to quantization table generation for the JPEG baseline algorithm , 2016 .

[21]  Badrinath Roysam,et al.  Image change detection algorithms: a systematic survey , 2005, IEEE Transactions on Image Processing.

[23]  Jianmin Jiang,et al.  JPEG compressed image retrieval via statistical features , 2003, Pattern Recognit..

[24]  Ananthi Sheshasayee,et al.  Comparative Study of Fuzzy C Means and K Means Algorithm for Requirements Clustering , 2014 .

[25]  Hans Burkhardt,et al.  A CONTENT-BASED IMAGE RETRIEVAL SCHEME IN JPEG COMPRESSED DOMAIN , 2006 .

[26]  T. Velmurugan,et al.  Performance based analysis between k-Means and Fuzzy C-Means clustering algorithms for connection oriented telecommunication data , 2014, Appl. Soft Comput..

[27]  Xun Du,et al.  Content-based image compression , 2001, SPIE Defense + Commercial Sensing.

[28]  Rajiv Kumar,et al.  Performance Evaluation and Comparative Analysis of Proposed Image Segmentation Algorithm , 2013 .

[29]  Alexander Wong,et al.  A Flexible Content-Based Approach to Adaptive Image Compression , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[30]  V. Loumos,et al.  A block-based clustering technique for real time object detection on a static background , 2004, 2004 2nd International IEEE Conference on 'Intelligent Systems'. Proceedings (IEEE Cat. No.04EX791).

[31]  Chee Sun Won Improved block-based image segmentation , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[32]  P.K. Singh Unsupervised segmentation of HRCT lung images using FDK clustering , 2004, IEEE International Workshop on Biomedical Circuits and Systems, 2004..

[33]  Kamaljit Kaur,et al.  Review of Existing Methods for Finding Initial Clusters in K-means Algorithm , 2013 .

[34]  Pedro Larrañaga,et al.  An empirical comparison of four initialization methods for the K-Means algorithm , 1999, Pattern Recognit. Lett..