Shannon entropy based fuzzy distance norm for pixel classification in remote sensing imagery

Pixel classification of mixed pixels in overlapping regions of remote sensing images is a very challenging task. Efficiency and detection of uncertainty are always the key ingredients for this task. This paper proposes an approach for pixel classification using Shannon's entropy-based fuzzy distance norm. Unsupervised clustering is used to group the objects based on some similarity or dissimilarity. The proposed algorithm is able to identify clusters comparing fuzzy membership values based on Shannon's entropy evaluation. This new normalized definition of the distance also satisfies separability, symmetric and triangular inequality conditions for a distance metric. This approach addresses the overlapping regions in remote sensing images by uncertainties using fuzzy set membership values. Shannon entropy further introduces belongingness and non-belongingness to one cluster within the distance measure. We demonstrate our algorithm for segmenting a LANDSAT image of Shanghai. The newly developed algorithm is compared with FCM and K-Means algorithms. The new algorithm generated clustered regions are verified with on hand ground truth facts. The validity and statistical analysis are carried out to demonstrate the superior performance of our new algorithms with K-Means and FCM algorithms.

[1]  Ramesh C. Jain,et al.  Similarity measures for image databases , 1995, Electronic Imaging.

[2]  Aaas News,et al.  Book Reviews , 1893, Buffalo Medical and Surgical Journal.

[3]  C. Pappis,et al.  A comparative assessment of measures of similarity of fuzzy values , 1993 .

[4]  Robert LIN,et al.  NOTE ON FUZZY SETS , 2014 .

[5]  Enrique H. Ruspini,et al.  Numerical methods for fuzzy clustering , 1970, Inf. Sci..

[6]  Donald W. Bouldin,et al.  A Cluster Separation Measure , 1979, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Wen-June Wang,et al.  New similarity measures on fuzzy sets and on elements , 1997, Fuzzy Sets Syst..

[8]  Luis Samaniego,et al.  Fuzzy rule-based classification of remotely sensed imagery , 2002, IEEE Trans. Geosci. Remote. Sens..

[9]  Ronald R. Yager,et al.  Entropy measures under similarity relations , 1992 .

[10]  Settimo Termini,et al.  A Definition of a Nonprobabilistic Entropy in the Setting of Fuzzy Sets Theory , 1972, Inf. Control..

[11]  Shyi-Ming Chen,et al.  A comparison of similarity measures of fuzzy values , 1995 .

[12]  S. K. Basu,et al.  Robust classification of multispectral data using multiple neural networks and fuzzy integral , 1997, IEEE Trans. Geosci. Remote. Sens..

[13]  Bor-Chen Kuo,et al.  A New Adaptive Fuzzy Clustering Algorithm for Remotely Sensed Images , 2008, IGARSS 2008 - 2008 IEEE International Geoscience and Remote Sensing Symposium.

[14]  Sanghamitra Bandyopadhyay,et al.  Satellite image classification using genetically guided fuzzy clustering with spatial information , 2005 .

[15]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[16]  Rajesh N. Dave,et al.  Use Of The Adaptive Fuzzy Clustering Algorithm To Detect Lines In Digital Images , 1990, Other Conferences.

[17]  P. Rousseeuw Silhouettes: a graphical aid to the interpretation and validation of cluster analysis , 1987 .

[18]  Russell G. Congalton,et al.  Assessing the accuracy of remotely sensed data : principles and practices , 1998 .

[19]  C. Borror Nonparametric Statistical Methods, 2nd, Ed. , 2001 .

[20]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[21]  J. C. Dunn,et al.  A Fuzzy Relative of the ISODATA Process and Its Use in Detecting Compact Well-Separated Clusters , 1973 .

[22]  H. R. Keshavan,et al.  An optimal multiple threshold scheme for image segmentation , 1984, IEEE Transactions on Systems, Man, and Cybernetics.

[23]  Ujjwal Maulik,et al.  Parallel Point Symmetry Based Clustering for Gene Microarray Data , 2009, 2009 Seventh International Conference on Advances in Pattern Recognition.

[24]  Nikhil R. Pal,et al.  Fuzzy divergence, probability measure of fuzzy events and image thresholding , 1992, Pattern Recognit. Lett..

[25]  Pierpaolo D'Urso,et al.  Fuzzy unsupervised classification of multivariate time trajectories with the Shannon entropy regularization , 2006, Comput. Stat. Data Anal..

[26]  D. Wolfe,et al.  Nonparametric Statistical Methods. , 1974 .

[27]  Ujjwal Maulik,et al.  Efficient parallel algorithm for pixel classification in remote sensing imagery , 2012, GeoInformatica.

[28]  Isabelle Bloch,et al.  On fuzzy distances and their use in image processing under imprecision , 1999, Pattern Recognit..

[29]  B. Bouchon-Meunier,et al.  Entropy of similarity relations in questionnaires and decision trees , 1993, [Proceedings 1993] Second IEEE International Conference on Fuzzy Systems.

[30]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .