A non-extensive entropy feature and its application to texture classification

Abstract This paper presents a novel color segmentation technique using fuzzy co-clustering approach in which both the objects and the features are assigned membership functions. An objective function which includes a multi-dimensional distance function as the dissimilarity measure and entropy as the regularization term is formulated in the proposed fuzzy co-clustering for images (FCCI) algorithm. The chrominance color cues a ⁎ and b ⁎ of CIELAB color space are used as the feature variables for co-clustering. The experiments are conducted on 100 natural images obtained from the Berkeley segmentation database. It is observed from the experimental results that the proposed FCCI yields well formed, valid and high quality clusters, as verified from Liu’s F -measure and Normalized Probabilistic RAND index. The proposed color segmentation method is also compared with other segmentation methods namely Mean-Shift, NCUT, GMM, FCM and is found to outperform all the methods. The bacterial foraging global optimization algorithm gives image specific values to the parameters involved in the algorithm.

[1]  Jian Fan,et al.  Texture Classification by Wavelet Packet Signatures , 1993, MVA.

[2]  M. Hanmandlu,et al.  Fuzzy Co-Clustering of medical images using bacterial foraging , 2008, 2008 23rd International Conference Image and Vision Computing New Zealand.

[3]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[4]  Engin Avci,et al.  Comparison of wavelet families for texture classification by using wavelet packet entropy adaptive network based fuzzy inference system , 2008, Appl. Soft Comput..

[5]  Márcio Portes de Albuquerque,et al.  Image thresholding using Tsallis entropy , 2004, Pattern Recognit. Lett..

[6]  Taghi M. Khoshgoftaar,et al.  Unsupervised multiscale color image segmentation based on MDL principle , 2006, IEEE Transactions on Image Processing.

[7]  Esther de Ves,et al.  Selecting the structuring element for morphological texture classification , 2006, Pattern Analysis and Applications.

[8]  Heung-Won Park,et al.  Image segmentation of color image based on region coherency , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[9]  Michael Spann,et al.  Texture feature performance for image segmentation , 1990, Pattern Recognit..

[10]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Driss Aboutajdine,et al.  Selecting a Discriminant Subset of Co-occurrence Matrix Features for Texture-Based Image Retrieval , 2005, ISVC.

[12]  Jing Li Wang,et al.  Color image segmentation: advances and prospects , 2001, Pattern Recognit..

[13]  Tae Jin Kang,et al.  Texture classification and segmentation using wavelet packet frame and Gaussian mixture model , 2007, Pattern Recognit..

[14]  Michael Unser,et al.  Texture classification and segmentation using wavelet frames , 1995, IEEE Trans. Image Process..

[15]  E. Jaynes Information Theory and Statistical Mechanics , 1957 .

[16]  William-Chandra Tjhi,et al.  Possibilistic fuzzy co-clustering of large document collections , 2007, Pattern Recognit..

[17]  M.I. Chacon,et al.  Definition and applications of a fuzzy image processing scheme , 2002, Proceedings of 2002 IEEE 10th Digital Signal Processing Workshop, 2002 and the 2nd Signal Processing Education Workshop..

[18]  Shilong Wang,et al.  A fast underwater optical image segmentation algorithm based on a histogram weighted fuzzy c-means improved by PSO , 2011 .

[19]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[20]  Wilson S. Geisler,et al.  Multichannel Texture Analysis Using Localized Spatial Filters , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Luc Vincent,et al.  Watersheds in Digital Spaces: An Efficient Algorithm Based on Immersion Simulations , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  P. Schmid Segmentation of digitized dermatoscopic images by two-dimensional color clustering , 1999, IEEE Transactions on Medical Imaging.

[23]  Lior Shamir,et al.  Human Perception-based Color Segmentation Using Fuzzy Logic , 2006, IPCV.

[24]  Andrew Zisserman,et al.  A Statistical Approach to Texture Classification from Single Images , 2005, International Journal of Computer Vision.

[25]  Jitendra Malik,et al.  Normalized Cuts and Image Segmentation , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Anil K. Jain,et al.  Markov Random Field Texture Models , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Wei Xu,et al.  New fuzzy c-means clustering model based on the data weighted approach , 2010, Data Knowl. Eng..

[28]  B.C. Lovell,et al.  Detection of skin lesions by fuzzy entropy based texel identification , 2009, 2009 Proceedings of 6th International Symposium on Image and Signal Processing and Analysis.

[29]  Richard W. Conners,et al.  A Theoretical Comparison of Texture Algorithms , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Alfred Mertins,et al.  Scalable multiresolution color image segmentation , 2006, Signal Process..

[31]  Madasu Hanmandlu,et al.  Content-based Image Retrieval by Information Theoretic Measure , 2011 .

[32]  Alexander Kadyrov,et al.  Reverse engineering the way humans rank textures , 2006, Pattern Analysis and Applications.

[33]  Michael M. Richter,et al.  Color image segmentation using an enhanced Gradient Network Method , 2009, Pattern Recognit. Lett..

[34]  A. Rényi On Measures of Entropy and Information , 1961 .

[35]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[36]  Andrzej Bargiela,et al.  Automatic brain MRI segmentation scheme based on feature weighting factors selection on fuzzy c-means clustering algorithms with Gaussian smoothing , 2010, CI 2010.

[37]  Jitendra Malik,et al.  From contours to regions: An empirical evaluation , 2009, CVPR.

[38]  William M. Rand,et al.  Objective Criteria for the Evaluation of Clustering Methods , 1971 .

[39]  Sankar K. Pal,et al.  Entropy: a new definition and its applications , 1991, IEEE Trans. Syst. Man Cybern..

[40]  Gerardo Beni,et al.  A Validity Measure for Fuzzy Clustering , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[41]  Raúl Enrique Sánchez-Yáñez,et al.  Natural Image Segmentation Using the CIELab Space , 2009, 2009 International Conference on Electrical, Communications, and Computers.

[42]  Sang Uk Lee,et al.  On the color image segmentation algorithm based on the thresholding and the fuzzy c-means techniques , 1990, Pattern Recognit..

[43]  Kevin M. Passino,et al.  Biomimicry of bacterial foraging for distributed optimization and control , 2002 .

[44]  Shyi-Chyi Cheng,et al.  Region-growing approach to colour segmentation using 3-D clustering and relaxation labelling , 2003 .

[45]  Marc Acheroy,et al.  Texture classification using Gabor filters , 2002, Pattern Recognit. Lett..

[46]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[47]  Madasu Hanmandlu,et al.  A Novel Optimal Fuzzy System for Color Image Enhancement Using Bacterial Foraging , 2009, IEEE Transactions on Instrumentation and Measurement.

[48]  B. S. Manjunath,et al.  Unsupervised Segmentation of Color-Texture Regions in Images and Video , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[49]  Alain Trémeau,et al.  A region growing and merging algorithm to color segmentation , 1997, Pattern Recognit..

[50]  Engin Avci,et al.  An expert system based on Wavelet Neural Network-Adaptive Norm Entropy for scale invariant texture classification , 2007, Expert Syst. Appl..

[51]  Xuelong Li,et al.  Fast Haar Transform Based Feature Extraction for Face Representation and Recognition , 2009, IEEE Transactions on Information Forensics and Security.

[52]  Torfinn Taxt,et al.  Local frequency features for texture classification , 1994, Pattern Recognit..

[53]  Tzong-Jer Chen,et al.  Fuzzy c-means clustering with spatial information for image segmentation , 2006, Comput. Medical Imaging Graph..

[54]  Michael A. Arbib,et al.  Color Image Segmentation using Competitive Learning , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[55]  Song-Chun Zhu,et al.  From Information Scaling of Natural Images to Regimes of Statistical Models , 2007 .

[56]  Jayanta Mukherjee MRF clustering for segmentation of color images , 2002, Pattern Recognit. Lett..

[57]  T. Kanade,et al.  Color information for region segmentation , 1980 .

[58]  Rose,et al.  Statistical mechanics and phase transitions in clustering. , 1990, Physical review letters.

[59]  Nonadditive entropy : The concept and its use C . Tsallis , 2009 .

[60]  C. Kang,et al.  Fuzzy based seeded region growing for image segmentation , 2009, NAFIPS 2009 - 2009 Annual Meeting of the North American Fuzzy Information Processing Society.

[61]  Martial Hebert,et al.  Toward Objective Evaluation of Image Segmentation Algorithms , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[62]  Daniel P. Huttenlocher,et al.  Efficient Graph-Based Image Segmentation , 2004, International Journal of Computer Vision.

[63]  Martial Hebert,et al.  Measures of Similarity , 2005, 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION'05) - Volume 1.

[64]  James M. Keller,et al.  A possibilistic fuzzy c-means clustering algorithm , 2005, IEEE Transactions on Fuzzy Systems.

[65]  Jian Guan,et al.  Spectral Images and Features Co-Clustering with Application to Content-based Image Retrieval , 2005, 2005 IEEE 7th Workshop on Multimedia Signal Processing.

[66]  Raghu Krishnapuram,et al.  Fuzzy co-clustering of documents and keywords , 2003, The 12th IEEE International Conference on Fuzzy Systems, 2003. FUZZ '03..

[68]  H. D. Cheng,et al.  Fuzzy homogeneity and scale-space approach to color image segmentation , 2003, Pattern Recognit..

[69]  Jitendra Malik,et al.  Blobworld: Image Segmentation Using Expectation-Maximization and Its Application to Image Querying , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[70]  Robert M. Haralick,et al.  Texture Anisotropy, Symmetry, Regularity: Recovering Structure and Orientation from Interaction Maps , 1995, BMVC.

[71]  Adam Krzyzak,et al.  Robust Estimation for Range Image Segmentation and Reconstruction , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[72]  Kongqiao Wang,et al.  Learning optimal spatial filters by discriminant analysis for brain-computer-interface , 2012, Neurocomputing.

[73]  Gunther Wyszecki,et al.  Color Science: Concepts and Methods, Quantitative Data and Formulae, 2nd Edition , 2000 .