Unsupervised hierarchical image segmentation through fuzzy entropy maximization

We present an unsupervised multilevel segmentation scheme for automatically segmenting grayscale and color images.Fuzzy 2-partition entropy is combined with Graph Cut to form a bi-level segmentation operator that splits a given region into 2 parts based on both global optimal threshold and local spatial coherence.A multilevel segmentation scheme iteratively performs on selected regions and color channels, producing a coarse-to-fine hierarchy of segments.The presented algorithm is evaluated using the Berkeley Segmentation Database and achieves competitive results compared with the state-of-the-art methods. The fuzzy c-partition entropy has been widely adopted as a global optimization technique for finding the optimal thresholds when performing multilevel gray image segmentation. Nevertheless, existing fuzzy c-partition entropy approaches generally have two limitations, i.e., partition number cneeds to be manually tuned for different input and the methods can process grayscale images only. To address these two limitations, an unsupervised multilevel segmentation algorithm is presented in this paper. The core step of our algorithm is a bi-level segmentation operator, which uses binary graph cuts to maximize both fuzzy 2-partition entropy and segmentation smoothness. By iteratively performing this bi-level segmentation operator, multilevel image segmentation is achieved in a hierarchical manner: Starting from the input color image, our algorithm first picks the color channel that can best segment the image into two labels, and then iteratively selects channels to further split each labels until convergence. The experimental results demonstrate the presented hierarchical segmentation scheme can efficiently segment both grayscale and color images. Quantitative evaluations over classic gray images and the Berkeley Segmentation Database show that our method is comparable to the state-of-the-art multi-scale segmentation methods, yet has the advantage of being unsupervised, efficient, and easy to implement.

[1]  Andrew K. C. Wong,et al.  A new method for gray-level picture thresholding using the entropy of the histogram , 1985, Comput. Vis. Graph. Image Process..

[2]  Wei Liu,et al.  Fuzzy entropy based optimal thresholding using bat algorithm , 2015, Appl. Soft Comput..

[3]  Weixing Wang,et al.  Efficient multilevel image segmentation through fuzzy entropy maximization and graph cut optimization , 2014, Pattern Recognit..

[4]  Rama Chellappa,et al.  Entropy rate superpixel segmentation , 2011, CVPR 2011.

[5]  Abdul Ghafoor,et al.  SAR image segmentation based on active contours with fuzzy logic , 2016, IEEE Transactions on Aerospace and Electronic Systems.

[6]  Olga Veksler,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Qiang Ji,et al.  Image Segmentation with a Unified Graphical Model , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Sang Uk Lee,et al.  Learning full pairwise affinities for spectral segmentation , 2010, CVPR.

[9]  Yee-Hong Yang,et al.  Multiresolution Color Image Segmentation , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Souad Benabdelkader,et al.  Recursive algorithm based on fuzzy 2-partition entropy for 2-level image thresholding , 2005, Pattern Recognit..

[11]  Márcio Portes de Albuquerque,et al.  Image thresholding using Tsallis entropy , 2004, Pattern Recognit. Lett..

[12]  Allen Y. Yang,et al.  Unsupervised segmentation of natural images via lossy data compression , 2008, Comput. Vis. Image Underst..

[13]  Laurent Wendling,et al.  Scalable Arrow Detection in Biomedical Images , 2014, 2014 22nd International Conference on Pattern Recognition.

[14]  Laurent Wendling,et al.  Overlaid Arrow Detection for Labeling Regions of Interest in Biomedical Images , 2016, IEEE Intelligent Systems.

[15]  Ashish Kumar Bhandari,et al.  Tsallis entropy based multilevel thresholding for colored satellite image segmentation using evolutionary algorithms , 2015, Expert Syst. Appl..

[16]  Yu Zhou,et al.  Fusion with Diffusion for Robust Visual Tracking , 2012, NIPS.

[17]  Martial Hebert,et al.  Toward Objective Evaluation of Image Segmentation Algorithms , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Horst Bischof,et al.  Saliency driven total variation segmentation , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[19]  David Bull,et al.  A supervised hierarchical segmentation of remote-sensing images using a committee of multi-scale convolutional neural networks , 2016 .

[20]  Li He,et al.  Iterative ensemble normalized cuts , 2016, Pattern Recognit..

[21]  Yee-Hong Yang,et al.  Genetic-Based Multiresolution Color Image Segmentation , 2001 .

[22]  M. A. El-Shorbagy,et al.  Local search based hybrid particle swarm optimization algorithm for multiobjective optimization , 2012, Swarm Evol. Comput..

[23]  Shih-Fu Chang,et al.  Segmentation using superpixels: A bipartite graph partitioning approach , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  H. D. Cheng,et al.  Threshold selection based on fuzzy c-partition entropy approach , 1998, Pattern Recognit..

[25]  Bülent Sankur,et al.  Survey over image thresholding techniques and quantitative performance evaluation , 2004, J. Electronic Imaging.

[26]  Swagatam Das,et al.  Multilevel Image Thresholding Based on 2D Histogram and Maximum Tsallis Entropy— A Differential Evolution Approach , 2013, IEEE Transactions on Image Processing.

[27]  Xue-Cheng Tai,et al.  A study on continuous max-flow and min-cut approaches , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[28]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[29]  Hai Jin,et al.  Object segmentation using ant colony optimization algorithm and fuzzy entropy , 2007, Pattern Recognit. Lett..

[30]  Jianbo Shi,et al.  Spectral segmentation with multiscale graph decomposition , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[31]  Yuxing Tang,et al.  A Global/Local Affinity Graph for Image Segmentation , 2015, IEEE Transactions on Image Processing.

[32]  A. Abutaleb,et al.  Automatic Thresholding Of Gray-Level Pictures Using 2-D Entropy , 1988, Optics & Photonics.

[33]  H. D. Cheng,et al.  Thresholding using two-dimensional histogram and fuzzy entropy principle , 2000, IEEE Trans. Image Process..

[34]  N. Pavesic,et al.  Gray level thresholding using the Havrda and Charvat entropy , 2000, 2000 10th Mediterranean Electrotechnical Conference. Information Technology and Electrotechnology for the Mediterranean Countries. Proceedings. MeleCon 2000 (Cat. No.00CH37099).

[35]  Long Quan,et al.  Normalized tree partitioning for image segmentation , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[36]  Yiliang Zeng,et al.  Multi-threshold image segmentation using maximum fuzzy entropy based on a new 2D histogram , 2013 .

[37]  Jian Yang,et al.  Image segmentation by iterated region merging with localized graph cuts , 2011, Pattern Recognit..

[38]  Xavier Cufí,et al.  Yet Another Survey on Image Segmentation: Region and Boundary Information Integration , 2002, ECCV.

[39]  Sankar K. Pal,et al.  A review on image segmentation techniques , 1993, Pattern Recognit..

[40]  Hossein Mobahi,et al.  Segmentation of Natural Images by Texture and Boundary Compression , 2011, International Journal of Computer Vision.

[41]  Minglun Gong,et al.  Integrated Foreground Segmentation and Boundary Matting for Live Videos , 2015, IEEE Transactions on Image Processing.

[42]  Marcel Worring,et al.  Content-Based Image Retrieval at the End of the Early Years , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[43]  Jiu-lun Fan,et al.  Image segmentation based on weak fuzzy partition entropy , 2015, Neurocomputing.

[44]  Paria Mehrani,et al.  Superpixels and Supervoxels in an Energy Optimization Framework , 2010, ECCV.

[45]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[46]  Doheon Lee,et al.  A novel initialization scheme for the fuzzy c-means algorithm for color clustering , 2004, Pattern Recognit. Lett..

[47]  Liang-Gee Chen,et al.  Efficient moving object segmentation algorithm using background registration technique , 2002, IEEE Trans. Circuits Syst. Video Technol..

[48]  Amar Mitiche,et al.  Multiregion Image Segmentation by Parametric Kernel Graph Cuts , 2011, IEEE Transactions on Image Processing.

[49]  Xuguang Zhang,et al.  A fast recursive algorithm based on fuzzy 2-partition entropy approach for threshold selection , 2011, Neurocomputing.

[50]  Azriel Rosenfeld,et al.  Scene segmentation by cluster detection in color spaces , 1976, SGAR.

[51]  Binmei Liang,et al.  KmsGC: An Unsupervised Color Image Segmentation Algorithm Based on -Means Clustering and Graph Cut , 2014 .

[52]  Oscar C. Au,et al.  An adaptive unsupervised approach toward pixel clustering and color image segmentation , 2010, Pattern Recognit..

[53]  Prasanna K. Sahoo,et al.  Image thresholding using two-dimensional Tsallis-Havrda-Charvát entropy , 2006, Pattern Recognit. Lett..

[54]  Laurent Wendling,et al.  A Simple and Efficient Arrowhead Detection Technique in Biomedical Images , 2016, Int. J. Pattern Recognit. Artif. Intell..

[55]  Nikhil R. Pal,et al.  On minimum cross-entropy thresholding , 1996, Pattern Recognit..

[56]  Marie-Pierre Jolly,et al.  Interactive Graph Cuts for Optimal Boundary and Region Segmentation of Objects in N-D Images , 2001, ICCV.

[57]  Vladimir Kolmogorov,et al.  An experimental comparison of min-cut/max- flow algorithms for energy minimization in vision , 2001, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[58]  Marina Meila,et al.  Comparing clusterings: an axiomatic view , 2005, ICML.

[59]  Jayaram K. Udupa,et al.  Synergistic arc-weight estimation for interactive image segmentation using graphs , 2010, Comput. Vis. Image Underst..