Iterative image segmentation with feature driven heuristic four-color labeling

A heuristic four color labeling method is proposed to give robust initial foul-phase partition for Multiphase Multiple Piecewise Constant (MMPC) model.A regional adjacency cracking method is proposed to remove unnecessary adjacency constraints which impede the four color labeling.Compared with the random four color labeling, the color map of heuristic coloring shows better consistency for the homogenous regions.The heuristic four color labeling based approach reaches the good or even better segmentation with fewer iterations. Multilabel segmentation is an important research branch in image segmentation field. In our previous work, Multiphase Multiple Piecewise Constant and Geodesic Active Contour (MMPC-GAC) model was proposed, which can effectively describe multiple objects and background with intensity inhomogeneity. It can be approximately solved with Multiple Layer Graph (MLG) methods. To make the optimization more efficient and limit the approximate error, four-color labeling theorem was further introduced which can limit the MLG within three layers (representing four phases). However, the adopted random four-color labeling method usually provides chaotic color maps with obvious inhomogeneity for those semantic consistent regions. For this case, a new and alternative method named heuristic four-color labeling is proposed in this paper, which aims to generate more reasonable color maps with a global view of the whole image. And compared with the random four-color labeling strategy, the whole iterative algorithm based on our method usually produces better segmentations with faster convergence, particularly for images with clutters and complicated structures. This strategy is a good substitute for random coloring method when the latter produces unsatisfactory messy segmentation. Experiments conducted on public dataset demonstrate the effectiveness of the proposed method.

[1]  Seunghoon Hong,et al.  Learning Deconvolution Network for Semantic Segmentation , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[2]  Hiroshi Ishikawa,et al.  Exact Optimization for Markov Random Fields with Convex Priors , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Wenbing Tao,et al.  SaCoseg: Object Cosegmentation by Shape Conformability , 2015, IEEE Transactions on Image Processing.

[4]  K. Appel,et al.  Every Planar Map Is Four Colorable , 2019, Mathematical Solitaires & Games.

[5]  Jitendra Malik,et al.  Normalized Cuts and Image Segmentation , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Xiangchu Feng,et al.  A multiscale image segmentation method , 2016, Pattern Recognit..

[7]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[8]  Jianfei Cai,et al.  Beyond pixels: A comprehensive survey from bottom-up to semantic image segmentation and cosegmentation , 2015, J. Vis. Commun. Image Represent..

[9]  Xue-Cheng Tai,et al.  Graph Cut Optimization for the Piecewise Constant Level Set Method Applied to Multiphase Image Segmentation , 2009, SSVM.

[10]  Long Quan,et al.  Regularized Tree Partitioning and Its Application to Unsupervised Image Segmentation , 2014, IEEE Transactions on Image Processing.

[11]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[12]  Charless C. Fowlkes,et al.  Contour Detection and Hierarchical Image Segmentation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Dapeng Wu,et al.  Modularity-Based Image Segmentation , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[14]  D. Mumford,et al.  Optimal approximations by piecewise smooth functions and associated variational problems , 1989 .

[15]  Wenbing Tao,et al.  Complementary saliency driven co-segmentation with region searching and Hierarchical constraint , 2016, Inf. Sci..

[16]  Luc Vincent,et al.  Watersheds in Digital Spaces: An Efficient Algorithm Based on Immersion Simulations , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Wenbing Tao,et al.  Image segmentation by iterative optimization of multiphase multiple piecewise constant model and Four-Color relabeling , 2011, Pattern Recognit..

[18]  Allen Y. Yang,et al.  Unsupervised segmentation of natural images via lossy data compression , 2008, Comput. Vis. Image Underst..

[19]  Wei-Xue Liu,et al.  Towards parameter-independent data clustering and image segmentation , 2016, Pattern Recognit..

[20]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Nurdan Akhan Baykan,et al.  Sequential image segmentation based on minimum spanning tree representation , 2017, Pattern Recognit. Lett..

[22]  Martial Hebert,et al.  Toward Objective Evaluation of Image Segmentation Algorithms , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Keith Price,et al.  Picture Segmentation Using a Recursive Region Splitting Method , 1998 .

[24]  Christian Desrosiers,et al.  Unsupervised segmentation using dynamic superpixel random walks , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[25]  Daniel P. Huttenlocher,et al.  Efficient Graph-Based Image Segmentation , 2004, International Journal of Computer Vision.

[26]  Christian Desrosiers A Fast and Adaptive Random Walks Approach for the Unsupervised Segmentation of Natural Images , 2014, 2014 22nd International Conference on Pattern Recognition.

[27]  Siu Kai Choy,et al.  Fuzzy model-based clustering and its application in image segmentation , 2017, Pattern Recognit..

[28]  Wenbing Tao,et al.  Adaptive Optimal Shape Prior for Easy Interactive Object Segmentation , 2015, IEEE Transactions on Multimedia.

[29]  Yinhui Zhang,et al.  Unsupervised segmentation of highly dynamic scenes through global optimization of multiscale cues , 2015, Pattern Recognit..

[30]  Wenbing Tao,et al.  Image segmentation based on anisotropic diffusion and graph cuts optimisation , 2014 .

[31]  Katsushi Ikeuchi,et al.  Geodesic Active Contour , 2014, Computer Vision, A Reference Guide.

[32]  Vladimir Kolmogorov,et al.  "GrabCut": interactive foreground extraction using iterated graph cuts , 2004, ACM Trans. Graph..

[33]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[34]  Charles T. Zahn,et al.  Graph-Theoretical Methods for Detecting and Describing Gestalt Clusters , 1971, IEEE Transactions on Computers.

[35]  Leo Grady,et al.  Isoperimetric graph partitioning for image segmentation , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[36]  Ingemar J. Cox,et al.  "Ratio regions": a technique for image segmentation , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[37]  Wenbing Tao,et al.  Unsupervised Co-Segmentation for Indefinite Number of Common Foreground Objects , 2016, IEEE Transactions on Image Processing.

[38]  M. Meilă Comparing clusterings---an information based distance , 2007 .

[39]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[40]  Sudeep Sarkar,et al.  Investigation of measures for grouping by graph partitioning , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[41]  Jianbo Shi,et al.  Spectral segmentation with multiscale graph decomposition , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[42]  James F. Peters,et al.  Voronoi Region-Based Adaptive Unsupervised Color Image Segmentation , 2016, Pattern Recognit..

[43]  Delbert Dueck,et al.  Clustering by Passing Messages Between Data Points , 2007, Science.

[44]  Xavier Cufí,et al.  Yet Another Survey on Image Segmentation: Region and Boundary Information Integration , 2002, ECCV.

[45]  Guillermo Sapiro,et al.  Geodesic Active Contours , 1995, International Journal of Computer Vision.

[46]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[47]  Hai Jin,et al.  Color Image Segmentation Based on Mean Shift and Normalized Cuts , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[48]  Xavier Bresson,et al.  Fast Global Minimization of the Active Contour/Snake Model , 2007, Journal of Mathematical Imaging and Vision.

[49]  Jian Sun,et al.  Lazy snapping , 2004, SIGGRAPH 2004.

[50]  Xue-Cheng Tai,et al.  Global Minimization for Continuous Multiphase Partitioning Problems Using a Dual Approach , 2011, International Journal of Computer Vision.