Automatic Image Semantic Segmentation by MRF with Transformation-Invariant Shape Priors

Shape priors has greatly enhanced low-level driven image segmentations, however existing graph cut based segmentation methods still restrict to pre-aligned shape priors. The major contribution of this paper is to incorporate transformation-invariant shape priors into the graph cut algorithm for automatic image segmentations. The expectation of shape transformation and image knowledge are encoded into energy functions that is optimized in a MRF maximum likelihood framework using the expectation-maximization. The iteratively updated expectation process improves the segmentation robustness. In turn, the maximum likelihood segmentation is realized integrally by casting the lower-bound of energy function in a graph structure that can be effectively optimized by graph-cuts algorithm in order to achieve a global solution and also increase the accuracy of the probabilities measurement. Finally, experimental results demonstrate the potentials of our method under conditions of noises, clutters, and incomplete occlusions.

[1]  Yan Wang,et al.  DeepContour: A deep convolutional feature learned by positive-sharing loss for contour detection , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Olivier D. Faugeras,et al.  Shape Statistics for Image Segmentation with Prior , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Tony F. Chan,et al.  Level set based shape prior segmentation , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[4]  Adel Said Elmaghraby,et al.  Graph cut optimization for the Mumford-Shah model , 2007 .

[5]  Ning Xu,et al.  Object segmentation using graph cuts based active contours , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[6]  Stefano Soatto,et al.  Dynamic Textures , 2003, International Journal of Computer Vision.

[7]  Gregory G. Slabaugh,et al.  Graph cuts segmentation using an elliptical shape prior , 2005, IEEE International Conference on Image Processing 2005.

[8]  Scott Cohen,et al.  Geodesic graph cut for interactive image segmentation , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[9]  Yogesh Rathi,et al.  Graph Cut Segmentation with Nonlinear Shape Priors , 2007, 2007 IEEE International Conference on Image Processing.

[10]  Vladimir Kolmogorov,et al.  Graph cut based image segmentation with connectivity priors , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Jarrod D. Hadfield,et al.  MCMC methods for multi-response generalized linear mixed models , 2010 .

[12]  Gareth Funka-Lea,et al.  Graph Cuts and Efficient N-D Image Segmentation , 2006, International Journal of Computer Vision.

[13]  Tao Zhang,et al.  Interactive graph cut based segmentation with shape priors , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[14]  Daniel Cremers,et al.  Dynamical statistical shape priors for level set-based tracking , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Yogesh Rathi,et al.  Shape-Based Approach to Robust Image Segmentation using Kernel PCA , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).