Mutilabel MRFs with Label Adjacency Constraint : Globally Optimal Solutions and Applications

This work addresses the problem of optimally solving Markov Random Fields(MRFs) in which labels obey a certain topology constraint. Utilizing prior information, such as domain knowledge about the appearance, shape, or spatial configuration of objects in a scene can greatly improve the accuracy of segmentation algorithms in the presence of noise, clutter, and occlusion. Nowhere is this more evident than in the segmentation of biomedical images, where typically the spatial relationships among the image regions inherently reflect those of the anatomical structures being imaged. In this work, we propose a new methodology to segment a special class of images, which exhibit nested layer topologies often encountered in biomedical applications. The segmentation problem is modeled using multi-label Markov Random Fields with an additional label adjacency constraint (LAC). The multi-label MRF energy with LAC is transformed via boolean variables encoding into an equivalent function of binary variables. We show this boolean function is submodular, graph representable, and can be minimized exactly and efficiently with graph cut techniques. Our experimental results on both synthetic and real images demonstrate the utility of the proposed LAC segmentation algorithm.

[1]  Xiaodong Wu,et al.  Intraretinal Layer Segmentation of Macular Optical Coherence Tomography Images Using Optimal 3-D Graph Search , 2008, IEEE Transactions on Medical Imaging.

[2]  D. Schlesinger,et al.  TRANSFORMING AN ARBITRARY MINSUM PROBLEM INTO A BINARY ONE , 2006 .

[3]  Marie-Pierre Jolly,et al.  Interactive graph cuts for optimal boundary & region segmentation of objects in N-D images , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[4]  Martial Hebert,et al.  Toward Objective Evaluation of Image Segmentation Algorithms , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  B. S. Manjunath,et al.  Texture Features for Browsing and Retrieval of Image Data , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Vladimir Kolmogorov,et al.  What energy functions can be minimized via graph cuts? , 2002, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Olga Veksler,et al.  Fast approximate energy minimization via graph cuts , 2001, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[8]  Rachid Deriche,et al.  Active unsupervised texture segmentation on a diffusion based feature space , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[9]  Tony F. Chan,et al.  A Multiphase Level Set Framework for Image Segmentation Using the Mumford and Shah Model , 2002, International Journal of Computer Vision.

[10]  Pushmeet Kohli,et al.  P3 & Beyond: Solving Energies with Higher Order Cliques , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Vladimir Kolmogorov,et al.  Minimizing Nonsubmodular Functions with Graph Cuts-A Review , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Luminita A. Vese,et al.  Energy Minimization Based Segmentation and Denoising Using a Multilayer Level Set Approach , 2005, EMMCVPR.

[13]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Yogesh Rathi,et al.  A Graph Cut Approach to Image Segmentation in Tensor Space , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Nikos Paragios,et al.  Shape Priors for Level Set Representations , 2002, ECCV.

[16]  Thomas Brox,et al.  A TV Flow Based Local Scale Measure for Texture Discrimination , 2004, ECCV.

[17]  Carlo Tomasi,et al.  Fast Tiered Labeling with Topological Priors , 2012, ECCV.

[18]  T. Chan,et al.  A Variational Level Set Approach to Multiphase Motion , 1996 .

[19]  Alexei A. Efros,et al.  Recovering Surface Layout from an Image , 2007, International Journal of Computer Vision.

[20]  Pushmeet Kohli,et al.  Exact inference in multi-label CRFs with higher order cliques , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  R. Zabih,et al.  What energy functions can be minimized via graph cuts , 2004 .

[22]  W. Eric L. Grimson,et al.  A shape-based approach to the segmentation of medical imagery using level sets , 2003, IEEE Transactions on Medical Imaging.

[23]  Vladimir Kolmogorov,et al.  An experimental comparison of min-cut/max- flow algorithms for energy minimization in vision , 2001, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Pushmeet Kohli,et al.  Dynamic Graph Cuts for Efficient Inference in Markov Random Fields , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Daniel Cremers,et al.  Globally Optimal Image Segmentation with an Elastic Shape Prior , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[26]  Vladimir Kolmogorov,et al.  "GrabCut": interactive foreground extraction using iterated graph cuts , 2004, ACM Trans. Graph..

[27]  Endre Boros,et al.  Pseudo-Boolean optimization , 2002, Discret. Appl. Math..

[28]  Olga Veksler,et al.  Graph cut with ordering constraints on labels and its applications , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[29]  Hiroshi Ishikawa,et al.  Exact Optimization for Markov Random Fields with Convex Priors , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  O. Faugeras,et al.  Statistical shape influence in geodesic active contours , 2002, 5th IEEE EMBS International Summer School on Biomedical Imaging, 2002..

[31]  Pushmeet Kohli,et al.  Robust Higher Order Potentials for Enforcing Label Consistency , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[32]  Larry S. Davis,et al.  Efficient Kernel Density Estimation Using the Fast Gauss Transform with Applications to Color Modeling and Tracking , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[33]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[34]  Eric V. Denardo,et al.  Flows in Networks , 2011 .

[35]  D. Greig,et al.  Exact Maximum A Posteriori Estimation for Binary Images , 1989 .

[36]  Martin J. Wainwright,et al.  MAP estimation via agreement on trees: message-passing and linear programming , 2005, IEEE Transactions on Information Theory.

[37]  Geoffrey P. Lewis,et al.  Cellular remodeling in mammalian retina: results from studies of experimental retinal detachment , 2005, Progress in Retinal and Eye Research.

[38]  Daniel Freedman,et al.  Energy minimization via graph cuts: settling what is possible , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[39]  Yuri Boykov,et al.  A Scalable graph-cut algorithm for N-D grids , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[40]  Olga Veksler,et al.  Tiered scene labeling with dynamic programming , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[41]  Vladimir Kolmogorov,et al.  Convergent Tree-Reweighted Message Passing for Energy Minimization , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[42]  Thomas Brox,et al.  A TV flow based local scale estimate and its application to texture discrimination , 2006, J. Vis. Commun. Image Represent..

[43]  Larry S. Davis,et al.  Improved fast gauss transform and efficient kernel density estimation , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.