Convex multi-region probabilistic segmentation with shape prior in the isometric log-ratio transformation space

Image segmentation is often performed via the minimization of an energy function over a domain of possible segmentations. The effectiveness and applicability of such methods depends greatly on the properties of the energy function and its domain, and on what information can be encoded by it. Here we propose an energy function that achieves several important goals. Specifically, our energy function is convex and incorporates shape prior information while simultaneously generating a probabilistic segmentation for multiple regions. Our energy function represents multi-region probabilistic segmentations as elements of a vector space using the isometric log-ratio (ILR) transformation. To our knowledge, these four goals (convex, with shape priors, multi-region, and probabilistic) do not exist together in any other method, and this is the first time ILR is used in an image segmentation method. We provide examples demonstrating the usefulness of these features.

[1]  William M. Wells,et al.  Simultaneous truth and performance level estimation (STAPLE): an algorithm for the validation of image segmentation , 2004, IEEE Transactions on Medical Imaging.

[2]  G. Mateu-Figueras,et al.  Isometric Logratio Transformations for Compositional Data Analysis , 2003 .

[3]  Jan-Michael Frahm,et al.  Fast Global Labeling for Real-Time Stereo Using Multiple Plane Sweeps , 2008, VMV.

[4]  S. Osher,et al.  Algorithms Based on Hamilton-Jacobi Formulations , 1988 .

[5]  W. Eric L. Grimson,et al.  Using the logarithm of odds to define a vector space on probabilistic atlases , 2007, Medical Image Anal..

[6]  Ghassan Hamarneh,et al.  Exploration and Visualization of Segmentation Uncertainty using Shape and Appearance Prior Information , 2010, IEEE Transactions on Visualization and Computer Graphics.

[7]  Hiroshi Ishikawa,et al.  Exact Optimization for Markov Random Fields with Convex Priors , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Timothy F. Cootes,et al.  Active Shape Models-Their Training and Application , 1995, Comput. Vis. Image Underst..

[9]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[10]  Xiaodong Wu,et al.  Simultaneous searching of globally optimal interacting surfaces with shape priors , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[11]  Lisa Tang,et al.  Simulation of Ground-Truth Validation Data Via Physically- and Statistically-Based Warps , 2008, MICCAI.

[12]  B. S. Manjunath,et al.  Shape prior segmentation of multiple objects with graph cuts , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Ghassan Hamarneh,et al.  Fast Random Walker with Priors Using Precomputation for Interactive Medical Image Segmentation , 2010, MICCAI.

[14]  Olga Veksler,et al.  Star Shape Prior for Graph-Cut Image Segmentation , 2008, ECCV.

[15]  John Aitchison,et al.  The Statistical Analysis of Compositional Data , 1986 .

[16]  Daniel Cremers,et al.  Dynamical statistical shape priors for level set-based tracking , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  J. Sethian,et al.  Fronts propagating with curvature-dependent speed: algorithms based on Hamilton-Jacobi formulations , 1988 .

[18]  Christoph Schnörr,et al.  Convex optimization for multi-class image labeling with a novel family of total variation based regularizers , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[19]  Ghassan Hamarneh,et al.  Probabilistic Multi-shape Segmentation of Knee Extensor and Flexor Muscles , 2011, MICCAI.

[20]  Daniel Cremers,et al.  A Convex Formulation of Continuous Multi-label Problems , 2008, ECCV.

[21]  Daniel Cremers,et al.  Shape priors in variational image segmentation: Convexity, Lipschitz continuity and globally optimal solutions , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  Yuri Boykov,et al.  Globally optimal segmentation of multi-region objects , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[23]  O. Faugeras,et al.  Statistical shape influence in geodesic active contours , 2002, 5th IEEE EMBS International Summer School on Biomedical Imaging, 2002..

[24]  Daniel Cremers,et al.  A convex relaxation approach for computing minimal partitions , 2009, CVPR.

[25]  Ghassan Hamarneh,et al.  Probabilistic Multi-Shape Representation Using an Isometric Log-Ratio Mapping , 2010, MICCAI.

[26]  Leo Grady,et al.  Multilabel random walker image segmentation using prior models , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[27]  T. Chan,et al.  Convex Formulation and Exact Global Solutions for Multi-phase Piecewise Constant Mumford-Shah Image Segmentation , 2009 .

[28]  Mila Nikolova,et al.  Algorithms for Finding Global Minimizers of Image Segmentation and Denoising Models , 2006, SIAM J. Appl. Math..