Combining region-based and imprecise boundary-based cues for interactive medical image segmentation.

In this paper, we present an approach combining both region selection and user point selection for user-assisted segmentation as either an enclosed object or an open curve, investigate the method of image segmentation in specific medical applications (user-assisted segmentation of the media-adventitia border in intravascular ultrasound images, and lumen border in optical coherence tomography images), and then demonstrate the method with generic images to show how it could be utilized in other types of medical image and is not limited to the applications described. The proposed method combines point-based soft constraint on object boundary and stroke-based regional constraint. The user points act as attraction points and are treated as soft constraints rather than hard constraints that the segmented boundary has to pass through. The user can also use strokes to specify region of interest. The probabilities of region of interest for each pixel are then calculated, and their discontinuity is used to indicate object boundary. The combinations of different types of user constraints and image features allow flexible and robust segmentation, which is formulated as an energy minimization problem on a multilayered graph and is solved using a shortest path search algorithm. We show that this combinatorial approach allows efficient and effective interactive segmentation, which can be used with both open and closed curves to segment a variety of images in different ways. The proposed method is demonstrated in the two medical applications, that is, intravascular ultrasound and optical coherence tomography images, where image artefacts such as acoustic shadow and calcification are commonplace and thus user guidance is desirable. We carried out both qualitative and quantitative analysis of the results for the medical data; comparing the proposed method against a number of interactive segmentation techniques.

[1]  Olga Veksler,et al.  Star Shape Prior for Graph-Cut Image Segmentation , 2008, ECCV.

[2]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[3]  Nassir Navab,et al.  A State-of-the-Art Review on Segmentation Algorithms in Intravascular Ultrasound (IVUS) Images , 2012, IEEE Transactions on Information Technology in Biomedicine.

[4]  Daniel Cremers,et al.  Beyond connecting the dots: A polynomial-time algorithm for segmentation and boundary estimation with imprecise user input , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[5]  Leo Grady,et al.  A Seeded Image Segmentation Framework Unifying Graph Cuts And Random Walker Which Yields A New Algorithm , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[6]  Vladimir Kolmogorov,et al.  "GrabCut": interactive foreground extraction using iterated graph cuts , 2004, ACM Trans. Graph..

[7]  Dimitrios I. Fotiadis,et al.  Fully automated calcium detection using optical coherence tomography , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[8]  Andrew Blake,et al.  Geodesic star convexity for interactive image segmentation , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[9]  Marie-Pierre Jolly,et al.  Interactive Organ Segmentation Using Graph Cuts , 2000, MICCAI.

[10]  Daniel Rueckert,et al.  Automatical vessel wall detection in intravascular coronary OCT , 2011, 2011 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[11]  Yuanyuan Wang,et al.  Estimating coronary artery lumen area with optimization-based contour detection , 2003, IEEE Transactions on Medical Imaging.

[12]  Dorothea Wagner,et al.  Engineering multilevel overlay graphs for shortest-path queries , 2009, JEAL.

[13]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[14]  Andrew Blake,et al.  "GrabCut" , 2004, ACM Trans. Graph..

[15]  Dorothea Wagner,et al.  Geometric Speed-Up Techniques for Finding Shortest Paths in Large Sparse Graphs , 2003, ESA.

[16]  Jian Sun,et al.  Lazy snapping , 2004, SIGGRAPH 2004.

[17]  K.B. Chandran,et al.  Lumen detection in human IVUS images using region-growing , 1996, Computers in Cardiology 1996.

[18]  William A. Barrett,et al.  Interactive Segmentation with Intelligent Scissors , 1998, Graph. Model. Image Process..

[19]  Jonathan Warrell,et al.  “Lattice Cut” - Constructing superpixels using layer constraints , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[20]  Yogesh Rathi,et al.  Graph Cut Segmentation with Nonlinear Shape Priors , 2007, 2007 IEEE International Conference on Image Processing.

[21]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Dorin Comaniciu,et al.  Real-time tracking of non-rigid objects using mean shift , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[23]  Sergio Shiguemi Furuie,et al.  An automatic media-adventitia border segmentation approach for IVUS images , 2010, 2010 Computing in Cardiology.

[24]  Elsa D. Angelini,et al.  Automatic detection of luminal borders in IVUS images by magnitude-phase histograms of complex brushlet coefficients , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[25]  Jayaram K. Udupa,et al.  User-Steered Image Segmentation Paradigms: Live Wire and Live Lane , 1998, Graph. Model. Image Process..

[26]  Milan Sonka,et al.  Segmentation of intravascular ultrasound images: a knowledge-based approach , 1995, IEEE Trans. Medical Imaging.

[27]  Stefano Soatto,et al.  Class segmentation and object localization with superpixel neighborhoods , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[28]  Luc Vincent,et al.  Watersheds in Digital Spaces: An Efficient Algorithm Based on Immersion Simulations , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  B. S. Manjunath,et al.  Shape prior segmentation of multiple objects with graph cuts , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[30]  Marie-Pierre Jolly,et al.  Interactive graph cuts for optimal boundary & region segmentation of objects in N-D images , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[31]  Laurent D. Cohen,et al.  Global Minimum for Active Contour Models: A Minimal Path Approach , 1997, International Journal of Computer Vision.

[32]  Xianghua Xie,et al.  Shape Prior Model for Media-Adventitia Border Segmentation in IVUS Using Graph Cut , 2012, MCV.

[33]  Jean Ponce,et al.  Segmentation by transduction , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[34]  Tao Zhang,et al.  Interactive graph cut based segmentation with shape priors , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).