GC-ASM: Synergistic integration of graph-cut and active shape model strategies for medical image segmentation

Image segmentation methods may be classified into two categories: purely image based and model based. Each of these two classes has its own advantages and disadvantages. In this paper, we propose a novel synergistic combination of the image based graph-cut (GC) method with the model based ASM method to arrive at the GC-ASM method for medical image segmentation. A multi-object GC cost function is proposed which effectively integrates the ASM shape information into the GC framework. The proposed method consists of two phases: model building and segmentation. In the model building phase, the ASM model is built and the parameters of the GC are estimated. The segmentation phase consists of two main steps: initialization (recognition) and delineation. For initialization, an automatic method is proposed which estimates the pose (translation, orientation, and scale) of the model, and obtains a rough segmentation result which also provides the shape information for the GC method. For delineation, an iterative GC-ASM algorithm is proposed which performs finer delineation based on the initialization results. The proposed methods are implemented to operate on 2D images and evaluated on clinical chest CT, abdominal CT, and foot MRI data sets. The results show the following: (a) An overall delineation accuracy of TPVF > 96%, FPVF < 0.6% can be achieved via GC-ASM for different objects, modalities, and body regions. (b) GC-ASM improves over ASM in its accuracy and precision to search region. (c) GC-ASM requires far fewer landmarks (about 1/3 of ASM) than ASM. (d) GC-ASM achieves full automation in the segmentation step compared to GC which requires seed specification and improves on the accuracy of GC. (e) One disadvantage of GC-ASM is its increased computational expense owing to the iterative nature of the algorithm.

[1]  Xinjian Chen,et al.  Ball-scale based hierarchical multi-object recognition in 3D medical images , 2010, Medical Imaging.

[2]  David G. Stork,et al.  Pattern Classification (2nd ed.) , 1999 .

[3]  Elsa D. Angelini,et al.  State of the Art of Level Set Methods in Segmentation and Registration of Medical Imaging Modalities , 2005 .

[4]  N. Komodakis,et al.  Shape priors and discrete MRFs for knowledge-based segmentation , 2009, CVPR 2009.

[5]  David G. Stork,et al.  Pattern Classification , 1973 .

[6]  Nikos Paragios,et al.  3D cardiac segmentation with pose-invariant higher-order MRFs , 2012, 2012 9th IEEE International Symposium on Biomedical Imaging (ISBI).

[7]  D. Mumford,et al.  Optimal approximations by piecewise smooth functions and associated variational problems , 1989 .

[8]  Tao Zhang,et al.  Interactive graph cut based segmentation with shape priors , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[9]  Andrew Zisserman,et al.  OBJ CUT , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[10]  Xinjian Chen,et al.  GC-ASM: synergistic integration of active shape modeling and graph-cut methods , 2009, Medical Imaging.

[11]  Pushmeet Kohli,et al.  Simultaneous Segmentation and Pose Estimation of Humans Using Dynamic Graph Cuts , 2008, International Journal of Computer Vision.

[12]  Mihalis Yannakakis,et al.  The Complexity of Multiterminal Cuts , 1994, SIAM J. Comput..

[13]  Jun-ichiro Toriwaki,et al.  New algorithms for euclidean distance transformation of an n-dimensional digitized picture with applications , 1994, Pattern Recognit..

[14]  L O Hall,et al.  Review of MR image segmentation techniques using pattern recognition. , 1993, Medical physics.

[15]  Jun Zhang,et al.  The mean field theory in EM procedures for blind Markov random field image restoration , 1993, IEEE Trans. Image Process..

[16]  Xinjian Chen,et al.  Linear Time Algorithms for Exact Distance Transform , 2011, Journal of Mathematical Imaging and Vision.

[17]  Yogesh Rathi,et al.  Graph Cut Segmentation with Nonlinear Shape Priors , 2007, 2007 IEEE International Conference on Image Processing.

[18]  Dzung L. Pham,et al.  Spatial Models for Fuzzy Clustering , 2001, Comput. Vis. Image Underst..

[19]  Milan Sonka,et al.  Image Processing, Analysis and Machine Vision , 1993, Springer US.

[20]  Laurent D. Cohen,et al.  Finite-Element Methods for Active Contour Models and Balloons for 2-D and 3-D Images , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Demetri Terzopoulos,et al.  United Snakes , 1999, Medical Image Anal..

[22]  Paul M. Thompson,et al.  Detection, visualization and animation of abnormal anatomic structure with a deformable probabilistic brain atlas based on random vector field transformations , 1997, Medical Image Anal..

[23]  Jayaram K. Udupa,et al.  Optimum Image Thresholding via Class Uncertainty and Region Homogeneity , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Klaus D. Tönnies,et al.  Segmentation of multiple sclerosis lesions from MR brain images using the principles of fuzzy-connectedness and artificial neuron networks , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[25]  Camille Couprie,et al.  Power Watershed: A Unifying Graph-Based Optimization Framework , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Tomio Hirata,et al.  A Unified Linear-Time Algorithm for Computing Distance Maps , 1996, Inf. Process. Lett..

[27]  Jayaram K. Udupa,et al.  Iterative relative fuzzy connectedness for multiple objects with multiple seeds , 2007, Comput. Vis. Image Underst..

[28]  D. Freedman,et al.  Joint Segmentation-Registration of Organs Using Geometric Models , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[29]  Serge Beucher,et al.  THE WATERSHED TRANSFORMATION APPLIED TO IMAGE SEGMENTATION , 2009 .

[30]  Baba C. Vemuri,et al.  Large margin pursuit for a Conic Section classifier , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[31]  Jan A Snyman,et al.  Practical Mathematical Optimization: An Introduction to Basic Optimization Theory and Classical and New Gradient-Based Algorithms , 2005 .

[32]  Pushmeet Kohli,et al.  PoseCut: Simultaneous Segmentation and 3D Pose Estimation of Humans Using Dynamic Graph-Cuts , 2006, ECCV.

[33]  Jayaram K. Udupa,et al.  Oriented active shape models , 2006, SPIE Medical Imaging.

[34]  Supun Samarasekera,et al.  Fuzzy Connectedness and Object Definition: Theory, Algorithms, and Applications in Image Segmentation , 1996, CVGIP Graph. Model. Image Process..

[35]  Ugo Montanari,et al.  On the optimal detection of curves in noisy pictures , 1971, CACM.

[36]  Jing Bai,et al.  Atlas-Based Fuzzy Connectedness Segmentation and Intensity Nonuniformity Correction Applied to Brain MRI , 2007, IEEE Transactions on Biomedical Engineering.

[37]  Jerry L Prince,et al.  Current methods in medical image segmentation. , 2000, Annual review of biomedical engineering.

[38]  Steven W. Zucker,et al.  Region growing: Childhood and adolescence* , 1976 .

[39]  Marcel Worring,et al.  Watersnakes: Energy-Driven Watershed Segmentation , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[40]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[41]  Martin Styner,et al.  Automatic and Robust Computation of 3D Medial Models Incorporating Object Variability , 2003, International Journal of Computer Vision.

[42]  Guido Gerig,et al.  Multiscale medial shape-based analysis of image objects , 2003, Proc. IEEE.

[43]  Heinz-Otto Peitgen,et al.  Local-cost computation for efficient segmentation of 3D objects with live wire , 2001, SPIE Medical Imaging.

[44]  Thomas S. Huang,et al.  Image processing , 1971 .

[45]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[46]  Olga Veksler,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[47]  Timothy F. Cootes,et al.  Active Appearance Models , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[48]  Worthie Doyle,et al.  Operations Useful for Similarity-Invariant Pattern Recognition , 1962, JACM.

[49]  George Loizou,et al.  Computer vision and pattern recognition , 2007, Int. J. Comput. Math..

[50]  B. S. Manjunath,et al.  Shape prior segmentation of multiple objects with graph cuts , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[51]  Jayaram K. Udupa,et al.  A framework for evaluating image segmentation algorithms , 2006, Comput. Medical Imaging Graph..

[52]  M L Mendelsohn,et al.  THE ANALYSIS OF CELL IMAGES * , 1966, Annals of the New York Academy of Sciences.

[53]  M. Melamed Detection , 2021, SETI: Astronomy as a Contact Sport.

[54]  Jianhua Yao,et al.  Live level set: a hybrid method of livewire and level set for medical image segmentation. , 2008, Medical physics.

[55]  Dale Borowiak,et al.  Linear Models, Least Squares and Alternatives , 2001, Technometrics.

[56]  Michel Couprie,et al.  Some links between extremum spanning forests, watersheds and min-cuts , 2010, Image Vis. Comput..

[57]  Haluk Derin,et al.  Modeling and Segmentation of Noisy and Textured Images Using Gibbs Random Fields , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[58]  Ramin Zabih,et al.  Segmentation of the left ventricle in cardiac MR images using graph cuts with parametric shape priors , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[59]  Calvin R. Maurer,et al.  A Linear Time Algorithm for Computing Exact Euclidean Distance Transforms of Binary Images in Arbitrary Dimensions , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[60]  Serge Beucher,et al.  Use of watersheds in contour detection , 1979 .

[61]  Xiao Han,et al.  A Topology Preserving Level Set Method for Geometric Deformable Models , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[62]  Tony F. Chan,et al.  A Multiphase Level Set Framework for Image Segmentation Using the Mumford and Shah Model , 2002, International Journal of Computer Vision.

[63]  J. Udupa,et al.  Iterative relative fuzzy connectedness and object definition: theory, algorithms, and applications in image segmentation , 2000, Proceedings IEEE Workshop on Mathematical Methods in Biomedical Image Analysis. MMBIA-2000 (Cat. No.PR00737).

[64]  Jie Yang,et al.  A Novel Segmentation Method for MR Brain Images Based on Fuzzy Connectedness and FCM , 2005, FSKD.

[65]  Gregory G. Slabaugh,et al.  Graph cuts segmentation using an elliptical shape prior , 2005, IEEE International Conference on Image Processing 2005.

[66]  Milan Sonka,et al.  Multistage hybrid active appearance model matching: segmentation of left and right ventricles in cardiac MR images , 2001, IEEE Transactions on Medical Imaging.

[67]  Baba C. Vemuri,et al.  Shape Modeling with Front Propagation: A Level Set Approach , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[68]  Xinjian Chen,et al.  Automatic anatomy recognition via multiobject oriented active shape models. , 2010 .

[69]  Hsun K. Liu,et al.  Two and three dimensional boundary detection , 1977 .

[70]  Brian Everitt,et al.  Principles of Multivariate Analysis , 2001 .

[71]  Ramin Zabih,et al.  Graph Cuts Segmentation with Statistical Shape Priors for Medical Images , 2007, 2007 Third International IEEE Conference on Signal-Image Technologies and Internet-Based System.

[72]  Nikos Paragios,et al.  Tagged cardiac MR image segmentation using boundary & regional-support and graph-based deformable priors , 2011, 2011 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[73]  Nikos Paragios,et al.  Prior Knowledge, Level Set Representations & Visual Grouping , 2008, International Journal of Computer Vision.

[74]  James M. Keller,et al.  Snakes on the Watershed , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[75]  Wojtek J. Krzanowski,et al.  Principles of multivariate analysis : a user's perspective. oxford , 1988 .

[76]  Jayaram K. Udupa,et al.  A 3D generalization of user-steered live-wire segmentation , 2000, Medical Image Anal..

[77]  Milan Sonka,et al.  Image pre-processing , 1993 .

[78]  R. Rabbitt,et al.  3D brain mapping using a deformable neuroanatomy. , 1994, Physics in medicine and biology.

[79]  Jayaram K. Udupa,et al.  Relative Fuzzy Connectedness and Object Definition: Theory, Algorithms, and Applications in Image Segmentation , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[80]  Jøger Hansegård,et al.  Constrained Active Appearance Models for Segmentation of Triplane Echocardiograms , 2007, IEEE Transactions on Medical Imaging.

[81]  Richard M. Leahy,et al.  An Optimal Graph Theoretic Approach to Data Clustering: Theory and Its Application to Image Segmentation , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[82]  Xiaobo Li,et al.  Adaptive image region-growing , 1994, IEEE Trans. Image Process..

[83]  Joanne Hardy,et al.  Prior knowledge. , 2006, Nursing standard (Royal College of Nursing (Great Britain) : 1987).

[84]  Jayaram K. Udupa,et al.  User-Steered Image Segmentation Paradigms: Live Wire and Live Lane , 1998, Graph. Model. Image Process..

[85]  Hiroshi Ishikawa,et al.  Exact Optimization for Markov Random Fields with Convex Priors , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[86]  Timothy F. Cootes,et al.  Active Shape Models-Their Training and Application , 1995, Comput. Vis. Image Underst..

[87]  Gareth Funka-Lea,et al.  Graph Cuts and Efficient N-D Image Segmentation , 2006, International Journal of Computer Vision.