Oriented Active Shape Models

Active shape models (ASM) are widely employed for recognizing anatomic structures and for delineating them in medical images. In this paper, a novel strategy called oriented active shape models (OASM) is presented in an attempt to overcome the following five limitations of ASM: 1) lower delineation accuracy, 2) the requirement of a large number of landmarks, 3) sensitivity to search range, 4) sensitivity to initialization, and 5) inability to fully exploit the specific information present in the given image to be segmented. OASM effectively combines the rich statistical shape information embodied in ASM with the boundary orientedness property and the globally optimal delineation capability of the live wire methodology of boundary segmentation. The latter characteristics allow live wire to effectively separate an object boundary from other nonobject boundaries with similar properties especially when they come very close in the image domain. The approach leads to a two-level dynamic programming method, wherein the first level corresponds to boundary recognition and the second level corresponds to boundary delineation, and to an effective automatic initialization method. The method outputs a globally optimal boundary that agrees with the shape model if the recognition step is successful in bringing the model close to the boundary in the image. Extensive evaluation experiments have been conducted by utilizing 40 image (magnetic resonance and computed tomography) data sets in each of five different application areas for segmenting breast, liver, bones of the foot, and cervical vertebrae of the spine. Comparisons are made between OASM and ASM based on precision, accuracy, and efficiency of segmentation. Accuracy is assessed using both region-based false positive and false negative measures and boundary-based distance measures. The results indicate the following: 1) The accuracy of segmentation via OASM is considerably better than that of ASM; 2) The number of landmarks can be reduced by a factor of 3 in OASM over that in ASM; 3) OASM becomes largely independent of search range and initialization becomes automatic. All three benefits of OASM ensue mainly from the severe constraints brought in by the boundary-orientedness property of live wire and the globally optimal solution found by the 2-level dynamic programming algorithm.

[1]  Anil K. Jain,et al.  Deformable template models: A review , 1998, Signal Process..

[2]  Yo-Sung Ho,et al.  A new general method of 3D model generation for active shape image segmentation , 2006, SPIE Medical Imaging.

[3]  Jayaram K. Udupa,et al.  User-Steered Image Segmentation Paradigms: Live Wire and Live Lane , 1998, Graph. Model. Image Process..

[4]  Timothy F. Cootes,et al.  Active Shape Models-Their Training and Application , 1995, Comput. Vis. Image Underst..

[5]  Jayaram K. Udupa Multidimensional Digital Boundaries , 1994, CVGIP Graph. Model. Image Process..

[6]  Jayaram K. Udupa,et al.  Adaptive boundary detection using 'live-wire' two-dimensional dynamic programming , 1992, Proceedings Computers in Cardiology.

[7]  Michael Kohnen,et al.  Model-based analysis of chest radiographs , 2000, Medical Imaging: Image Processing.

[8]  Demetri Terzopoulos,et al.  Deformable models , 2000, The Visual Computer.

[9]  Laurent D. Cohen,et al.  On active contour models and balloons , 1991, CVGIP Image Underst..

[10]  Milan Sonka,et al.  Object localization and border detection criteria design in edge-based image segmentation: automated learning from examples , 2000, IEEE Transactions on Medical Imaging.

[11]  Horst Bischof,et al.  ASM Driven Snakes in Rheumatoid Arthritis Assessment , 2003, SCIA.

[12]  Milan Sonka,et al.  Multistage hybrid active appearance model matching: segmentation of left and right ventricles in cardiac MR images , 2001, IEEE Transactions on Medical Imaging.

[13]  Demetri Terzopoulos,et al.  United Snakes , 1999, Medical Image Anal..

[14]  Jayaram K. Udupa,et al.  Multiobject relative fuzzy connectedness and its implications in image segmentation , 2001, SPIE Medical Imaging.

[15]  Jayaram K. Udupa,et al.  Fuzzy connectedness and image segmentation , 2003, Proc. IEEE.

[16]  Max A. Viergever,et al.  A discrete dynamic contour model , 1995, IEEE Trans. Medical Imaging.

[17]  Milan Sonka,et al.  Automated contour detection in X-ray left ventricular angiograms using multiview active appearance models and dynamic programming , 2006, IEEE Transactions on Medical Imaging.

[18]  Timothy F. Cootes,et al.  Active Appearance Models , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  C J Taylor,et al.  The use of active shape models for making thickness measurements of articular cartilage from MR images , 1997, Magnetic resonance in medicine.

[20]  William A. Barrett,et al.  Interactive Segmentation with Intelligent Scissors , 1998, Graph. Model. Image Process..

[21]  Alejandro F. Frangi,et al.  Active shape model segmentation with optimal features , 2002, IEEE Transactions on Medical Imaging.

[22]  Jürgen Weese,et al.  Automated segmentation of the left ventricle in cardiac MRI , 2004, Medical Image Anal..

[23]  Timothy F. Cootes,et al.  The Use of Active Shape Models for Locating Structures in Medical Images , 1993, IPMI.

[24]  Stuart Solloway,et al.  Quantification of Articular Cartilage from MR Images Using Active Shape Models , 1996, ECCV.

[25]  Timothy F. Cootes,et al.  Non-linear generalization of point distribution models using polynomial regression , 1995, Image Vis. Comput..

[26]  G. Hamarneh,et al.  Combining snakes and active shape models for segmenting the human left ventricle in echocardiographic images , 2000, Computers in Cardiology 2000. Vol.27 (Cat. 00CH37163).

[27]  Xiaodong Wu,et al.  Optimal Surface Segmentation in Volumetric Images-A Graph-Theoretic Approach , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  David N. Levin,et al.  Brownian strings: segmenting images with stochastically deformable contours , 1994, Other Conferences.

[29]  Demetri Terzopoulos,et al.  Topologically adaptable snakes , 1995, Proceedings of IEEE International Conference on Computer Vision.

[30]  D. Cremers,et al.  Diffusion-snakes: combining statistical shape knowledge and image information in a variational framework , 2001, Proceedings IEEE Workshop on Variational and Level Set Methods in Computer Vision.

[31]  Christopher J. Taylor,et al.  Automatic measurement of vertebral shape using active shape models , 1997, Image Vis. Comput..

[32]  Max A. Viergever,et al.  Interactive shape models , 2003, SPIE Medical Imaging.

[33]  Jayaram K. Udupa,et al.  An ultra-fast user-steered image segmentation paradigm: live wire on the fly , 2000, IEEE Transactions on Medical Imaging.

[34]  Timothy F. Cootes,et al.  Use of active shape models for locating structures in medical images , 1994, Image Vis. Comput..

[35]  Sankar K. Pal,et al.  A review on image segmentation techniques , 1993, Pattern Recognit..

[36]  Alok Gupta,et al.  Dynamic Programming for Detecting, Tracking, and Matching Deformable Contours , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[37]  Paul Suetens,et al.  Evaluation of image features and search strategies for segmentation of bone structures in radiographs using Active Shape Models , 2002, Medical Image Anal..

[38]  Jayaram K. Udupa,et al.  Oriented active shape models , 2006, SPIE Medical Imaging.

[39]  Timothy F. Cootes,et al.  Statistical models of appearance for computer vision , 1999 .

[40]  Jerry L. Prince,et al.  A Survey of Current Methods in Medical Image Segmentation , 1999 .

[41]  Jerry L Prince,et al.  Current methods in medical image segmentation. , 2000, Annual review of biomedical engineering.

[42]  O. Faugeras,et al.  Statistical shape influence in geodesic active contours , 2002, 5th IEEE EMBS International Summer School on Biomedical Imaging, 2002..

[43]  Jayaram K. Udupa,et al.  Automatic landmark selection for active shape models , 2005, SPIE Medical Imaging.

[44]  Mongi A. Abidi,et al.  Video Object Tracking Based On Extended Active Shape Models With Color Information , 2002, CGIV.

[45]  Paul Suetens,et al.  Active Shape Model-Based Segmentation of Digital X-ray Images , 1999, MICCAI.

[46]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[47]  Timothy F. Cootes,et al.  Combining point distribution models with shape models based on finite element analysis , 1994, Image Vis. Comput..

[48]  Brian Everitt,et al.  Principles of Multivariate Analysis , 2001 .

[49]  Milan Sonka,et al.  Segmentation and interpretation of MR brain images. An improved active shape model , 1998, IEEE Transactions on Medical Imaging.

[50]  Jayaram K. Udupa,et al.  A framework for evaluating image segmentation algorithms , 2006, Comput. Medical Imaging Graph..