Medical image segmentation via atlases and fuzzy object models: Improving efficacy through optimum object search and fewer models.

PURPOSE Statistical object shape models (SOSMs), known as probabilistic atlases, are popular in medical image segmentation. They register an image into the atlas coordinate system, such that a desired object can be delineated from the constraints of its shape model. While this strategy facilitates segmenting objects with even weak-boundary contrast, it tends to require more models per object to cope with possible registration errors. Fuzzy object shape models (FOSMs) gain substantial speed by avoiding image registration and placing more relaxed model constraints with optimum object search. However, they tend to require stronger object boundary contrast for effective delineation. In this work, the authors show that optimum object search, the essential underpinning of FOSMs, can improve segmentation efficacy of SOSMs with fewer models per object. METHODS For the sake of efficiency, the authors use three atlases per object (SOSM-3) as baseline for segmentation based on the best match with posterior probability maps. A novel strategy for SOSM with a single atlas and optimum object search (SOSM-S) is presented. When registering an image to the atlas system, one should expect that the object's boundary falls within the uncertainty region of the model-region wherein voxels show probabilities greater than 0 and less than 1 to be in the object. Since registration may fail, SOSM-S translates the atlas locally and, at each location, delineates and scores a candidate object in the uncertainty region. Segmentation is defined by the candidate with the highest score. The presented FOSM also uses a single model per object, but model construction uses only shape translations, building a fuzzy object model with larger uncertainty region. Optimum object search requires estimation of the object's location and/or optimization algorithms to speed-up segmentation. RESULTS The authors evaluate SOSM-3, SOSM-S, and FOSM on 75 CT-images of the thorax and 35 MR T1-weighted images of the brain, with nine objects of interest. The results show that SOSM-S and FOSM can segment seven out of the nine objects with higher accuracy than SOSM-3, according to the average symmetric surface distance and statistical test. SOSM-S was consistently more accurate than FOSM, FOSM being 2-3 orders of magnitude faster than SOSM-S and SOSM-3 for model construction and hundreds of times faster than them for segmentation. CONCLUSIONS Although multiple models per object can usually improve segmentation efficacy, the optimum object search has shown to reduce the number of required models. The efficiency gain of FOSM over SOSM-S motivates its use for interactive applications and studies with large image data sets. FOSM and SOSM impose different degrees of shape constraints from the model, making one approach more suitable than the other, depending on contrast. This suggests the use of hybrid models that can take advantage from the strengths of fuzzy and statistical models.

[1]  Stefan Klein,et al.  Cerebellum segmentation in MRI using atlas registration and local multi-scale image descriptors , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[2]  Benoit M. Dawant,et al.  Evaluation of multi atlas-based approaches for the segmentation of the thyroid gland in IMRT head-and-neck CT images , 2011, Medical Imaging.

[3]  Jayaram K. Udupa,et al.  Fuzzy object modeling , 2011, Medical Imaging.

[4]  Jayaram K. Udupa,et al.  Body-wide hierarchical fuzzy modeling, recognition, and delineation of anatomy in medical images , 2014, Medical Image Anal..

[5]  Paulo André Vechiatto Miranda,et al.  A case analysis of the impact of prior center of gravity estimation over skull-stripping algorithms in MR images , 2013, 2013 IEEE International Conference on Image Processing.

[6]  Xinjian Chen,et al.  Automatic anatomy recognition via multiobject oriented active shape models. , 2010 .

[7]  Jayaram K. Udupa,et al.  Clouds: A model for synergistic image segmentation , 2008, 2008 5th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[8]  Xinjian Chen,et al.  Medical Image Segmentation by Combining Graph Cuts and Oriented Active Appearance Models , 2012, IEEE Transactions on Image Processing.

[9]  Meritxell Bach Cuadra,et al.  A review of atlas-based segmentation for magnetic resonance brain images , 2011, Comput. Methods Programs Biomed..

[10]  Yunjie Chen,et al.  A New Fast Brain Skull Stripping Method , 2009, 2009 2nd International Conference on Biomedical Engineering and Informatics.

[11]  Jayaram K. Udupa,et al.  Cloud bank: A multiple clouds model and its use in MR brain image segmentation , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[12]  Jayaram K. Udupa,et al.  User-Steered Image Segmentation Paradigms: Live Wire and Live Lane , 1998, Graph. Model. Image Process..

[13]  Timothy F. Cootes,et al.  Active Shape Models-Their Training and Application , 1995, Comput. Vis. Image Underst..

[14]  Jayaram K. Udupa,et al.  Automatic anatomy recognition via fuzzy object models , 2012, Medical Imaging.

[15]  Jayaram K. Udupa,et al.  Oriented Active Shape Models , 2009, IEEE Transactions on Medical Imaging.

[16]  Max A. Viergever,et al.  elastix: A Toolbox for Intensity-Based Medical Image Registration , 2010, IEEE Transactions on Medical Imaging.

[17]  Paul A. Yushkevich,et al.  Multi-Atlas Segmentation with Joint Label Fusion , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Arthur W. Toga,et al.  A Probabilistic Atlas of the Human Brain: Theory and Rationale for Its Development The International Consortium for Brain Mapping (ICBM) , 1995, NeuroImage.

[19]  Juha Koikkalainen,et al.  Improved generation of probabilistic atlases for the expectation maximization classification , 2011, 2011 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[20]  Jayaram K. Udupa,et al.  Medical image segmentation using object atlas versus object cloud models , 2015, Medical Imaging.

[21]  Jayaram K. Udupa,et al.  Fuzzy object model based fuzzy connectedness image segmentation of newborn brain MR images , 2012, 2012 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[22]  Jorge Stolfi,et al.  The image foresting transform: theory, algorithms, and applications , 2004 .

[23]  Anant Madabhushi,et al.  Statistical 3D prostate imaging atlas construction via anatomically constrained registration , 2013, Medical Imaging.

[24]  Fabrice Mériaudeau,et al.  Prostate Segmentation with Texture Enhanced Active Appearance Model , 2010, 2010 Sixth International Conference on Signal-Image Technology and Internet Based Systems.

[25]  J. A. Hartigan,et al.  A k-means clustering algorithm , 1979 .

[26]  Hans-Peter Meinzer,et al.  3D Active Shape Models Using Gradient Descent Optimization of Description Length , 2005, IPMI.

[27]  Gerard van Burken,et al.  Automatic active appearance model segmentation of 3D echocardiograms , 2010, 2010 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[28]  Yi Gao,et al.  Combining atlas and active contour for automatic 3D medical image segmentation , 2011, 2011 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[29]  L. R. Dice Measures of the Amount of Ecologic Association Between Species , 1945 .

[30]  Ron Kikinis,et al.  Improved watershed transform for medical image segmentation using prior information , 2004, IEEE Transactions on Medical Imaging.

[31]  Radhika S. Inamdar,et al.  Active appearance models for segmentation of cardiac MRI data , 2013, 2013 International Conference on Communication and Signal Processing.

[32]  Max A. Viergever,et al.  Combined pixel classification and atlas-based segmentation of the ventricular system in brain CT Images , 2013, Medical Imaging.

[33]  Juha Koikkalainen,et al.  Fast and robust multi-atlas segmentation of brain magnetic resonance images , 2010, NeuroImage.

[34]  Daniel Rueckert,et al.  Nonrigid registration using free-form deformations: application to breast MR images , 1999, IEEE Transactions on Medical Imaging.

[35]  Hans-Peter Meinzer,et al.  Statistical shape models for 3D medical image segmentation: A review , 2009, Medical Image Anal..

[36]  Timothy F. Cootes,et al.  Active Appearance Models , 1998, ECCV.

[37]  Josien P. W. Pluim,et al.  Evaluating and improving label fusion in atlas-based segmentation using the surface distance , 2011, Medical Imaging.

[38]  Benoit M Dawant,et al.  Combining registration and active shape models for the automatic segmentation of the lymph node regions in head and neck CT images. , 2010, Medical physics.

[39]  Michael E. Leventon,et al.  Statistical models in medical image analysis , 2000 .

[40]  Pascal Haigron,et al.  Evaluation of multi-atlas-based segmentation of CT scans in prostate cancer radiotherapy , 2011, 2011 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[41]  Jayaram K. Udupa,et al.  Improving Atlas-Based Medical Image Segmentation with a Relaxed Object Search , 2014, CompIMAGE.