3D image segmentation of deformable objects with joint shape-intensity prior models using level sets

We propose a novel method for 3D image segmentation, where a Bayesian formulation, based on joint prior knowledge of the object shape and the image gray levels, along with information derived from the input image, is employed. Our method is motivated by the observation that the shape of an object and the gray level variation in an image have consistent relations that provide configurations and context that aid in segmentation. We define a maximum a posteriori (MAP) estimation model using the joint prior information of the object shape and the image gray levels to realize image segmentation. We introduce a representation for the joint density function of the object and the image gray level values, and define a joint probability distribution over the variations of the object shape and the gray levels contained in a set of training images. By estimating the MAP shape of the object, we formulate the shape-intensity model in terms of level set functions as opposed to landmark points of the object shape. In addition, we evaluate the performance of the level set representation of the object shape by comparing it with the point distribution model (PDM). We found the algorithm to be robust to noise and able to handle multidimensional data, while able to avoid the need for explicit point correspondences during the training phase. Results and validation from various experiments on 2D and 3D medical images are shown.

[1]  Timothy F. Cootes,et al.  A Minimum Description Length Approach to Statistical Shape Modelling , 2001 .

[2]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[3]  V. Caselles,et al.  A geometric model for active contours in image processing , 1993 .

[4]  Timothy F. Cootes,et al.  A Unified Framework for Atlas Matching Using Active Appearance Models , 1999, IPMI.

[5]  Guillermo Sapiro,et al.  Geodesic Active Contours , 1995, International Journal of Computer Vision.

[6]  J. Sethian,et al.  Fronts propagating with curvature-dependent speed: algorithms based on Hamilton-Jacobi formulations , 1988 .

[7]  Timothy F. Cootes,et al.  Use of active shape models for locating structures in medical images , 1994, Image Vis. Comput..

[8]  Daniel P. Huttenlocher,et al.  Comparing Images Using the Hausdorff Distance , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  W. Eric L. Grimson,et al.  Model-based curve evolution technique for image segmentation , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[10]  Zhuowen Tu,et al.  Image Segmentation by Data-Driven Markov Chain Monte Carlo , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  O. Faugeras,et al.  Statistical shape influence in geodesic active contours , 2002, 5th IEEE EMBS International Summer School on Biomedical Imaging, 2002..

[12]  James S. Duncan,et al.  Statistical Neighbor Distance Influence in Active Contours , 2002, MICCAI.

[13]  James S. Duncan,et al.  Boundary Finding with Parametrically Deformable Models , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  W. Eric L. Grimson,et al.  A shape-based approach to the segmentation of medical imagery using level sets , 2003, IEEE Transactions on Medical Imaging.

[15]  James S. Duncan,et al.  3D Image Segmentation of Deformable Objects with Shape-Appearance Joint Prior Models , 2003, MICCAI.

[16]  Yunmei Chen,et al.  Using Prior Shapes in Geometric Active Contours in a Variational Framework , 2002, International Journal of Computer Vision.

[17]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[18]  Baba C. Vemuri,et al.  Topology-independent shape modeling scheme , 1993, Optics & Photonics.

[19]  James S. Duncan,et al.  Neighbor-constrained segmentation with level set based 3-D deformable models , 2004, IEEE Transactions on Medical Imaging.

[20]  James S. Duncan,et al.  Neighbor-Constrained Segmentation with 3D Deformable Models , 2003, IPMI.

[21]  Martin Styner,et al.  Evaluation of 3D Correspondence Methods for Model Building , 2003, IPMI.

[22]  Robert T. Schultz,et al.  Segmentation and Measurement of the Cortex from 3D MR Images , 1998, MICCAI.

[23]  Lawrence H. Staib,et al.  Boundary finding with correspondence using statistical shape models , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[24]  Timothy F. Cootes,et al.  Active Appearance Models , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  W. Eric L. Grimson,et al.  Coupled Multi-shape Model and Mutual Information for Medical Image Segmentation , 2003, IPMI.

[26]  Timothy F. Cootes,et al.  A minimum description length approach to statistical shape modeling , 2002, IEEE Transactions on Medical Imaging.

[27]  John S. Duncan,et al.  Joint prior models of neighboring objects for 3D image segmentation , 2004, CVPR 2004.

[28]  S. Osher,et al.  Algorithms Based on Hamilton-Jacobi Formulations , 1988 .

[29]  Anthony J. Yezzi,et al.  A statistical approach to snakes for bimodal and trimodal imagery , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.