Coupling CRFs and Deformable Models for 3D Medical Image Segmentation

In this paper we present a hybrid probabilistic framework for 3D image segmentation, using Conditional Random Fields (CRFs) and implicit deformable models. Our 3D deformable model uses voxel intensity and higher scale textures as data-driven terms, while the shape is formulated implicitly using the Euclidean distance transform. The data-driven terms are used as observations in a 3D discriminative CRF, which drives the model evolution based on a simple graphical model. In this way, we solve the model evolution as a joint MAP estimation problem for the 3D label field of the CRF and the 3D shape of the deformable model. We demonstrate the performance of our approach in the estimation of the volume of the human tear menisci from images obtained with optical coherence tomography.

[1]  Martial Hebert,et al.  Discriminative Fields for Modeling Spatial Dependencies in Natural Images , 2003, NIPS.

[2]  F. Holly.  Formation and stability of the tear film. , 1973, International ophthalmology clinics.

[3]  Miguel Á. Carreira-Perpiñán,et al.  Multiscale conditional random fields for image labeling , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[4]  L. T. Do,et al.  In vivo tear-film thickness determination and implications for tear-film stability. , 1998, Current eye research.

[5]  S. Li.  Ch. 13. Modeling image analysis problems using markov random fields , 2003 .

[6]  Rachid Deriche,et al.  Geodesic Active Regions and Level Set Methods for Supervised Texture Segmentation , 2002, International Journal of Computer Vision.

[7]  Laurent D. Cohen,et al.  Finite-Element Methods for Active Contour Models and Balloons for 2-D and 3-D Images , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  M A Lemp,et al.  The precorneal tear film. I. Factors in spreading and maintaining a continuous tear film over the corneal surface. , 1970, Archives of ophthalmology.

[9]  Dimitris N. Metaxas,et al.  MetaMorphs: Deformable shape and texture models , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[10]  Vladimir Pavlovic,et al.  A tightly coupled region-shape framework for 3D medical image segmentation , 2006, 3rd IEEE International Symposium on Biomedical Imaging: Nano to Macro, 2006..

[11]  S. I. Brown,et al.  Hydrodynamics of blinking. In vitro study of the interaction of the superficial oily layer and the tears. , 1969, Archives of ophthalmology.

[12]  S. Li.  Modeling Image Analysis Problems Using Markov Random Fields , 2000 .

[13]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[14]  B E Bouma,et al.  High resolution in vivo intra-arterial imaging with optical coherence tomography , 1999, Heart.

[15]  D. Mumford,et al.  Optimal approximations by piecewise smooth functions and associated variational problems , 1989 .

[16]  Holly Fj.  Formation and stability of the tear film. , 1973 .

[17]  JongWon Kim,et al.  Volumetric Object Reconstruction Using the 3-D MRF Model-Based Segmentation , 1997, IEEE Trans. Medical Imaging.

[18]  Dimitris N. Metaxas,et al.  Deformable-Model Based Textured Object Segmentation , 2005, EMMCVPR.

[19]  Demetri Terzopoulos,et al.  Deformable models in medical image analysis: a survey , 1996, Medical Image Anal..

[20]  J. Fujimoto,et al.  New Technology for High‐Speed and High‐Resolution Optical Coherence Tomography a , 1998, Annals of the New York Academy of Sciences.

[21]  R. Kimmel,et al.  Geodesic Active Contours , 1995, Proceedings of IEEE International Conference on Computer Vision.

[22]  Dimitris N. Metaxas,et al.  A graphical model framework for coupling MRFs and deformable models , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[23]  Martial Hebert,et al.  Discriminative random fields: a discriminative framework for contextual interaction in classification , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[24]  E A Swanson,et al.  Micrometer-scale resolution imaging of the anterior eye in vivo with optical coherence tomography. , 1994, Archives of ophthalmology.

[25]  Andrew McCallum,et al.  Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data , 2001, ICML.

[26]  Nikos Paragios,et al.  Globally Optimal Active Contours, Sequential Monte Carlo and On-Line Learning for Vessel Segmentation , 2006, ECCV.