Detection of Fetal Anatomies from Ultrasound Images using a Constrained Probabilistic Boosting Tree

We propose a novel method for the automatic detection and measurement of fetal anatomical structures i n ultrasound images. This problem offers a myriad of challenges, including: difficulty of modeling the appearance variations of the visual object of interest; robustness to speckle noise and s ignal drop-out; and large search space of the detection procedure . Previous solutions typically rely on the explicit encoding of prior knowledge and formulation of the problem as a perceptual grouping task solved through clustering or variational approaches. These methods are constrained by the validity o f the underlying assumptions and usually are not enough to captur e the complex appearances of fetal anatomies. We propose a novel system for fast automatic detection and measurement o f fetal anatomies that directly exploits a large database of e xpert annotated fetal anatomical structures in ultrasound images. Our method learns automatically to distinguish between the appearance of the object of interest and background by training a constrained probabilistic boosting tree classifier. Thissystem is able to produce the automatic segmentation of several fet al anatomies using the same basic detection algorithm. We show results on fully automatic measurement of biparietal diameter (BPD), head circumference (HC), abdominal circumference ( AC), femur length (FL), humerus length (HL), and crown rump length (CRL). Notice that our approach is the first in the literature to deal with the HL and CRL measurements. Extensive experiment s (with clinical validation) show that our system is, on average, close to the accuracy of experts in terms of segmentation and obstetric measurements. Finally this system runs under hal f second on a standard dual-core PC computer.

[1]  Andrew Zisserman,et al.  OBJ CUT , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[2]  Yongmin Kim,et al.  A methodology for evaluation of boundary detection algorithms on medical images , 1997, IEEE Transactions on Medical Imaging.

[3]  Mário A. T. Figueiredo,et al.  Segmentation of fetal ultrasound images. , 2005, Ultrasound in medicine & biology.

[4]  Timothy F. Cootes,et al.  Active Appearance Models , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  James S. Duncan,et al.  Deformable boundary finding in medical images by integrating gradient and region information , 1996, IEEE Trans. Medical Imaging.

[6]  Shimon Ullman,et al.  Class-Specific, Top-Down Segmentation , 2002, ECCV.

[7]  Robert E. Schapire,et al.  The strength of weak learnability , 1990, Mach. Learn..

[8]  Yongmin Kim,et al.  Edge-guided boundary delineation in prostate ultrasound images , 2000, IEEE Transactions on Medical Imaging.

[9]  P. Schluter,et al.  Ultrasonic fetal size measurements in Brisbane, Australia. , 2004, Australasian radiology.

[10]  George K. Matsopoulos,et al.  Use of morphological image processing techniques for the measurement of a fetal head from ultrasound images , 1994, Pattern Recognit..

[11]  Richard S. Zemel,et al.  Topological map learning from outdoor image sequences , 2006, J. Field Robotics.

[12]  Dorin Comaniciu,et al.  Database-guided segmentation of anatomical structures with complex appearance , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[13]  Dimitris N. Metaxas,et al.  Combining low-, high-level and empirical domain knowledge for automated segmentation of ultrasonic breast lesions , 2003, IEEE Transactions on Medical Imaging.

[14]  Y. Freund Boosting a Weak Learning Algorithm by Majority to Be Published in Information and Computation , 1995 .

[15]  Timothy F. Cootes,et al.  Facial feature detection using AdaBoost with shape constraints , 2003, BMVC.

[16]  T. Poggio,et al.  Hierarchical models of object recognition in cortex September 23 , 1999 , 1999 .

[17]  Anat Levin,et al.  Learning to Combine Bottom-Up and Top-Down Segmentation , 2006, ECCV.

[18]  T. Poggio,et al.  Hierarchical models of object recognition in cortex , 1999, Nature Neuroscience.

[19]  A. Kurjak,et al.  Current perspectives on the fetus as a patient , 1997 .

[20]  Tomaso A. Poggio,et al.  Pedestrian detection using wavelet templates , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[21]  Dorin Comaniciu,et al.  Fast Automatic Heart Chamber Segmentation from 3D CT Data Using Marginal Space Learning and Steerable Features , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[22]  Paul A. Viola,et al.  Robust Real-time Object Detection , 2001 .

[23]  Jerry L Prince,et al.  Current methods in medical image segmentation. , 2000, Annual review of biomedical engineering.

[24]  P Jeanty,et al.  Automatic measurements of fetal long bones. A feasibility study. , 1991, Journal of ultrasound in medicine : official journal of the American Institute of Ultrasound in Medicine.

[25]  N. Paragios A level set approach for shape-driven segmentation and tracking of the left ventricle , 2003, IEEE Transactions on Medical Imaging.

[26]  Alan L. Yuille,et al.  Region Competition: Unifying Snakes, Region Growing, and Bayes/MDL for Multiband Image Segmentation , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  S D Pathak,et al.  Interactive automatic fetal head measurements from ultrasound images using multimedia computer technology. , 1997, Ultrasound in medicine & biology.

[28]  Rachid Deriche,et al.  Geodesic Active Regions and Level Set Methods for Supervised Texture Segmentation , 2002, International Journal of Computer Vision.

[29]  Juan Ruiz-Alzola,et al.  Comments on: A methodology for evaluation of boundary detection algorithms on medical images , 2004, IEEE Trans. Medical Imaging.

[30]  Gustavo Carneiro,et al.  Automatic Fetal Measurements in Ultrasound Using Constrained Probabilistic Boosting Tree , 2007, MICCAI.

[31]  V Chalana,et al.  Automatic fetal head measurements from sonographic images. , 1996, Academic radiology.

[32]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1995, EuroCOLT.

[33]  B. Schiele,et al.  Combined Object Categorization and Segmentation With an Implicit Shape Model , 2004 .

[34]  C.W. Hanna,et al.  Automated measurements in obstetric ultrasound images , 1997, Proceedings of International Conference on Image Processing.

[35]  Michael Brady,et al.  Segmentation of ultrasound B-mode images with intensity inhomogeneity correction , 2002, IEEE Transactions on Medical Imaging.

[36]  P. Moral,et al.  Sequential Monte Carlo samplers , 2002, cond-mat/0212648.

[37]  Zhuowen Tu,et al.  Probabilistic boosting-tree: learning discriminative models for classification, recognition, and clustering , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[38]  Olivier D. Faugeras,et al.  Statistical shape influence in geodesic active contours , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[39]  Automatic Measurements of Fetal Long Bones: A Feasibility Study , 1992 .

[40]  J. Alison Noble,et al.  A shape-space-based approach to tracking myocardial borders and quantifying regional left-ventricular function applied in echocardiography , 2002, IEEE Transactions on Medical Imaging.

[41]  Kaleem Siddiqi,et al.  Area and length minimizing flows for shape segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[42]  Chandra Kambhamettu,et al.  A Coarse-to-Fine Deformable Contour Optimization Framework , 2003, IEEE Trans. Pattern Anal. Mach. Intell..