Detection and Measurement of Fetal Anatomies from Ultrasound Images using a Constrained Probabilistic Boosting Tree

We propose a novel method for the automatic detection and measurement of fetal anatomical structures in ultrasound images. This problem offers a myriad of challenges, including: difficulty of modeling the appearance variations of the visual object of interest, robustness to speckle noise and signal dropout, and large search space of the detection procedure. Previous solutions typically rely on the explicit encoding of prior knowledge and formulation of the problem as a perceptual grouping task solved through clustering or variational approaches. These methods are constrained by the validity of the underlying assumptions and usually are not enough to capture the complex appearances of fetal anatomies. We propose a novel system for fast automatic detection and measurement of fetal anatomies that directly exploits a large database of expert annotated fetal anatomical structures in ultrasound images. Our method learns automatically to distinguish between the appearance of the object of interest and background by training a constrained probabilistic boosting tree classifier. This system is able to produce the automatic segmentation of several fetal anatomies using the same basic detection algorithm. We show results on fully automatic measurement of biparietal diameter (BPD), head circumference (HC), abdominal circumference (AC), femur length (FL), humerus length (HL), and crown rump length (CRL). Notice that our approach is the first in the literature to deal with the HL and CRL measurements. Extensive experiments (with clinical validation) show that our system is, on average, close to the accuracy of experts in terms of segmentation and obstetric measurements. Finally, this system runs under half second on a standard dual-core PC computer.

[1]  Juan Ruiz-Alzola,et al.  Comments on: A methodology for evaluation of boundary detection algorithms on medical images , 2004, IEEE Trans. Medical Imaging.

[2]  V Chalana,et al.  Automatic fetal head measurements from sonographic images. , 1996, Academic radiology.

[3]  B. Schiele,et al.  Combined Object Categorization and Segmentation With an Implicit Shape Model , 2004 .

[4]  Zhuowen Tu,et al.  Probabilistic boosting-tree: learning discriminative models for classification, recognition, and clustering , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[5]  Olivier D. Faugeras,et al.  Statistical shape influence in geodesic active contours , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[6]  S D Pathak,et al.  Interactive automatic fetal head measurements from ultrasound images using multimedia computer technology. , 1997, Ultrasound in medicine & biology.

[7]  Rachid Deriche,et al.  Geodesic Active Regions and Level Set Methods for Supervised Texture Segmentation , 2002, International Journal of Computer Vision.

[8]  Dorin Comaniciu,et al.  Database-guided segmentation of anatomical structures with complex appearance , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[9]  Andrew Zisserman,et al.  OBJ CUT , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[10]  Gustavo Carneiro,et al.  Automatic Fetal Measurements in Ultrasound Using Constrained Probabilistic Boosting Tree , 2007, MICCAI.

[11]  Yoav Freund,et al.  Boosting a weak learning algorithm by majority , 1995, COLT '90.

[12]  George K. Matsopoulos,et al.  Use of morphological image processing techniques for the measurement of a fetal head from ultrasound images , 1994, Pattern Recognit..

[13]  Thomas Serre,et al.  Robust Object Recognition with Cortex-Like Mechanisms , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  James S. Duncan,et al.  Deformable boundary finding in medical images by integrating gradient and region information , 1996, IEEE Trans. Medical Imaging.

[15]  Richard S. Zemel,et al.  Topological map learning from outdoor image sequences , 2006, J. Field Robotics.

[16]  Dimitris N. Metaxas,et al.  Combining low-, high-level and empirical domain knowledge for automated segmentation of ultrasonic breast lesions , 2003, IEEE Transactions on Medical Imaging.

[17]  Paul A. Viola,et al.  Robust Real-time Object Detection , 2001 .

[18]  Tomaso A. Poggio,et al.  Pedestrian detection using wavelet templates , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[19]  P. Schluter,et al.  Ultrasonic fetal size measurements in Brisbane, Australia. , 2004, Australasian radiology.

[20]  Chandra Kambhamettu,et al.  A Coarse-to-Fine Deformable Contour Optimization Framework , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Timothy F. Cootes,et al.  Facial feature detection using AdaBoost with shape constraints , 2003, BMVC.

[22]  Kaleem Siddiqi,et al.  Area and length minimizing flows for shape segmentation , 1998, IEEE Trans. Image Process..

[23]  A. Kurjak,et al.  Current perspectives on the fetus as a patient , 1997 .

[24]  J. Alison Noble,et al.  A shape-space-based approach to tracking myocardial borders and quantifying regional left-ventricular function applied in echocardiography , 2002, IEEE Transactions on Medical Imaging.

[25]  Jerry L Prince,et al.  Current methods in medical image segmentation. , 2000, Annual review of biomedical engineering.

[26]  P Jeanty,et al.  Automatic measurements of fetal long bones. A feasibility study. , 1991, Journal of ultrasound in medicine : official journal of the American Institute of Ultrasound in Medicine.

[27]  N. Paragios A level set approach for shape-driven segmentation and tracking of the left ventricle , 2003, IEEE Transactions on Medical Imaging.

[28]  Alan L. Yuille,et al.  Region Competition: Unifying Snakes, Region Growing, and Bayes/MDL for Multiband Image Segmentation , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  Michael Brady,et al.  Segmentation of ultrasound B-mode images with intensity inhomogeneity correction , 2002, IEEE Transactions on Medical Imaging.

[30]  P. Moral,et al.  Sequential Monte Carlo samplers , 2002, cond-mat/0212648.

[31]  R. Schapire The Strength of Weak Learnability , 1990, Machine Learning.

[32]  Dorin Comaniciu,et al.  Fast Automatic Heart Chamber Segmentation from 3D CT Data Using Marginal Space Learning and Steerable Features , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[33]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[34]  C.W. Hanna,et al.  Automated measurements in obstetric ultrasound images , 1997, Proceedings of International Conference on Image Processing.

[35]  Yongmin Kim,et al.  A methodology for evaluation of boundary detection algorithms on medical images , 1997, IEEE Transactions on Medical Imaging.

[36]  Mário A. T. Figueiredo,et al.  Segmentation of fetal ultrasound images. , 2005, Ultrasound in medicine & biology.

[37]  T. Poggio,et al.  Hierarchical models of object recognition in cortex , 1999, Nature Neuroscience.

[38]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1995, EuroCOLT.

[39]  Timothy F. Cootes,et al.  Active Appearance Models , 1998, ECCV.

[40]  Anat Levin,et al.  Learning to Combine Bottom-Up and Top-Down Segmentation , 2006, International Journal of Computer Vision.

[41]  Shimon Ullman,et al.  Class-Specific, Top-Down Segmentation , 2002, ECCV.

[42]  Yongmin Kim,et al.  Edge-guided boundary delineation in prostate ultrasound images , 2000, IEEE Transactions on Medical Imaging.