Learning to segment key clinical anatomical structures in fetal neurosonography informed by a region-based descriptor

Abstract. We present a general framework for automatic segmentation of fetal brain structures in ultrasound images inspired by recent advances in machine learning. The approach is based on a region descriptor that characterizes the shape and local intensity context of different neurological structures without explicit models. To validate our framework, we present experiments to segment two fetal brain structures of clinical importance that have quite different ultrasonic appearances—the corpus callosum (CC) and the choroid plexus (CP). Results demonstrate that our approach achieves high region segmentation accuracy (dice coefficient: 0.81  %    ±  0.06 CC, 0.76  %    ±  0.08 CP) relative to human delineation, whereas the derived automated biometry measurement deviations are within human intra/interobserver variations. The use of our proposed method may help to standardize intracranial anatomy measurements for both the routine examination and the detection of congenital conditions in the future.

[1]  Ehsan Samei,et al.  Sonography of Fetal Choroid Plexus Cysts , 2003, Journal of ultrasound in medicine : official journal of the American Institute of Ultrasound in Medicine.

[2]  George K. Matsopoulos,et al.  Use of morphological image processing techniques for the measurement of a fetal head from ultrasound images , 1994, Pattern Recognit..

[3]  Jiri Matas,et al.  Robust wide-baseline stereo from maximally stable extremal regions , 2004, Image Vis. Comput..

[4]  Daniela Prayer,et al.  Fetal Neuroimaging: Ultrasound, MRI, or Both? , 2008, Obstetrical & gynecological survey.

[5]  Bahbibi Rahmatullah,et al.  Nakagami-Based Choroid Plexus Detection in Fetal Ultrasound Images using AdaBoost , 2015 .

[6]  Ronald M. Summers,et al.  Deep Learning in Medical Imaging: Overview and Future Promise of an Exciting New Technique , 2016 .

[7]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Zhuowen Tu,et al.  Auto-Context and Its Application to High-Level Vision Tasks and 3D Brain Image Segmentation , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  S. Carroll,et al.  Correlation of prenatal ultrasound diagnosis and pathologic findings in fetal brain abnormalities , 2000, Ultrasound in obstetrics & gynecology : the official journal of the International Society of Ultrasound in Obstetrics and Gynecology.

[10]  Cordelia Schmid,et al.  A Performance Evaluation of Local Descriptors , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Colin Studholme,et al.  Spatially adapted augmentation of age-specific atlas-based segmentation using patch-based priors , 2014, Medical Imaging.

[12]  P. Goodyear,et al.  Outcome in Prenatally Diagnosed Fetal Agenesis of the Corpus callosum , 2001, Fetal Diagnosis and Therapy.

[13]  Benjamín Gutiérrez-Becker,et al.  Automatic segmentation of the fetal cerebellum on ultrasound volumes, using a 3D statistical shape model , 2013, Medical & Biological Engineering & Computing.

[14]  E. Reece,et al.  The clinical significance of prenatally diagnosed choroid plexus cysts. , 1989, American journal of obstetrics and gynecology.

[15]  Dorin Comaniciu,et al.  Automatic Detection and Measurement of Structures in Fetal Head Ultrasound Volumes Using Sequential Estimation and Integrated Detection Network (IDN) , 2014, IEEE Transactions on Medical Imaging.

[16]  Andrew Zisserman,et al.  Learning to Detect Cells Using Non-overlapping Extremal Regions , 2012, MICCAI.

[17]  A. Kurtz,et al.  The atria of the fetal lateral ventricles: a sonographic study of normal atrial size and choroid plexus volume. , 1995, AJR. American journal of roentgenology.

[18]  I. Timor-Tritsch,et al.  Sonographic examination of the fetal central nervous system: guidelines for performing the ‘basic examination’ and the ‘fetal neurosonogram’ , 2007, Ultrasound in obstetrics & gynecology : the official journal of the International Society of Ultrasound in Obstetrics and Gynecology.

[19]  D. Altman,et al.  International standards for fetal growth based on serial ultrasound measurements: the Fetal Growth Longitudinal Study of the INTERGROWTH-21st Project , 2014, The Lancet.

[20]  Jinglu Tan,et al.  Automated fetal head detection and measurement in ultrasound images by iterative randomized Hough transform. , 2005, Ultrasound in medicine & biology.

[21]  Daniel Rueckert,et al.  Age dependent fetal MR segmentation using manual and automated approaches , 2013 .

[22]  Andrew Zisserman,et al.  Image Classification using Random Forests and Ferns , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[23]  E. Reece,et al.  Fetal cerebellar growth unaffected by intrauterine growth retardation: a new parameter for prenatal diagnosis. , 1987, American journal of obstetrics and gynecology.

[24]  Taghi M. Khoshgoftaar,et al.  RUSBoost: A Hybrid Approach to Alleviating Class Imbalance , 2010, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[25]  L Chik,et al.  Ultrasound measurement of the fetal head: computer versus operator , 1991, Ultrasound in obstetrics & gynecology : the official journal of the International Society of Ultrasound in Obstetrics and Gynecology.

[26]  László Sztriha,et al.  Spectrum of corpus callosum agenesis. , 2005, Pediatric neurology.

[27]  L. Hill,et al.  A Sonographic and Karyotypic Study of Second-Trimester Fetal Choroid Plexus Cysts , 1989, Obstetrics and gynecology.

[28]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[29]  J. Alison Noble,et al.  Volumetric Segmentation of Key Fetal Brain Structures in 3D Ultrasound , 2013, MLMI.

[30]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[31]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[32]  L. R. Dice Measures of the Amount of Ecologic Association Between Species , 1945 .

[33]  Michael Unser,et al.  Multiresolution Feature Extraction and Selection for Texture Segmentation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[34]  Syed Muhammad Anwar,et al.  Deep Learning in Medical Image Analysis , 2017 .

[35]  Gobert N. Lee,et al.  Deep Learning in Medical Image Analysis: Challenges and Applications , 2020, Advances in Experimental Medicine and Biology.

[36]  Fred L. Bookstein,et al.  Corpus Callosum Shape and Neuropsychological Deficits in Adult Males with Heavy Fetal Alcohol Exposure , 2002, NeuroImage.

[37]  Gustavo Carneiro,et al.  Semantic-based indexing of fetal anatomies from 3-D ultrasound data using global/semi-local context and sequential sampling , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[38]  Simon K. Warfield,et al.  Multi-atlas multi-shape segmentation of fetal brain MRI for volumetric and morphometric analysis of ventriculomegaly , 2012, NeuroImage.

[39]  Colin Studholme,et al.  Atlas‐based segmentation of developing tissues in the human brain with quantitative validation in young fetuses , 2010, Human brain mapping.