A regression framework to head-circumference delineation from US fetal images

BACKGROUND AND OBJECTIVES Measuring head-circumference (HC) length from ultrasound (US) images is a crucial clinical task to assess fetus growth. To lower intra- and inter-operator variability in HC length measuring, several computer-assisted solutions have been proposed in the years. Recently, a large number of deep-learning approaches is addressing the problem of HC delineation through the segmentation of the whole fetal head via convolutional neural networks (CNNs). Since the task is a edge-delineation problem, we propose a different strategy based on regression CNNs. METHODS The proposed framework consists of a region-proposal CNN for head localization and centering, and a regression CNN for accurately delineate the HC. The first CNN is trained exploiting transfer learning, while we propose a training strategy for the regression CNN based on distance fields. RESULTS The framework was tested on the HC18 Challenge dataset, which consists of 999 training and 335 testing images. A mean absolute difference of 1.90 ( ±  1.76) mm and a Dice similarity coefficient of 97.75 ( ±  1.32) % were achieved, overcoming approaches in the literature. CONCLUSIONS The experimental results showed the effectiveness of the proposed framework, proving its potential in supporting clinicians during the clinical practice.

[1]  Gustavo Carneiro,et al.  Detection and Measurement of Fetal Anatomies from Ultrasound Images using a Constrained Probabilistic Boosting Tree , 2008, IEEE Transactions on Medical Imaging.

[2]  Andrew W. Fitzgibbon,et al.  Direct Least Square Fitting of Ellipses , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Paolo Zaffino,et al.  Technical Note: plastimatch mabs, an open source tool for automatic image segmentation. , 2016, Medical physics.

[4]  Xavier Bresson,et al.  Evaluation and Comparison of Current Fetal Ultrasound Image Segmentation Methods for Biometric Measurements: A Grand Challenge , 2014, IEEE Transactions on Medical Imaging.

[5]  Xinjian Chen,et al.  Deriving external forces via convolutional neural networks for biomedical image segmentation. , 2019, Biomedical optics express.

[6]  Eugenio Culurciello,et al.  LinkNet: Exploiting encoder representations for efficient semantic segmentation , 2017, 2017 IEEE Visual Communications and Image Processing (VCIP).

[7]  Jinglu Tan,et al.  Detection of incomplete ellipse in images with strong noise by iterative randomized Hough transform (IRHT) , 2008, Pattern Recognit..

[8]  J. Espinoza,et al.  Does the Use of Automated Fetal Biometry Improve Clinical Work Flow Efficiency? , 2013 .

[9]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[10]  Georgios Tzimiropoulos,et al.  Human Pose Estimation via Convolutional Part Heatmap Regression , 2016, ECCV.

[11]  Articulated Multi-Instrument 2-D Pose Estimation Using Fully Convolutional Networks , 2018, Ieee Transactions on Medical Imaging.

[12]  Ali Farhadi,et al.  YOLO9000: Better, Faster, Stronger , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Xujiong Ye,et al.  A supervised texton based approach for automatic segmentation and measurement of the fetal head and femur in 2D ultrasound images , 2016, Physics in medicine and biology.

[14]  Y. Ville,et al.  Outcomes of fetuses with small head circumference on second‐trimester ultrasonography , 2012, Prenatal diagnosis.

[15]  Shadrokh Samavi,et al.  Fetal Ultrasound Image Segmentation for Measuring Biometric Parameters Using Multi-Task Deep Learning , 2019, 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[16]  Jin Keun Seo,et al.  Automatic evaluation of fetal head biometry from ultrasound images using machine learning , 2018, Physiological measurement.

[17]  Emanuele Frontoni,et al.  Inter-foetus Membrane Segmentation for TTTS Using Adversarial Networks , 2019, Annals of Biomedical Engineering.

[18]  Alessandro Crimi,et al.  Segmentation of ultrasound images of fetal anatomic structures using random forest for low-cost settings , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[19]  Emanuele Frontoni,et al.  Preterm Infants’ Pose Estimation With Spatio-Temporal Features , 2019, IEEE Transactions on Biomedical Engineering.

[20]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[21]  Verónica Medina-Bañuelos,et al.  Automatic Fetal Head Measurements from Ultrasound Images Using Optimal Ellipse Detection and Texture Maps , 2015 .

[22]  Alessandro Foi,et al.  HEAD CONTOUR EXTRACTION FROM FETAL ULTRASOUND IMAGES BY DIFFERENCE OF GAUSSIANS REVOLVED ALONG ELLIPTICAL PATHS , 2012 .

[23]  B. Ginneken,et al.  Automated measurement of fetal head circumference using 2D ultrasound images , 2018, PloS one.

[24]  Mia Hubert,et al.  Anomaly detection by robust statistics , 2017, WIREs Data Mining Knowl. Discov..

[25]  Giorgio Terracina,et al.  Biomedical Data Augmentation Using Generative Adversarial Neural Networks , 2017, ICANN.

[26]  Ben Glocker,et al.  Attention Gated Networks: Learning to Leverage Salient Regions in Medical Images , 2018, Medical Image Anal..

[27]  Ron Kikinis,et al.  Fully automatic catheter segmentation in MRI with 3D convolutional neural networks: application to MRI-guided gynecologic brachytherapy , 2019, Physics in medicine and biology.

[28]  Emanuele Frontoni,et al.  Faster R-CNN approach for detection and quantification of DNA damage in comet assay images , 2020, Comput. Biol. Medicine.

[29]  Dong Ni,et al.  Automatic Fetal Head Circumference Measurement in Ultrasound Using Random Forest and Fast Ellipse Fitting , 2018, IEEE Journal of Biomedical and Health Informatics.

[30]  Nima Tajbakhsh,et al.  Embracing Imperfect Datasets: A Review of Deep Learning Solutions for Medical Image Segmentation , 2019, Medical Image Anal..

[31]  Bishesh Khanal,et al.  Confident Head Circumference Measurement from Ultrasound with Real-time Feedback for Sonographers , 2019, MICCAI.

[32]  Qinmu Peng,et al.  Automatic kidney segmentation in ultrasound images using subsequent boundary distance regression and pixelwise classification networks , 2018, Medical Image Anal..

[33]  Ikhsanul Habibie,et al.  Particle swarm optimation based 2-dimensional randomized hough transform for fetal head biometry detection and approximation in ultrasound imaging , 2014, 2014 International Conference on Advanced Computer Science and Information System.

[34]  Dong Ni,et al.  Deep Learning in Medical Ultrasound Analysis: A Review , 2019, Engineering.

[35]  Hongzhi Wang,et al.  Integrating Deformable Modeling with 3D Deep Neural Network Segmentation , 2018, DLMIA/ML-CDS@MICCAI.

[36]  S. Degani,et al.  Fetal Biometry: Clinical, Pathological, and Technical Considerations , 2001, Obstetrical & gynecological survey.

[37]  N. Sri Madhava Raja,et al.  Fetal Head Periphery Extraction from Ultrasound Image using Jaya Algorithm and Chan-Vese Segmentation , 2019, Procedia Computer Science.

[38]  Danail Stoyanov,et al.  Deep Learning Based Robotic Tool Detection and Articulation Estimation With Spatio-Temporal Layers , 2019, IEEE Robotics and Automation Letters.

[39]  Hiok Chai Quek,et al.  ElliFit: An unconstrained, non-iterative, least squares based geometric Ellipse Fitting method , 2013, Pattern Recognit..

[40]  Daniel Rueckert,et al.  Deep learning with ultrasound physics for fetal skull segmentation , 2018, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[41]  Bryan M. Williams,et al.  Improving Fetal Head Contour Detection by Object Localisation with Deep Learning , 2019, MIUA.

[42]  Lena Maier-Hein,et al.  Kidney edge detection in laparoscopic image data for computer-assisted surgery , 2019, International Journal of Computer Assisted Radiology and Surgery.