A multiphase texture-based model of active contours assisted by a convolutional neural network for automatic CT and MRI heart ventricle segmentation

BACKGROUND Left and right ventricle automatic segmentation remains one of the more important tasks in computed aided diagnosis. Active contours have shown to be efficient for this task, however they often require user interaction to provide the initial position, which drives the tool substantially dependent on a prior knowledge and a manual process. METHODS We propose to overcome this limitation with a Convolutional Neural Network (CNN) to reach the assumed target locations. This is followed by a novel multiphase active contour method based on texture that enhances whole heart patterns leading to an accurate identification of distinct regions, mainly left (LV) and right ventricle (RV) for the purposes of this work. RESULTS Experiments reveal that the initial location and estimated shape provided by the CNN are of great concern for the subsequent active contour stage. We assessed our method on two short data sets with Dice scores of 93% (LV-CT), 91% (LV-MRI), 0.86% (RV-CT) and 0.85% (RV-MRI). CONCLUSION Our approach overcomes the performance of other techniques by means of a multiregion segmentation assisted by a CNN trained with a limited data set, a typical issue in medical imaging.

[1]  Caroline Petitjean,et al.  A review of segmentation methods in short axis cardiac MR images , 2011, Medical Image Anal..

[2]  José Luis Silván-Cárdenas,et al.  The multiscale Hermite transform for local orientation analysis , 2006, IEEE Transactions on Image Processing.

[3]  Nima Tajbakhsh,et al.  UNet++: A Nested U-Net Architecture for Medical Image Segmentation , 2018, DLMIA/ML-CDS@MICCAI.

[4]  Piotr J. Slomka,et al.  Heart chambers and whole heart segmentation techniques: review , 2012, J. Electronic Imaging.

[5]  Marc Pollefeys,et al.  An Exploration of 2D and 3D Deep Learning Techniques for Cardiac MR Image Segmentation , 2017, STACOM@MICCAI.

[6]  Jimena Olveres,et al.  A multiphase active contour model based on the Hermite transform for texture segmentation , 2018, Photonics Europe.

[7]  Zhiming Luo,et al.  Convolutional Neural Network With Shape Prior Applied to Cardiac MRI Segmentation , 2019, IEEE Journal of Biomedical and Health Informatics.

[8]  Daniel Rueckert,et al.  Deep Learning for Cardiac Image Segmentation: A Review , 2020, Frontiers in Cardiovascular Medicine.

[9]  Robert A. McLaughlin,et al.  Convolutional neural network regression for short‐axis left ventricle segmentation in cardiac cine MR sequences , 2017, Medical Image Anal..

[10]  B. Westerhof,et al.  The Relationship Between the Right Ventricle and its Load in Pulmonary Hypertension. , 2017, Journal of the American College of Cardiology.

[11]  Bryan M. Williams,et al.  Learning Active Contour Models for Medical Image Segmentation , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Boris Escalante-Ramírez,et al.  Rotation-invariant texture features from the steered Hermite transform , 2011, Pattern Recognit. Lett..

[13]  Allen R. Tannenbaum,et al.  Localizing Region-Based Active Contours , 2008, IEEE Transactions on Image Processing.

[14]  Edward H. Adelson,et al.  The Design and Use of Steerable Filters , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Pablo Lamata,et al.  Recurrent Fully Convolutional Neural Networks for Multi-slice MRI Cardiac Segmentation , 2016, RAMBO+HVSMR@MICCAI.

[16]  B. Escalante-Ramírez,et al.  Deformable Models for Segmentation Based on Local Analysis , 2017 .

[17]  Sara Moccia,et al.  Automated left and right ventricular chamber segmentation in cardiac magnetic resonance images using dense fully convolutional neural network , 2021, Comput. Methods Programs Biomed..

[18]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[19]  N. Fine,et al.  Right Ventricular Function in Heart Failure: The Long and Short of Free Wall Motion Versus Deformation Imaging. , 2018, Circulation. Cardiovascular imaging.

[20]  Klaus-Robert Müller,et al.  Efficient BackProp , 2012, Neural Networks: Tricks of the Trade.

[21]  Jean-Bernard Martens,et al.  The Hermite transform-theory , 1990, IEEE Trans. Acoust. Speech Signal Process..

[22]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[23]  Ayush Goyal,et al.  Automatic Left Ventricle Segmentation in Cardiac MRI Images Using a Membership Clustering and Heuristic Region-Based Pixel Classification Approach , 2015, SIRS.

[24]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[25]  Jorge S. Marques,et al.  Fast segmentation of the left ventricle in cardiac MRI using dynamic programming , 2018, Comput. Methods Programs Biomed..

[26]  Hamid Jafarkhani,et al.  A combined deep-learning and deformable-model approach to fully automatic segmentation of the left ventricle in cardiac MRI , 2015, Medical Image Anal..

[27]  Eigil Samset,et al.  Semiautomated biventricular segmentation in three-dimensional echocardiography by coupled deformable surfaces , 2017, Journal of medical imaging.

[28]  Tony F. Chan,et al.  A Multiphase Level Set Framework for Image Segmentation Using the Mumford and Shah Model , 2002, International Journal of Computer Vision.

[29]  Jiayu Wang,et al.  Automatic segmentation of left ventricle from cardiac MRI via deep learning and region constrained dynamic programming , 2019, Neurocomputing.

[30]  Boris Escalante-Ramírez,et al.  Active contours for multiregion segmentation with a convolutional neural network initialization , 2020, Optics, Photonics and Digital Technologies for Imaging Applications VI.

[31]  Boris Escalante-Ramírez,et al.  A 3D Hermite-based multiscale local active contour method with elliptical shape constraints for segmentation of cardiac MR and CT volumes , 2017, Medical & Biological Engineering & Computing.

[32]  José M. F. Moura,et al.  STACS: new active contour scheme for cardiac MR image segmentation , 2005, IEEE Transactions on Medical Imaging.

[33]  Xiuquan Du,et al.  DeepCQ: Deep multi-task conditional quantification network for estimation of left ventricle parameters , 2019, Comput. Methods Programs Biomed..

[34]  Xin Yang,et al.  Deep Learning Techniques for Automatic MRI Cardiac Multi-Structures Segmentation and Diagnosis: Is the Problem Solved? , 2018, IEEE Transactions on Medical Imaging.

[35]  Massimo Bellomi,et al.  Radiomics: the facts and the challenges of image analysis , 2018, European Radiology Experimental.

[36]  Yong Xia,et al.  Multiscale attention guided U-Net architecture for cardiac segmentation in short-axis MRI images , 2021, Comput. Methods Programs Biomed..

[37]  Ganapathy Krishnamurthi,et al.  Fully convolutional multi‐scale residual DenseNets for cardiac segmentation and automated cardiac diagnosis using ensemble of classifiers , 2018, Medical Image Anal..

[38]  Boris Escalante-Ramírez,et al.  Left ventricle segmentation in fetal echocardiography using a multi-texture active appearance model based on the steered Hermite transform , 2016, Comput. Methods Programs Biomed..

[39]  Jean-Bernard Martens,et al.  Image representation and compression with steered Hermite transforms , 1997, Signal Process..

[40]  Hamid Jafarkhani,et al.  Automatic segmentation of the right ventricle from cardiac MRI using a learning‐based approach , 2017, Magnetic resonance in medicine.

[41]  Xuan Yang,et al.  A Data Augmentation Approach to Train Fully Convolutional Networks for Left Ventricle Segmentation. , 2020, Magnetic resonance imaging.

[42]  Andre Dekker,et al.  Radiomics: the process and the challenges. , 2012, Magnetic resonance imaging.

[43]  Demetri Terzopoulos,et al.  Deep Active Lesion Segmentation , 2019, bioRxiv.

[44]  Asad Munir,et al.  Segmentation of Left and Right Ventricles in Cardiac MRI Using Active Contours , 2017, Comput. Math. Methods Medicine.

[45]  J. Sethian,et al.  Fronts propagating with curvature-dependent speed: algorithms based on Hamilton-Jacobi formulations , 1988 .

[46]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[47]  Gustavo Carneiro,et al.  Combining deep learning and level set for the automated segmentation of the left ventricle of the heart from cardiac cine magnetic resonance , 2017, Medical Image Anal..