Heart left ventricle segmentation in ultrasound images using deep learning

Automatic segmentation of the heart left ventricle (LV) is an important step in setting an adequate diagnostic in echocardiography. Some of the state-of-the-art methods for 2D segmentation include traditional methods like active shape models, active contours, level sets, Kalman filter etc., but also deep modern learning methods (i.e. convolutional neural networks), where accuracy usually surpasses the accuracy of traditional methods. Due to the promising results of convolutional neural network called U-net in different segmentation problems, we propose it for the extraction of the left heart ventricle. The results show that the network has been able to segment the left ventricle with the accuracy of around 83.5% on unseen data which surpasses the reported state-of-the-art results, even with a smaller database. Larger database will enable better learning that we are confident will contribute to even higher accuracy. Future work will include testing on larger databases in order to meet the needs for Big Data analysis, but pertain the accuracy and reduce the time necessary for manual analysis of images.

[1]  Gustavo Carneiro,et al.  The Segmentation of the Left Ventricle of the Heart From Ultrasound Data Using Deep Learning Architectures and Derivative-Based Search Methods , 2012, IEEE Transactions on Image Processing.

[2]  Saeed Kermani,et al.  A hybrid graph-based approach for right ventricle segmentation in cardiac MRI by long axis information transition. , 2018, Physica medica : PM : an international journal devoted to the applications of physics to medicine and biology : official journal of the Italian Association of Biomedical Physics.

[3]  Kevin H. Leung,et al.  Direct attenuation correction of brain PET images using only emission data via a deep convolutional encoder-decoder (Deep-DAC) , 2019, European Radiology.

[4]  Olga Solovyova,et al.  Identification of the left ventricle endocardial border on two-dimensional ultrasound images using the convolutional neural network Unet , 2018, 2018 Ural Symposium on Biomedical Engineering, Radioelectronics and Information Technology (USBEREIT).

[5]  Milan Sonka,et al.  Automatic segmentation of echocardiographic sequences by active appearance motion models , 2002, IEEE Transactions on Medical Imaging.

[6]  N. Paragios A level set approach for shape-driven segmentation and tracking of the left ventricle , 2003, IEEE Transactions on Medical Imaging.

[7]  Milan Sonka,et al.  3-D active appearance models: segmentation of cardiac MR and ultrasound images , 2002, IEEE Transactions on Medical Imaging.

[8]  Konstantinos Kamnitsas,et al.  Anatomically Constrained Neural Networks (ACNNs): Application to Cardiac Image Enhancement and Segmentation , 2017, IEEE Transactions on Medical Imaging.

[9]  Arman Rahmim,et al.  Simultaneous Attenuation Correction and Reconstruction of PET Images Using Deep Convolutional Encoder Decoder Networks from Emission Data , 2019 .

[10]  Mostafa Ghelich Oghli,et al.  Left Ventricle Segmentation Using a Combination of Region Growing and Graph Based Method , 2017 .

[11]  김종영 구글 TensorFlow 소개 , 2015 .

[12]  K. Y. Esther Leung,et al.  Probabilistic framework for tracking in artifact-prone 3D echocardiograms , 2010, Medical Image Anal..

[13]  Lasse Lovstakken,et al.  2D left ventricle segmentation using deep learning , 2017, 2017 IEEE International Ultrasonics Symposium (IUS).

[14]  P. Libby,et al.  Braunwald's Heart Disease: A Textbook of Cardiovascular Medicine, 2-Volume Set, 9th Edition Expert Consult Premium Edition €“ Enhanced Online Features , 2011 .

[15]  J. Alison Noble,et al.  Ultrasound image segmentation: a survey , 2006, IEEE Transactions on Medical Imaging.

[16]  Arman Rahmim,et al.  PSFNET: ultrafast generation of PSF-modelled-like PET images using deep convolutional neural network , 2019 .

[17]  Gustavo Carneiro,et al.  Combining Multiple Dynamic Models and Deep Learning Architectures for Tracking the Left Ventricle Endocardium in Ultrasound Data , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[19]  Azin Alizadehasl,et al.  MFP-Unet: A Novel Deep Learning Based Approach for Left Ventricle Segmentation in Echocardiography , 2019, Physica medica : PM : an international journal devoted to the applications of physics to medicine and biology : official journal of the Italian Association of Biomedical Physics.

[20]  James S. Duncan,et al.  Combinative Multi-scale Level Set Framework for Echocardiographic Image Segmentation , 2002, MICCAI.