Echocardiography segmentation based on a shape-guided deformable model driven by a fully convolutional network prior

Advances in deep learning have yielded simplified solutions in many challenging medical imaging problems. Despite their capability, these learning approaches often fail to produce accurate and reliable segmentation in echocardiography image sequences due to varying amounts of speckle noise accompanied with ill-defined and missing boundaries. For this, we propose a combination of deep learning and a shape-driven deformable model in the form of level set. The proposed method uses an end-to-end trained fully convolutional network that acts as a prior to drive the level set-based deformable model. Further, we define a new energy formulation within the level set framework that accounts for characteristics of the desired structure. By employing the proposed method, we achieve accurate and reliable segmentation of cardiac structures (left ventricles) both qualitatively and quantitatively.

[1]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[2]  J. Sethian,et al.  FRONTS PROPAGATING WITH CURVATURE DEPENDENT SPEED: ALGORITHMS BASED ON HAMILTON-JACOB1 FORMULATIONS , 2003 .

[3]  Raghav Mehta,et al.  M-net: A Convolutional Neural Network for deep brain structure segmentation , 2017, 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017).

[4]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[5]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[6]  Paul A. Yushkevich,et al.  Multi-Atlas Segmentation with Joint Label Fusion , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Ruzena Bajcsy,et al.  An End-to-End Computer Vision Pipeline for Automated Cardiac Function Assessment by Echocardiography , 2017, ArXiv.

[8]  Christoph Meinel,et al.  Deep Learning for Medical Image Analysis , 2018, Journal of Pathology Informatics.

[9]  S. Osher,et al.  Algorithms Based on Hamilton-Jacobi Formulations , 1988 .

[10]  Anthony Yezzi,et al.  Hybrid geodesic region-based curve evolutions for image segmentation , 2007, SPIE Medical Imaging.

[11]  Tanveer F. Syeda-Mahmood,et al.  A Cross-Modality Neural Network Transform for Semi-automatic Medical Image Annotation , 2016, MICCAI.

[12]  Timothy F. Cootes,et al.  Active Appearance Models , 1998, ECCV.

[13]  Seyed-Ahmad Ahmadi,et al.  V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation , 2016, 2016 Fourth International Conference on 3D Vision (3DV).