Automatic Left Ventricle Recognition, Segmentation and Tracking in Cardiac Ultrasound Image Sequences

In this study, we propose a novel method incorporating faster region-based convolutional neural network and active shape model to automatically recognize, segment, and track the left ventricle in cardiac ultrasound image sequences, respectively. Ultrasound images typically contain noise and artifacts. The conventional filters cannot preserve the edges of image contours, and thus blurry images are often obtained. In this study, we propose an improved adaptive anisotropic diffusion filter to effectively reduce noise and reinforce image contours. In addition, because of the shape and appearance of the left ventricle vary considerably between adjacent images, conventional methods cannot automatically identify the position of the left ventricle or accurately segment them. A novel method that combines the faster region-based convolutional neural network with the active shape model is proposed to automatically recognize, segment, and track the left ventricle in cardiac ultrasound image sequences. Compared with four state-of-the-art approaches, the method proposed in this study can be applied to accurately segment and track the left ventricle in cardiac ultrasound image sequences. The proposed method produces the most satisfactory results in terms of visual presentation and segmentation quality based on four criteria.

[1]  Paul Geladi,et al.  Principal Component Analysis , 1987, Comprehensive Chemometrics.

[2]  Baowei Fei,et al.  Automatic segmentation of right ventricular ultrasound images using sparse matrix transform and a level set , 2013, Physics in medicine and biology.

[3]  Mattias Hansson,et al.  Segmentation of B-mode cardiac ultrasound data by Bayesian Probability Maps , 2014, Medical Image Anal..

[4]  Ville Tirronen,et al.  An Enhanced Memetic Differential Evolution in Filter Design for Defect Detection in Paper Production , 2008, Evolutionary Computation.

[5]  Alejandro F. Frangi,et al.  Active shape model segmentation with optimal features , 2002, IEEE Transactions on Medical Imaging.

[6]  Gustavo Carneiro,et al.  The Segmentation of the Left Ventricle of the Heart From Ultrasound Data Using Deep Learning Architectures and Derivative-Based Search Methods , 2012, IEEE Transactions on Image Processing.

[7]  Timothy F. Cootes,et al.  Statistical models of appearance for computer vision , 1999 .

[8]  James S. Duncan,et al.  Contour tracking in echocardiographic sequences via sparse representation and dictionary learning , 2014, Medical Image Anal..

[9]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Francesco Sardanelli,et al.  Segmentation of cardiac cine MR images of left and right ventricles: Interactive semiautomated methods and manual contouring by two readers with different education and experience , 2008, Journal of magnetic resonance imaging : JMRI.

[12]  P. Jaccard.  THE DISTRIBUTION OF THE FLORA IN THE ALPINE ZONE.1 , 1912 .

[13]  M. De Craene,et al.  A Framework for the Generation of Realistic Synthetic Cardiac Ultrasound and Magnetic Resonance Imaging Sequences From the Same Virtual Patients , 2018, IEEE Transactions on Medical Imaging.

[14]  Daniel P. Huttenlocher,et al.  Comparing Images Using the Hausdorff Distance , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Chen Wang,et al.  Standardized Evaluation System for Left Ventricular Segmentation Algorithms in 3D Echocardiography , 2016, IEEE Transactions on Medical Imaging.

[16]  Milan Sonka,et al.  Automatic segmentation of echocardiographic sequences by active appearance motion models , 2002, IEEE Transactions on Medical Imaging.

[17]  Timothy F. Cootes,et al.  Active Shape Models-Their Training and Application , 1995, Comput. Vis. Image Underst..

[18]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[19]  L. R. Dice.  Measures of the Amount of Ecologic Association Between Species , 1945 .

[20]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[21]  Jian Sun,et al.  Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  A. Almeida,et al.  Toward a fully automatic left ventricle segmentation using cine-MR images , 2008 .

[23]  Steven Henikoff,et al.  SIFT: predicting amino acid changes that affect protein function , 2003, Nucleic Acids Res..

[24]  Du-Ming Tsai,et al.  An anisotropic diffusion-based defect detection for low-contrast glass substrates , 2008, Image Vis. Comput..

[25]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[26]  Paul Suetens,et al.  Three-Dimensional Cardiac Strain Estimation Using Spatio–Temporal Elastic Registration of Ultrasound Images: A Feasibility Study , 2008, IEEE Transactions on Medical Imaging.

[27]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[28]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[29]  Gustavo Carneiro,et al.  Combining Multiple Dynamic Models and Deep Learning Architectures for Tracking the Left Ventricle Endocardium in Ultrasound Data , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  YingLiang Ma,et al.  Registering Preprocedure Volumetric Images With Intraprocedure 3-D Ultrasound Using an Ultrasound Imaging Model , 2010, IEEE Transactions on Medical Imaging.

[31]  Ville Tirronen,et al.  Super-fit control adaptation in memetic differential evolution frameworks , 2009, Soft Comput..

[32]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Fred L. Bookstein,et al.  Landmark methods for forms without landmarks: morphometrics of group differences in outline shape , 1997, Medical Image Anal..