Echocardiography without electrocardiogram using nonlinear dimensionality reduction methods

PurposeThe aim of this study is to evaluate the efficiency of a new automatic image processing technique, based on nonlinear dimensionality reduction (NLDR) to separate a cardiac cycle and also detect end-diastole (ED) (cardiac cycle start) and end-systole (ES) frames on an echocardiography system without using ECG.MethodsIsometric feature mapping (Isomap) and locally linear embeddings (LLE) are the most popular NLDR algorithms. First, Isomap algorithm is applied on recorded echocardiography images. By this approach, the nonlinear embedded information in sequential images is represented in a two-dimensional manifold and each image is characterized by a symbol on the constructed manifold. Cyclicity analysis of the resultant manifold, which is derived from the cyclic nature of the heart motion, is used to perform cardiac cycle length estimation. Then, LLE algorithm is applied on extracted left ventricle (LV) echocardiography images of one cardiac cycle. Finally, the relationship between consecutive symbols of the resultant manifold by the LLE algorithm, which is based on LV volume changes, is used to estimate ED (cycle start) and ES frames. The proposed algorithms are quantitatively compared to those obtained by a highly experienced echocardiographer from ECG as a reference in 20 healthy volunteers and 12 subjects with pathology.ResultsMean difference in cardiac cycle length, ED, and ES frame estimation between our method and ECG detection by the experienced echocardiographer is approximately 7, 17, and 17 ms (0.4, 1, and 1 frame), respectively.ConclusionThe proposed image-based method, based on NLDR, can be used as a useful tool for estimation of cardiac cycle length, ED and ES frames in echocardiography systems, with good agreement to ECG assessment by an experienced echocardiographer in routine clinical evaluation.

[1]  Robert Pless,et al.  Isomap and Nonparametric Models of Image Deformation , 2005, 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION'05) - Volume 1.

[2]  Fredrik Orderud,et al.  Echocardiography without electrocardiogram. , 2011, European journal of echocardiography : the journal of the Working Group on Echocardiography of the European Society of Cardiology.

[3]  Akihiro Kurita,et al.  Longitudinal fractional shortening and its relation to diastolic cardiac function , 2008, Journal of Medical Ultrasonics.

[4]  Hamid Behnam,et al.  Automatic Computation of Left Ventricular Volume Changes Over a Cardiac Cycle from Echocardiography Images by Nonlinear Dimensionality Reduction , 2015, Journal of Digital Imaging.

[5]  A. Guyton,et al.  Textbook of Medical Physiology , 1961 .

[6]  Hamid Behnam,et al.  Left ventricle wall motion quantification from echocardiographic images by non-rigid image registration , 2012, International Journal of Computer Assisted Radiology and Surgery.

[7]  Robert Pless,et al.  Image distance functions for manifold learning , 2007, Image Vis. Comput..

[8]  平野 雄一.  Predicting prognosis based on the shape of the left ventricular cavity in dilated cardiomyopathy : analysis using rate of improvement in the circle index , 2006 .

[9]  Robert Pless,et al.  A Survey of Manifold Learning for Images , 2009, IPSJ Trans. Comput. Vis. Appl..

[10]  Hongen Liao,et al.  Medical Imaging and Augmented Reality , 2004 .

[11]  J. Gardin,et al.  American Society of Echocardiography recommendations for use of echocardiography in clinical trials. , 2004, Journal of the American Society of Echocardiography : official publication of the American Society of Echocardiography.

[12]  Lawrence K. Saul,et al.  Think Globally, Fit Locally: Unsupervised Learning of Low Dimensional Manifold , 2003, J. Mach. Learn. Res..

[13]  William Stewart,et al.  Recommendations for chamber quantification. , 2006, European journal of echocardiography : the journal of the Working Group on Echocardiography of the European Society of Cardiology.

[14]  H. Behnam,et al.  Automatic detection of end-diastole and end-systole from echocardiography images using manifold learning. , 2010, Physiological measurement.

[15]  Nassir Navab,et al.  Endoscopic Video Manifolds for Targeted Optical Biopsy , 2012, IEEE Transactions on Medical Imaging.

[16]  N. Kachenoura,et al.  Automatic Detection of End Systole within a Sequence of Left Ventricular Echocardiographic Images using Autocorrelation and Mitral Valve Motion Detection , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[17]  Milan Sonka,et al.  Automatic segmentation of echocardiographic sequences by active appearance motion models , 2002, IEEE Transactions on Medical Imaging.

[18]  Kumiko Maeda,et al.  Pocket-sized transthoracic echocardiography device for the measurement of cardiac chamber size and function. , 2009, Circulation journal : official journal of the Japanese Circulation Society.

[19]  Maxime Cannesson,et al.  A novel two-dimensional echocardiographic image analysis system using artificial intelligence-learned pattern recognition for rapid automated ejection fraction. , 2007, Journal of the American College of Cardiology.

[20]  Ross T. Whitaker,et al.  Manifold modeling for brain population analysis , 2010, Medical Image Anal..

[21]  Hamid Behnam,et al.  Automatic Classification of Left Ventricular Regional Wall Motion Abnormalities in Echocardiography Images Using Nonrigid Image Registration , 2013, Journal of Digital Imaging.

[22]  Hamid Behnam,et al.  FULLY AUTOMATIC SEGMENTATION OF LEFT VENTRICLE IN A SEQUENCE OF ECHOCARDIOGRAPHY IMAGES OF ONE CARDIAC CYCLE BY DYNAMIC DIRECTIONAL VECTOR FIELD CONVOLUTION (DDVFC) METHOD AND MANIFOLD LEARNING , 2013 .

[23]  Christos Davatzikos,et al.  GRAM: A framework for geodesic registration on anatomical manifolds , 2010, Medical Image Anal..

[24]  Nassir Navab,et al.  Manifold learning for image-based breathing gating in ultrasound and MRI , 2012, Medical Image Anal..

[25]  Daniel Rueckert,et al.  Hierarchical Manifold Learning for Regional Image Analysis , 2014, IEEE Transactions on Medical Imaging.

[26]  J. Noble,et al.  Quantitative regional analysis of myocardial wall motion. , 2001, Ultrasound in medicine & biology.

[27]  Yang Wang,et al.  Prediction Based Collaborative Trackers (PCT): A Robust and Accurate Approach Toward 3D Medical Object Tracking , 2011, IEEE Transactions on Medical Imaging.

[28]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[29]  Michael Unser,et al.  Spatio-temporal nonrigid registration for ultrasound cardiac motion estimation , 2005, IEEE Transactions on Medical Imaging.

[30]  A. Ionescu,et al.  The pocket echocardiograph: a useful new tool? , 2008, European journal of echocardiography : the journal of the Working Group on Echocardiography of the European Society of Cardiology.

[31]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[32]  Richard B Devereux,et al.  Recommendations for chamber quantification: a report from the American Society of Echocardiography's Guidelines and Standards Committee and the Chamber Quantification Writing Group, developed in conjunction with the European Association of Echocardiography, a branch of the European Society of Cardio , 2005, Journal of the American Society of Echocardiography : official publication of the American Society of Echocardiography.

[33]  Andrew R. Jamieson,et al.  Exploring nonlinear feature space dimension reduction and data representation in breast Cadx with Laplacian eigenmaps and t-SNE. , 2009, Medical physics.

[34]  Nassir Navab,et al.  Manifold Learning for Image-Based Gating of Intravascular Ultrasound(IVUS) Pullback Sequences , 2010, MIAR.

[35]  Hamid Behnam,et al.  Automatic assessment of regional and global wall motion abnormalities in echocardiography images by nonlinear dimensionality reduction. , 2013, Medical physics.

[36]  Mikhail Belkin,et al.  Laplacian Eigenmaps and Spectral Techniques for Embedding and Clustering , 2001, NIPS.

[37]  Masahiko Harada,et al.  Assessment of left ventricular diastolic function using color kinesis: differentiation between normal and pseudonormalized patterns , 2009, Journal of Medical Ultrasonics.

[38]  Ahmed M. Elgammal,et al.  Nonlinear manifold learning for dynamic shape and dynamic appearance , 2007, Comput. Vis. Image Underst..

[39]  Alireza Akhbardeh,et al.  Comparative analysis of nonlinear dimensionality reduction techniques for breast MRI segmentation. , 2012, Medical physics.

[40]  Luminita Moraru,et al.  Cardiac Cycle Phase Estimation in 2-D Echocardiographic Images Using an Artificial Neural Network , 2013, IEEE Transactions on Biomedical Engineering.