Early Myocardial Infarction Detection over Multi-view Echocardiography

Myocardial infarction (MI) is the leading cause of mortality in the world that occurs due to a blockage of the coronary arteries feeding the myocardium. An early diagnosis of MI and its localization can mitigate the extent of myocardial damage by facilitating early therapeutic interventions. Following the blockage of a coronary artery, the regional wall motion abnormality (RWMA) of the ischemic myocardial segments is the earliest change to set in. Echocardiography is the fundamental tool to assess any RWMA. Assessing the motion of the left ventricle (LV) wall only from a single echocardiography view may lead to missing the diagnosis of MI as the RWMA may not be visible on that specific view. Therefore, in this study, we propose to fuse apical 4-chamber (A4C) and apical 2-chamber (A2C) views in which a total of 12 myocardial segments can be analyzed for MI detection. The proposed method first estimates the motion of the LV wall by Active Polynomials (APs), which extract and track the endocardial boundary to compute myocardial segment displacements. The features are extracted from the A4C and A2C view displacements, which are concatenated and fed into the classifiers to detect MI. The main contributions of this study are 1) creation of a new benchmark dataset by including both A4C and A2C views in a total of 260 echocardiography recordings, which is publicly shared with the research community, 2) improving the performance of the prior work of threshold-based APs by a Machine Learning based approach, and 3) a pioneer MI detection approach via multi-view echocardiography by fusing the information of A4C and A2C views. Experimental results show that the proposed method achieves 90.91% sensitivity and 86.36% precision for MI detection over multi-view echocardiography. The software implementation is shared at https://github.com/degerliaysen/MultiEchoAI.

[1]  S. Kiranyaz,et al.  Early Detection of Myocardial Infarction in Low-Quality Echocardiography , 2020, IEEE Access.

[2]  Serkan Kiranyaz,et al.  Left Ventricular Wall Motion Estimation by Active Polynomials for Acute Myocardial Infarction Detection , 2020, IEEE Access.

[3]  Akihiro Haga,et al.  A Deep Learning Approach for Assessment of Regional Wall Motion Abnormality From Echocardiographic Images. , 2020, JACC. Cardiovascular imaging.

[4]  Tomy Varghese,et al.  Hierarchical Motion Estimation With Bayesian Regularization in Cardiac Elastography: Simulation and $In~ Vivo$ Validation , 2019, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[5]  Onur Avci,et al.  1D Convolutional Neural Networks and Applications: A Survey , 2019, Mechanical Systems and Signal Processing.

[6]  J. Alison Noble,et al.  Automated Myocardial Wall Motion Classification using Handcrafted Features vs a Deep CNN-based mapping , 2018, 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[7]  Harald Becher,et al.  Clinical Applications of Ultrasonic Enhancing Agents in Echocardiography: 2018 American Society of Echocardiography Guidelines Update. , 2018, Journal of the American Society of Echocardiography : official publication of the American Society of Echocardiography.

[8]  Jean-Yves Tourneret,et al.  Motion Estimation in Echocardiography Using Sparse Representation and Dictionary Learning , 2018, IEEE Transactions on Image Processing.

[9]  François Chollet,et al.  Xception: Deep Learning with Depthwise Separable Convolutions , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Sergey Ioffe,et al.  Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning , 2016, AAAI.

[12]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[13]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  U. Rajendra Acharya,et al.  Computer-aided diagnosis of Myocardial Infarction using ultrasound images with DWT, GLCM and HOS methods: A comparative study , 2015, Comput. Biol. Medicine.

[16]  Victor Mor-Avi,et al.  Recommendations for cardiac chamber quantification by echocardiography in adults: an update from the American Society of Echocardiography and the European Association of Cardiovascular Imaging. , 2015, European heart journal cardiovascular Imaging.

[17]  Hugo A. Katus,et al.  Assessment of global longitudinal strain using standardized myocardial deformation imaging: a modality independent software approach , 2015, Clinical Research in Cardiology.

[18]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[19]  S. Coulter,et al.  Echocardiographic Evaluation of Coronary Artery Disease , 2015 .

[20]  Matilda Landgren,et al.  Segmentation of the left heart ventricle in ultrasound images using a region based snake , 2013, Medical Imaging.

[21]  Olivier Bernard,et al.  Myocardial Motion Estimation From Medical Images Using the Monogenic Signal , 2013, IEEE Transactions on Image Processing.

[22]  Hon Fai Choi,et al.  Regional cardiac motion and strain estimation in three-dimensional echocardiography: a validation study in thick-walled univentricular phantoms , 2012, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[23]  S. Solomon,et al.  Myocardial Deformation Imaging: Current Status and Future Directions , 2012, Circulation.

[24]  Maarten L. Simoons,et al.  The third universal definition of myocardial infarction , 2013 .

[25]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[26]  Wei-Yin Loh,et al.  Classification and regression trees , 2011, WIREs Data Mining Knowl. Discov..

[27]  Manish Bansal,et al.  Assessment of myocardial viability at dobutamine echocardiography by deformation analysis using tissue velocity and speckle-tracking. , 2010, JACC. Cardiovascular imaging.

[28]  Roland Hetzer,et al.  Strain and Strain Rate Imaging by Echocardiography – Basic Concepts and Clinical Applicability , 2009, Current cardiology reviews.

[29]  Fred S Apple,et al.  Universal definition of myocardial infarction. , 2007, Journal of the American College of Cardiology.

[30]  J. Rumsfeld,et al.  Implications of the Failure to Identify High-Risk Electrocardiogram Findings for the Quality of Care of Patients With Acute Myocardial Infarction: Results of the Emergency Department Quality in Myocardial Infarction (EDQMI) Study , 2006, Circulation.

[31]  A. Jaffe,et al.  Assessing the requirement for the 6-hour interval between specimens in the American Heart Association Classification of Myocardial Infarction in Epidemiology and Clinical Research Studies. , 2006, Clinical chemistry.

[32]  A. Støylen,et al.  Noninvasive myocardial strain measurement by speckle tracking echocardiography: validation against sonomicrometry and tagged magnetic resonance imaging. , 2006, Journal of the American College of Cardiology.

[33]  Richard B Devereux,et al.  Recommendations for chamber quantification: a report from the American Society of Echocardiography's Guidelines and Standards Committee and the Chamber Quantification Writing Group, developed in conjunction with the European Association of Echocardiography, a branch of the European Society of Cardio , 2005, Journal of the American Society of Echocardiography : official publication of the American Society of Echocardiography.

[34]  Michael Unser,et al.  Spatio-temporal nonrigid registration for ultrasound cardiac motion estimation , 2005, IEEE Transactions on Medical Imaging.

[35]  Michael Unser,et al.  Myocardial motion analysis from B-mode echocardiograms , 2005, IEEE Transactions on Image Processing.

[36]  K. Lindström,et al.  The history of echocardiography. , 2004, Ultrasound in medicine & biology.

[37]  Geoffrey E. Hinton,et al.  Neighbourhood Components Analysis , 2004, NIPS.

[38]  Zvi Friedman,et al.  Improving motion estimation by accounting for local image distortion. , 2004, Ultrasonics.

[39]  Zvi Vered,et al.  Two-dimensional strain-a novel software for real-time quantitative echocardiographic assessment of myocardial function. , 2004, Journal of the American Society of Echocardiography : official publication of the American Society of Echocardiography.

[40]  J. Gardin,et al.  American Society of Echocardiography recommendations for use of echocardiography in clinical trials. , 2004, Journal of the American Society of Echocardiography : official publication of the American Society of Echocardiography.

[41]  V. Behar,et al.  The combined effect of nonlinear filtration and window size on the accuracy of tissue displacement estimation using detected echo signals. , 2004, Ultrasonics.

[42]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[43]  Milan Sonka,et al.  Automatic segmentation of echocardiographic sequences by active appearance motion models , 2002, IEEE Transactions on Medical Imaging.

[44]  J. Alison Noble,et al.  A shape-space-based approach to tracking myocardial borders and quantifying regional left-ventricular function applied in echocardiography , 2002, IEEE Transactions on Medical Imaging.

[45]  F. Van de Werf,et al.  Noninvasive Quantification of the Contractile Reserve of Stunned Myocardium by Ultrasonic Strain Rate and Strain , 2001, Circulation.

[46]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[47]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[48]  S. Zarich,et al.  The Goldman algorithm revisited: prospective evaluation of a computer-derived algorithm versus unaided physician judgment in suspected acute myocardial infarction. , 1999, American heart journal.

[49]  Yongmin Kim,et al.  A multiple active contour model for cardiac boundary detection on echocardiographic sequences , 1996, IEEE Trans. Medical Imaging.

[50]  E F Cook,et al.  A computer protocol to predict myocardial infarction in emergency department patients with chest pain. , 1988, The New England journal of medicine.

[51]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[52]  M. Christensen,et al.  Optimal Diagnosis in Acute Myocardial Infarction: A Cost‐effectiveness Study , 1980, Circulation.

[53]  G. Krishna,et al.  The condensed nearest neighbor rule using the concept of mutual nearest neighborhood (Corresp.) , 1979, IEEE Trans. Inf. Theory.