Deep learning analysis of the myocardium in coronary CT angiography for identification of patients with functionally significant coronary artery stenosis

HighlightsPresence of functionally significant coronary stenosis is determined automatically.Functional significance of the stenosis is determined by myocardium analysis.Deep learning is applied to analyze the left ventricle myocardium in coronary CTA.The results demonstrate that identification of patients with low FFR is feasible.This may potentially reduce the number of patients undergoing invasive FFR. Graphical abstract Figure. No Caption available. Abstract In patients with coronary artery stenoses of intermediate severity, the functional significance needs to be determined. Fractional flow reserve (FFR) measurement, performed during invasive coronary angiography (ICA), is most often used in clinical practice. To reduce the number of ICA procedures, we present a method for automatic identification of patients with functionally significant coronary artery stenoses, employing deep learning analysis of the left ventricle (LV) myocardium in rest coronary CT angiography (CCTA). The study includes consecutively acquired CCTA scans of 166 patients who underwent invasive FFR measurements. To identify patients with a functionally significant coronary artery stenosis, analysis is performed in several stages. First, the LV myocardium is segmented using a multiscale convolutional neural network (CNN). To characterize the segmented LV myocardium, it is subsequently encoded using unsupervised convolutional autoencoder (CAE). As ischemic changes are expected to appear locally, the LV myocardium is divided into a number of spatially connected clusters, and statistics of the encodings are computed as features. Thereafter, patients are classified according to the presence of functionally significant stenosis using an SVM classifier based on the extracted features. Quantitative evaluation of LV myocardium segmentation in 20 images resulted in an average Dice coefficient of 0.91 and an average mean absolute distance between the segmented and reference LV boundaries of 0.7 mm. Twenty CCTA images were used to train the LV myocardium encoder. Classification of patients was evaluated in the remaining 126 CCTA scans in 50 10‐fold cross‐validation experiments and resulted in an area under the receiver operating characteristic curve of 0.74 ± 0.02. At sensitivity levels 0.60, 0.70 and 0.80, the corresponding specificity was 0.77, 0.71 and 0.59, respectively. The results demonstrate that automatic analysis of the LV myocardium in a single CCTA scan acquired at rest, without assessment of the anatomy of the coronary arteries, can be used to identify patients with functionally significant coronary artery stenosis. This might reduce the number of patients undergoing unnecessary invasive FFR measurements.

[1]  Marie-Pierre Jolly,et al.  Automatic Segmentation of the Left Ventricle in Cardiac MR and CT Images , 2006, International Journal of Computer Vision.

[2]  J. Lima,et al.  A stepwise approach to the visual interpretation of CT-based myocardial perfusion. , 2011, Journal of cardiovascular computed tomography.

[3]  P. H. van der Voort,et al.  Measurement of fractional flow reserve to assess the functional severity of coronary-artery stenoses. , 1996, The New England journal of medicine.

[4]  Amir A. Amini,et al.  A survey of shaped-based registration and segmentation techniques for cardiac images , 2013, Comput. Vis. Image Underst..

[5]  Mohammad Ullah,et al.  Fractional Flow Reserve - A Review , 2013 .

[6]  Honglak Lee,et al.  Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations , 2009, ICML '09.

[7]  Donghee Han,et al.  Incremental role of resting myocardial computed tomography perfusion for predicting physiologically significant coronary artery disease: A machine learning approach , 2018, Journal of Nuclear Cardiology.

[8]  Bon-Kwon Koo,et al.  The present and future of fractional flow reserve. , 2014, Circulation journal : official journal of the Japanese Circulation Society.

[9]  D. Sculley,et al.  Web-scale k-means clustering , 2010, WWW '10.

[10]  Giovanni Montana,et al.  Deep neural networks for anatomical brain segmentation , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[11]  M. Budoff,et al.  Diagnostic performance of 64-multidetector row coronary computed tomographic angiography for evaluation of coronary artery stenosis in individuals without known coronary artery disease: results from the prospective multicenter ACCURACY (Assessment by Coronary Computed Tomographic Angiography of Indi , 2008, Journal of the American College of Cardiology.

[12]  M. Reiser,et al.  Detection of hemodynamically significant coronary artery stenosis: incremental diagnostic value of dynamic CT-based myocardial perfusion imaging. , 2011, Radiology.

[13]  Y. Nesterov Gradient methods for minimizing composite objective function , 2007 .

[14]  Martin Styner,et al.  Standardized evaluation methodology and reference database for evaluating coronary artery centerline extraction algorithms , 2009, Medical Image Anal..

[15]  A. Kono,et al.  Fractional flow reserve computed from noninvasive CT angiography data: diagnostic performance of an on-site clinician-operated computational fluid dynamics algorithm. , 2015, Radiology.

[16]  Hannes Nickisch,et al.  Learning Patient-Specific Lumped Models for Interactive Coronary Blood Flow Simulations , 2015, MICCAI.

[17]  Christoph Meinel,et al.  Deep Learning for Medical Image Analysis , 2018, Journal of Pathology Informatics.

[18]  Michael J Pencina,et al.  Diagnostic accuracy of fractional flow reserve from anatomic CT angiography. , 2012, JAMA.

[19]  A. Engel,et al.  Feasibility of automatic assessment of four-chamber cardiac function with MDCT: Initial clinical application and validation. , 2010, European journal of radiology.

[20]  Hyuk-Jae Chang,et al.  Adenosine Stress 64- and 256-Row Detector Computed Tomography Angiography and Perfusion Imaging: A Pilot Study Evaluating the Transmural Extent of Perfusion Abnormalities to Predict Atherosclerosis Causing Myocardial Ischemia , 2009, Circulation. Cardiovascular imaging.

[21]  Konstantin Nikolaou,et al.  Accuracy of 64-MDCT in the diagnosis of ischemic heart disease. , 2006, AJR. American journal of roentgenology.

[22]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[23]  K. Gould,et al.  A black and white response to the "gray zone" for fractional flow reserve measurements. , 2014, JACC. Cardiovascular interventions.

[24]  Volker Klauss,et al.  Fractional flow reserve versus angiography for guidance of PCI in patients with multivessel coronary artery disease (FAME): 5-year follow-up of a randomised controlled trial , 2015, The Lancet.

[25]  Uwe Siebert,et al.  Clinical ResearchInterventional CardiologyFractional Flow Reserve Versus Angiography for Guiding Percutaneous Coronary Intervention in Patients With Multivessel Coronary Artery Disease: 2-Year Follow-Up of the FAME (Fractional Flow Reserve Versus Angiography for Multivessel Evaluation) Study , 2010 .

[26]  Hiroshi Ito,et al.  Diagnostic Performance of First-Pass Myocardial Perfusion Imaging without Stress with Computed Tomography (CT) Compared with Coronary CT Angiography Alone, with Fractional Flow Reserve as the Reference Standard , 2016, PloS one.

[27]  Ernst Klotz,et al.  Stress myocardial perfusion: imaging with multidetector CT. , 2014, Radiology.

[28]  Tim A. Fonte,et al.  Computational Fluid Dynamics Applied to Cardiac Computed Tomography for Noninvasive Quantification of Fractional Flow Reserve , 2022 .

[29]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Guanglei Xiong,et al.  Myocardial perfusion analysis in cardiac computed tomography angiographic images at rest , 2015, Medical Image Anal..

[31]  A. S. Abraham,et al.  Progression and regression of coronary artery disease in one year , 1993, The International Journal of Cardiac Imaging.

[32]  Max A. Viergever,et al.  Automatic segmentation of the left ventricle in cardiac CT angiography using convolutional neural networks , 2016, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).

[33]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[34]  Charles A. Taylor,et al.  Computational fluid dynamics applied to cardiac computed tomography for noninvasive quantification of fractional flow reserve: scientific basis. , 2013, Journal of the American College of Cardiology.

[35]  Konstantinos Kamnitsas,et al.  Efficient multi‐scale 3D CNN with fully connected CRF for accurate brain lesion segmentation , 2016, Medical Image Anal..

[36]  W. Wijns,et al.  Fractional Flow Reserve in Patients With Prior Myocardial Infarction , 2001, Circulation.

[37]  Sepp Hochreiter,et al.  Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs) , 2015, ICLR.

[38]  Tianxi Cai,et al.  Iodinated Contrast Opacification Gradients in Normal Coronary Arteries Imaged With Prospectively ECG-Gated Single Heart Beat 320-Detector Row Computed Tomography , 2010, Circulation. Cardiovascular imaging.

[39]  Max A. Viergever,et al.  Automatic Segmentation of MR Brain Images With a Convolutional Neural Network , 2016, IEEE Transactions on Medical Imaging.

[40]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[41]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[42]  U. Siebert,et al.  Fractional flow reserve versus angiography for guiding percutaneous coronary intervention. , 2009, The New England journal of medicine.

[43]  Patrick W Serruys,et al.  Comprehensive assessment of coronary artery stenoses: computed tomography coronary angiography versus conventional coronary angiography and correlation with fractional flow reserve in patients with stable angina. , 2008, Journal of the American College of Cardiology.

[44]  Nobuhiro Tanaka,et al.  Functional assessment of coronary stenoses: can we live without it? , 2013, European heart journal.

[45]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[46]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[47]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[48]  I. Meredith,et al.  Combined CT coronary angiography and stress myocardial perfusion imaging for hemodynamically significant stenoses in patients with suspected coronary artery disease: a comparison with fractional flow reserve. , 2012, JACC. Cardiovascular imaging.

[49]  V. Jain,et al.  Resting cardiac 64-MDCT does not reliably detect myocardial ischemia identified by radionuclide imaging. , 2013, AJR. American journal of roentgenology.

[50]  Dorin Comaniciu,et al.  Four-Chamber Heart Modeling and Automatic Segmentation for 3-D Cardiac CT Volumes Using Marginal Space Learning and Steerable Features , 2008, IEEE Transactions on Medical Imaging.

[51]  Colin Berry,et al.  VERIFY (VERification of Instantaneous Wave-Free Ratio and Fractional Flow Reserve for the Assessment of Coronary Artery Stenosis Severity in EverydaY Practice): a multicenter study in consecutive patients. , 2013, Journal of the American College of Cardiology.

[52]  Max A. Viergever,et al.  ConvNet-Based Localization of Anatomical Structures in 3-D Medical Images , 2017, IEEE Transactions on Medical Imaging.

[53]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[54]  William Wijns,et al.  Fractional flow reserve for the assessment of nonculprit coronary artery stenoses in patients with acute myocardial infarction. , 2010, JACC. Cardiovascular interventions.

[55]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[56]  Sayan Sen,et al.  Fractional flow reserve-guided revascularization: practical implications of a diagnostic gray zone and measurement variability on clinical decisions. , 2013, JACC. Cardiovascular interventions.

[57]  Christopher Joseph Pal,et al.  Brain tumor segmentation with Deep Neural Networks , 2015, Medical Image Anal..

[58]  M. Cerqueira,et al.  Standardized myocardial segmentation and nomenclature for tomographic imaging of the heart: A statement for healthcare professionals from the Cardiac Imaging Committee of the Council on Clinical Cardiology of the American Heart Association , 2002, The international journal of cardiovascular imaging.

[59]  Mark D. Huffman,et al.  Heart Disease and Stroke Statistics—2016 Update: A Report From the American Heart Association , 2016, Circulation.

[60]  M. Cerqueira,et al.  Standardized myocardial segmentation and nomenclature for tomographic imaging of the heart. A statement for healthcare professionals from the Cardiac Imaging Committee of the Council on Clinical Cardiology of the American Heart Association. , 2002, Journal of nuclear cardiology : official publication of the American Society of Nuclear Cardiology.

[61]  Puneet Sharma,et al.  A patient-specific reduced-order model for coronary circulation , 2012, 2012 9th IEEE International Symposium on Biomedical Imaging (ISBI).

[62]  Thomas Gärtner,et al.  Multi-Instance Kernels , 2002, ICML.

[63]  Jürgen Schmidhuber,et al.  Stacked Convolutional Auto-Encoders for Hierarchical Feature Extraction , 2011, ICANN.

[64]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[65]  Hiroshi Ito,et al.  Diagnostic performance of noninvasive fractional flow reserve derived from coronary computed tomography angiography in suspected coronary artery disease: the NXT trial (Analysis of Coronary Blood Flow Using CT Angiography: Next Steps). , 2014, Journal of the American College of Cardiology.

[66]  Stefan Baumann,et al.  Comparison of diagnostic value of a novel noninvasive coronary computed tomography angiography method versus standard coronary angiography for assessing fractional flow reserve. , 2014, The American journal of cardiology.

[67]  Wei Guo,et al.  Aligning Coronary Anatomy and Myocardial Perfusion Territories: An Algorithm for the CORE320 Multicenter Study , 2012, Circulation. Cardiovascular imaging.

[68]  T van Walsum,et al.  Evaluation of a multi-atlas based method for segmentation of cardiac CTA data: a large-scale, multicenter, and multivendor study. , 2010, Medical physics.

[69]  Habib Samady,et al.  Fractional flow reserve of infarct-related arteries identifies reversible defects on noninvasive myocardial perfusion imaging early after myocardial infarction. , 2006, Journal of the American College of Cardiology.