Automated detection of vulnerable plaque in intravascular ultrasound images

AbstractAcute coronary syndrome (ACS) is a syndrome caused by a decrease in blood flow in the coronary arteries. The ACS is usually related to coronary thrombosis and is primarily caused by plaque rupture followed by plaque erosion and calcified nodule. Thin-cap fibroatheroma (TCFA) is known to be the most similar lesion morphologically to a plaque rupture. In this paper, we propose methods to classify TCFA using various machine learning classifiers including feed-forward neural network (FNN), K-nearest neighbor (KNN), random forest (RF), and convolutional neural network (CNN) to figure out a classifier that shows optimal TCFA classification accuracy. In addition, we suggest pixel range–based feature extraction method to extract the ratio of pixels in the different region of interests to reflect the physician’s TCFA discrimination criteria. Our feature extraction method examines the pixel distribution of the intravascular ultrasound (IVUS) image at a given ROI, which allows us to extract general characteristics of the IVUS image while simultaneously reflecting the different properties of the vessel’s substances such as necrotic core and calcified nodule depending on the brightness of the pixel. A total of 12,325 IVUS images were labeled with corresponding optical coherence tomography (OCT) images to train and evaluate the classifiers. We achieved 0.859, 0.848, 0.844, and 0.911 area under the ROC curve (AUC) in the order of using FNN, KNN, RF, and CNN classifiers. As a result, the CNN classifier performed best and the top 10 features of the feature-based classifiers (FNN, KNN, RF) were found to be similar to the physician’s TCFA diagnostic criteria. Graphical AbstractAUC result of proposed classifiers.

[1]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[2]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[3]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[4]  Rob Fergus,et al.  Stochastic Pooling for Regularization of Deep Convolutional Neural Networks , 2013, ICLR.

[5]  Rodney X. Sturdivant,et al.  Applied Logistic Regression: Hosmer/Applied Logistic Regression , 2005 .

[6]  R. Plackett,et al.  Karl Pearson and the Chi-squared Test , 1983 .

[7]  Tae Joon Jun,et al.  Thin-Cap Fibroatheroma Detection with Deep Neural Networks , 2017, ICONIP.

[8]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[9]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[10]  Marco Nolden,et al.  The Medical Imaging Interaction Toolkit , 2005, Medical Image Anal..

[11]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  R. Virmani,et al.  The thin-cap fibroatheroma: a type of vulnerable plaque: The major precursor lesion to acute coronary syndromes , 2001, Current opinion in cardiology.

[13]  D. Hosmer,et al.  Applied Logistic Regression , 1991 .

[14]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[15]  Patrick W Serruys,et al.  Imaging of coronary atherosclerosis: intravascular ultrasound. , 2010, European heart journal.

[16]  Bolei Zhou,et al.  Learning Deep Features for Discriminative Localization , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Andrew L. Maas Rectifier Nonlinearities Improve Neural Network Acoustic Models , 2013 .

[18]  M. Bennett,et al.  Association between IVUS findings and adverse outcomes in patients with coronary artery disease: the VIVA (VH-IVUS in Vulnerable Atherosclerosis) Study. , 2011, JACC. Cardiovascular imaging.

[19]  Renu Virmani,et al.  Pathology of the vulnerable plaque. , 2007, Journal of the American College of Cardiology.

[20]  澤田 隆弘,et al.  Feasibility of combined use of intravascular ultrasound radiofrequency data analysis and optical coherence tomography for detecting thin-cap fibroatheroma , 2008 .

[21]  Patrice Y. Simard,et al.  Best practices for convolutional neural networks applied to visual document analysis , 2003, Seventh International Conference on Document Analysis and Recognition, 2003. Proceedings..

[22]  Heekuck Oh,et al.  Neural Networks for Pattern Recognition , 1993, Adv. Comput..

[23]  Matthew D. Zeiler ADADELTA: An Adaptive Learning Rate Method , 2012, ArXiv.

[24]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[25]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[26]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[27]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[28]  Zhi Chen,et al.  Prospective Prediction of Thin-Cap Fibroatheromas from Baseline Virtual Histology Intravascular Ultrasound Data , 2015, MICCAI.

[29]  Aixia Guo,et al.  Gene Selection for Cancer Classification using Support Vector Machines , 2014 .

[30]  P. Yock,et al.  Intravascular ultrasound: novel pathophysiological insights and current clinical applications. , 2001, Circulation.

[31]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[32]  M. Kendall Statistical Methods for Research Workers , 1937, Nature.

[33]  Marco Valgimigli,et al.  In vivo intravascular ultrasound-derived thin-cap fibroatheroma detection using ultrasound radiofrequency data analysis. , 2005, Journal of the American College of Cardiology.

[34]  R. Virmani,et al.  Intravascular Ultrasound and Near-Infrared Spectroscopic Characterization of Thin-Cap Fibroatheroma. , 2017, The American journal of cardiology.

[35]  Cardona Alzate,et al.  Predicción y selección de variables con bosques aleatorios en presencia de variables correlacionadas , 2020 .

[36]  Sepp Hochreiter,et al.  Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs) , 2015, ICLR.

[37]  Yoram Singer,et al.  Adaptive Subgradient Methods for Online Learning and Stochastic Optimization , 2011, J. Mach. Learn. Res..

[38]  Lawrence D. Jackel,et al.  Backpropagation Applied to Handwritten Zip Code Recognition , 1989, Neural Computation.

[39]  Brett E. Bouma,et al.  In Vivo Characterization of Coronary Atherosclerotic Plaque by Use of Optical Coherence Tomography , 2005, Circulation.