Automating Carotid Intima-Media Thickness Video Interpretation with Convolutional Neural Networks

Cardiovascular disease (CVD) is the leading cause of mortality yet largely preventable, but the key to prevention is to identify at-risk individuals before adverse events. For predicting individual CVD risk, carotid intima-media thickness (CIMT), a noninvasive ultrasound method, has proven to be valuable, offering several advantages over CT coronary artery calcium score. However, each CIMT examination includes several ultrasound videos, and interpreting each of these CIMT videos involves three operations: (1) select three end-diastolic ultrasound frames (EUF) in the video, (2) localize a region of interest (ROI) in each selected frame, and (3) trace the lumen-intima interface and the media-adventitia interface in each ROI to measure CIMT. These operations are tedious, laborious, and time consuming, a serious limitation that hinders the widespread utilization of CIMT in clinical practice. To overcome this limitation, this paper presents a new system to automate CIMT video interpretation. Our extensive experiments demonstrate that the suggested system performs reliably. The reliable performance is attributable to our unified framework based on convolutional neural networks (CNNs) coupled with our informative image representation and effective post-processing of the CNN outputs, which are uniquely designed for each of the above three operations.

[1]  Demetri Terzopoulos,et al.  United Snakes , 1999, Medical Image Anal..

[2]  Christos P. Loizou,et al.  A review of ultrasound common carotid artery image and video segmentation techniques , 2014, Medical & Biological Engineering & Computing.

[3]  P. Touboul,et al.  Use of monitoring software to improve the measurement of carotid wall thickness by B-mode imaging , 1992, Journal of hypertension. Supplement : official journal of the International Society of Hypertension.

[4]  Rafael Verdú,et al.  Frequency-domain active contours solution to evaluate intima-media thickness of the common carotid artery , 2015, Biomed. Signal Process. Control..

[5]  Christos P. Loizou,et al.  Integrated System for the Complete Segmentation of the Common Carotid Artery Bifurcation in Ultrasound Images , 2013, AIAI.

[6]  Kalpana Reddy Fully Automated Segmentation and Tracking of the Intima Media Thickness in Ultrasound Video Sequences of the Common Carotid Artery , 2014 .

[7]  Christopher B. Kendall,et al.  Incidence of subclinical atherosclerosis as a marker of cardiovascular risk in retired professional football players. , 2010, The American journal of cardiology.

[8]  Xiaoyi Jiang,et al.  Detections of Arterial Wall in Sonographic Artery Images Using Dual Dynamic Programming , 2008, IEEE Transactions on Information Technology in Biomedicine.

[9]  Alessandro C Rossi,et al.  Automatic localization of intimal and adventitial carotid artery layers with noninvasive ultrasound: a novel algorithm providing scan quality control. , 2010, Ultrasound in medicine & biology.

[10]  Christos P. Loizou,et al.  Segmentation of the Common Carotid Intima-Media Complex in Ultrasound Images Using Active Contours , 2012, IEEE Transactions on Biomedical Engineering.

[11]  Daniel J. Rader,et al.  Noninvasive atherosclerosis imaging for predicting cardiovascular events and assessing therapeutic interventions , 2004, Current atherosclerosis reports.

[12]  Rafael Verdú,et al.  Segmentation of the Common Carotid Artery Walls Based on a Frequency Implementation of Active Contours , 2013, Journal of Digital Imaging.

[13]  José-Luis Sancho-Gómez,et al.  Fully automatic segmentation of ultrasound common carotid artery images based on machine learning , 2015, Neurocomputing.

[14]  Filippo Molinari,et al.  Fully Automated Dual‐Snake Formulation for Carotid Intima‐Media Thickness Measurement , 2012, Journal of ultrasound in medicine : official journal of the American Institute of Ultrasound in Medicine.

[15]  Christopher B. Kendall,et al.  Use of carotid ultrasound to identify subclinical vascular disease and evaluate cardiovascular disease risk: a consensus statement from the American Society of Echocardiography Carotid Intima-Media Thickness Task Force. Endorsed by the Society for Vascular Medicine. , 2008, Journal of the American Society of Echocardiography : official publication of the American Society of Echocardiography.

[16]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[17]  John B. Shoven,et al.  I , Edinburgh Medical and Surgical Journal.

[18]  F. Faita,et al.  Real‐time Measurement System for Evaluation of the Carotid Intima‐Media Thickness With a Robust Edge Operator , 2008, Journal of ultrasound in medicine : official journal of the American Institute of Ultrasound in Medicine.

[19]  Lawrence D. Jackel,et al.  Handwritten Digit Recognition with a Back-Propagation Network , 1989, NIPS.

[20]  R. Todd Hurst,et al.  A user friendly system for ultrasound carotid intima-media thickness image interpretation , 2011, Medical Imaging.

[21]  Jasjit S. Suri,et al.  CAUDLES-EF: Carotid Automated Ultrasound Double Line Extraction System Using Edge Flow , 2011, Journal of Digital Imaging.

[22]  Yuan Zhou,et al.  Ultrasound intima-media segmentation using Hough transform and dual snake model , 2012, Comput. Medical Imaging Graph..

[23]  Tomas Gustavsson,et al.  A multiscale dynamic programming procedure for boundary detection in ultrasonic artery images , 2000, IEEE Transactions on Medical Imaging.

[24]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[25]  Jasjit S. Suri,et al.  Characterization of a Completely User-Independent Algorithm for Carotid Artery Segmentation in 2-D Ultrasound Images , 2007, IEEE Transactions on Instrumentation and Measurement.

[26]  C.S. Pattichis,et al.  An Integrated System for the Segmentation of Atherosclerotic Carotid Plaque , 2007, IEEE Transactions on Information Technology in Biomedicine.

[27]  Antonio González-López,et al.  Automatic Evaluation of Carotid Intima-Media Thickness in Ultrasounds Using Machine Learning , 2013, IWINAC.

[28]  Yu Zhang,et al.  ECG-based frame selection and curvature-based ROI detection for measuring carotid intima-media thickness , 2014, Medical Imaging.

[29]  P. Pignoli,et al.  Evaluation of atherosclerosis with B-mode ultrasound imaging. , 1988, The Journal of nuclear medicine and allied sciences.

[30]  Jasjit S. Suri,et al.  A state of the art review on intima-media thickness (IMT) measurement and wall segmentation techniques for carotid ultrasound , 2010, Comput. Methods Programs Biomed..