Performance evaluation of 10-year ultrasound image-based stroke/cardiovascular (CV) risk calculator by comparing against ten conventional CV risk calculators: A diabetic study

MOTIVATION AtheroEdge Composite Risk Score (AECRS1.010yr) is an integrated stroke/cardiovascular risk calculator that was recently developed and computes the 10-year risk of carotid image phenotypes by integrating conventional cardiovascular risk factors (CCVRFs). It is therefore important to understand how closely AECRS1.010yr is associated with the ten other currently available conventional cardiovascular risk calculators (CCVRCs). METHODS The Institutional Review Board of Toho University approved the examination of the left/right common carotid arteries of 202 Japanese patients. Step 1 consists of measurement of AECRS1.010yr, given current image phenotypes and CCVRFs. Step 2 consists of computing the risk score using ten different CCVRCs given CCVR factors: QRISK3, Framingham Risk Score (FRS), United Kingdom Prospective Diabetes Study (UKPDS) 56, UKPDS60, Reynolds Risk Score (RRS), Pooled cohort Risk Score (PCRS or ASCVD), Systematic Coronary Risk Evaluation (SCORE), Prospective Cardiovascular Munster Study (PROCAM) calculator, NIPPON, and World Health Organization (WHO) risk. Step 3 consists of computing the closeness factor between AECRS1.010yr and ten CCVRCs using cumulative ranking index derived using eight different statistically derived metrics. RESULTS AECRS1.010yr reported the highest area-under-the-curve (0.927;P < 0.001) among all the risk calculators. The top three CCVRCs closest to AECRS1.010yr were QRISK3, FRS, and UKPDS60 with cumulative ranking scores of 2.1, 3.0, and 3.8, respectively. CONCLUSION AECRS1.010yr produced the largest AUC due to the integration of image-based phenotypes with CCVR factors, and ranked at first place with the highest AUC. Cumulative ranking of ten CCVRCs demonstrated that QRISK3 was the closest calculator to AECRS1.010yr, which is also consistent with the industry trend.

[1]  J. Suri,et al.  Improved correlation between carotid and coronary atherosclerosis SYNTAX score using automated ultrasound carotid bulb plaque IMT measurement. , 2015, Ultrasound in medicine & biology.

[2]  U. Rajendra Acharya,et al.  Ultrasound IMT measurement on a multi-ethnic and multi-institutional database: Our review and experience using four fully automated and one semi-automated methods , 2012, Comput. Methods Programs Biomed..

[3]  D. Prabhakaran,et al.  Cardiovascular Diseases in India: Current Epidemiology and Future Directions , 2016, Circulation.

[4]  J. David Spence,et al.  Carotid Plaque Area: A Tool for Targeting and Evaluating Vascular Preventive Therapy , 2002, Stroke.

[5]  G Geroulakos,et al.  Increase in Echogenicity of Echolucent Carotid Plaques after Treatment with Total Triterpenic Fraction of Centella asiatica: A Prospective, Placebo-Controlled, Randomized Trial , 2001, Angiology.

[6]  J. Hippisley-Cox,et al.  Development and validation of QRISK3 risk prediction algorithms to estimate future risk of cardiovascular disease: prospective cohort study , 2017, British Medical Journal.

[7]  G. Assmann,et al.  Simple Scoring Scheme for Calculating the Risk of Acute Coronary Events Based on the 10-Year Follow-Up of the Prospective Cardiovascular Münster (PROCAM) Study , 2002, Circulation.

[8]  Pamela S Douglas,et al.  Predictors of Carotid Intima-Media Thickness Progression in Young Adults: The Bogalusa Heart Study , 2007, Stroke.

[9]  Tatjana Rundek,et al.  Ultrasonographic measure of carotid plaque burden. , 2013, JACC. Cardiovascular imaging.

[10]  Ajay Gupta,et al.  Plaque Tissue Morphology-Based Stroke Risk Stratification Using Carotid Ultrasound: A Polling-Based PCA Learning Paradigm , 2017, Journal of Medical Systems.

[11]  Jasjit S. Suri,et al.  A state of the art review on intima-media thickness (IMT) measurement and wall segmentation techniques for carotid ultrasound , 2010, Comput. Methods Programs Biomed..

[12]  Jennifer G. Robinson,et al.  Comparison of the Framingham and Reynolds Risk Scores for Global Cardiovascular Risk Prediction in the Multiethnic Women's Health Initiative , 2012, Circulation.

[13]  N. Cook,et al.  Development and validation of improved algorithms for the assessment of global cardiovascular risk in women: the Reynolds Risk Score. , 2007, JAMA.

[14]  S. Yusuf,et al.  Global and regional effects of potentially modifiable risk factors associated with acute stroke in 32 countries (INTERSTROKE): a case-control study , 2016, The Lancet.

[15]  P. Libby,et al.  Inflammation and Atherosclerosis , 2002, Circulation.

[16]  W. Tracz,et al.  Association of increased carotid intima-media thickness with the extent of coronary artery disease , 2004, Heart.

[17]  Filippo Molinari,et al.  Comparison between manual and automated analysis for the quantification of carotid wall by using sonography. A validation study with CT. , 2012, European journal of radiology.

[18]  Michiel L Bots,et al.  Comparison of the Framingham Risk Score, SCORE and WHO/ISH cardiovascular risk prediction models in an Asian population. , 2014, International journal of cardiology.

[19]  Jasjit S. Suri,et al.  Deep learning strategy for accurate carotid intima-media thickness measurement: An ultrasound study on Japanese diabetic cohort , 2018, Comput. Biol. Medicine.

[20]  Jasjit S. Suri,et al.  Intra- and inter-operator reproducibility of automated cloud-based carotid lumen diameter ultrasound measurement , 2018, Indian heart journal.

[21]  R. Stevens,et al.  UKPDS 60: Risk of Stroke in Type 2 Diabetes Estimated by the UK Prospective Diabetes Study Risk Engine , 2002, Stroke.

[22]  Johan Sundström,et al.  Impact of Aging on the Strength of Cardiovascular Risk Factors: A Longitudinal Study Over 40 Years , 2018, Journal of the American Heart Association.

[23]  Ajay Gupta,et al.  Web-based accurate measurements of carotid lumen diameter and stenosis severity: An ultrasound-based clinical tool for stroke risk assessment during multicenter clinical trials , 2017, Comput. Biol. Medicine.

[24]  Jasjit S. Suri,et al.  Relationship between leukoaraiosis, carotid intima-media thickness and intima-media thickness variability: Preliminary results , 2016, European Radiology.

[25]  Stephen Colagiuri,et al.  Comparison of the Framingham and United Kingdom Prospective Diabetes Study cardiovascular risk equations in Australian patients with type 2 diabetes from the Fremantle Diabetes Study , 2009, The Medical journal of Australia.

[26]  H. Tunstall-Pedoe,et al.  Estimation of ten-year risk of fatal cardiovascular disease in Europe: the SCORE project. , 2003, European heart journal.

[27]  G. M. Allan,et al.  Comparison of cardiovascular disease risk calculators , 2014, Current opinion in lipidology.

[28]  Jasjit S Suri,et al.  Nonlinear model for the carotid artery disease 10‐year risk prediction by fusing conventional cardiovascular factors to carotid ultrasound image phenotypes: A Japanese diabetes cohort study , 2019, Echocardiography.

[29]  Gerardo Heiss,et al.  Carotid Artery Intimal‐Medial Thickness Distribution in General Populations As Evaluated by B‐Mode Ultrasound , 1993, Stroke.

[30]  Michael J Pencina,et al.  Carotid-wall intima-media thickness and cardiovascular events. , 2011, The New England journal of medicine.

[31]  J David Spence,et al.  Resistant Atherosclerosis: The Need for Monitoring of Plaque Burden , 2017, Stroke.

[32]  S. Yusuf,et al.  Association of psychosocial risk factors with risk of acute myocardial infarction in 11 119 cases and 13 648 controls from 52 countries (the INTERHEART study): case-control study , 2004, The Lancet.

[33]  N John Bosomworth,et al.  Practical use of the Framingham risk score in primary prevention: Canadian perspective. , 2011, Canadian family physician Medecin de famille canadien.

[34]  Nadeem Qureshi,et al.  Cardiovascular risk assessment and lipid modification: NICE guideline. , 2015, The British journal of general practice : the journal of the Royal College of General Practitioners.

[35]  Jasjit S. Suri,et al.  Plaque Echolucency and Stroke Risk in Asymptomatic Carotid Stenosis: A Systematic Review and Meta-Analysis , 2015, Stroke.

[36]  J. Stein,et al.  Carotid intima-media thickness, plaques, and cardiovascular disease risk: implications for preventive cardiology guidelines. , 2010, Journal of the American College of Cardiology.

[37]  Eric Boerwinkle,et al.  Carotid intima-media thickness and presence or absence of plaque improves prediction of coronary heart disease risk: the ARIC (Atherosclerosis Risk In Communities) study. , 2010, Journal of the American College of Cardiology.

[38]  J. Suri,et al.  What is the correct distance measurement metric when measuring carotid ultrasound intima-media thickness automatically? , 2012, International angiology : a journal of the International Union of Angiology.

[39]  Jennifer G. Robinson,et al.  2013 ACC/AHA Guideline on the Assessment of Cardiovascular Risk: A Report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines , 2014, Circulation.

[40]  Lu Gao,et al.  Predictive value for cardiovascular events of common carotid intima media thickness and its rate of change in individuals at high cardiovascular risk – Results from the PROG-IMT collaboration , 2018, PloS one.

[41]  U Rajendra Acharya,et al.  Automated carotid IMT measurement and its validation in low contrast ultrasound database of 885 patient Indian population epidemiological study: results of AtheroEdge™ Software. , 2012, International angiology : a journal of the International Union of Angiology.

[42]  Sameeah A Rashid,et al.  Correlation between Carotid Artery Intima-Media Thickness and Luminal Diameter with Body Mass Index and Other Cardiovascular Risk Factors in Adults. , 2015, Sultan Qaboos University medical journal.

[43]  Jasjit S. Suri,et al.  Geometric Total Plaque Area Is an Equally Powerful Phenotype Compared With Carotid Intima-Media Thickness for Stroke Risk Assessment: A Deep Learning Approach , 2018, Journal for Vascular Ultrasound.

[44]  Diederick E. Grobbee,et al.  Carotid intima-media thickness measurement in cardiovascular screening programmes , 2009, European journal of cardiovascular prevention and rehabilitation : official journal of the European Society of Cardiology, Working Groups on Epidemiology & Prevention and Cardiac Rehabilitation and Exercise Physiology.

[45]  Mark C Simmonds,et al.  Risk Estimation Versus Screening Performance: A Comparison of Six Risk Algorithms for Cardiovascular Disease , 2012, Journal of medical screening.

[46]  L. Qin,et al.  Erectile dysfunction and risk of cardiovascular disease: meta-analysis of prospective cohort studies. , 2011, Journal of the American College of Cardiology.

[47]  R. Holman,et al.  The UKPDS risk engine: a model for the risk of coronary heart disease in Type II diabetes (UKPDS 56). , 2001, Clinical science.

[48]  Luca Saba,et al.  Intima Media Thickness Variability (IMTV) and its association with cerebrovascular events: a novel marker of carotid therosclerosis? , 2011, Cardiovascular diagnosis and therapy.

[49]  M. Pencina,et al.  General Cardiovascular Risk Profile for Use in Primary Care: The Framingham Heart Study , 2008, Circulation.

[50]  Daniel H Solomon,et al.  Comparison of cardiovascular risk algorithms in patients with vs without rheumatoid arthritis and the role of C-reactive protein in predicting cardiovascular outcomes in rheumatoid arthritis , 2017, Rheumatology.

[51]  Jasjit S. Suri,et al.  Morphologic TPA (mTPA) and composite risk score for moderate carotid atherosclerotic plaque is strongly associated with HbA1c in diabetes cohort , 2018, Comput. Biol. Medicine.

[52]  Ajay Gupta,et al.  Accurate cloud-based smart IMT measurement, its validation and stroke risk stratification in carotid ultrasound: A web-based point-of-care tool for multicenter clinical trial , 2016, Comput. Biol. Medicine.

[53]  Filippo Molinari,et al.  Intima-media thickness: setting a standard for a completely automated method of ultrasound measurement , 2010, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[54]  Min-Ho Shin,et al.  Comparison of the Framingham Risk Score, UKPDS Risk Engine, and SCORE for Predicting Carotid Atherosclerosis and Peripheral Arterial Disease in Korean Type 2 Diabetic Patients , 2011, Korean journal of family medicine.

[55]  Michèle Depairon,et al.  Associations Between Cardiovascular Risk Factors, Inflammation, and Progression of Carotid Atherosclerosis Among Smokers. , 2016, Nicotine & Tobacco Research.

[56]  A. Bhansali,et al.  Agreement between Framingham Risk Score and United Kingdom Prospective Diabetes Study Risk Engine in Identifying High Coronary Heart Disease Risk in North Indian Population , 2015, Diabetes & metabolism journal.

[57]  J. Suri,et al.  Automated carotid intima-media thickness and its link for prediction of SYNTAX score in Japanese coronary artery disease patients. , 2013, International angiology : a journal of the International Union of Angiology.

[58]  M. Drazner,et al.  2013 ACCF/AHA guideline for the management of heart failure: a report of the American College of Cardiology Foundation/American Heart Association Task Force on Practice Guidelines. , 2013, Journal of the American College of Cardiology.

[59]  Tadashi Araki,et al.  PCA-based polling strategy in machine learning framework for coronary artery disease risk assessment in intravascular ultrasound: A link between carotid and coronary grayscale plaque morphology , 2016, Comput. Methods Programs Biomed..

[60]  Azeem Majeed,et al.  The comparison of cardiovascular risk scores using two methods of substituting missing risk factor data in patient medical records. , 2011, Informatics in primary care.

[61]  Christopher B. Kendall,et al.  Use of carotid ultrasound to identify subclinical vascular disease and evaluate cardiovascular disease risk: a consensus statement from the American Society of Echocardiography Carotid Intima-Media Thickness Task Force. Endorsed by the Society for Vascular Medicine. , 2008, Journal of the American Society of Echocardiography : official publication of the American Society of Echocardiography.

[62]  Olle Melander,et al.  The effect of smoking on carotid intima-media thickness progression rate and rate of lumen diameter reduction. , 2016, European journal of internal medicine.

[63]  Naveen Garg,et al.  Comparison of different cardiovascular risk score calculators for cardiovascular risk prediction and guideline recommended statin uses , 2017, Indian heart journal.

[64]  Robert Dufour,et al.  2012 update of the Canadian Cardiovascular Society guidelines for the diagnosis and treatment of dyslipidemia for the prevention of cardiovascular disease in the adult. , 2013, The Canadian journal of cardiology.