Cardiovascular/stroke risk predictive calculators: a comparison between statistical and machine learning models.

Background Statistically derived cardiovascular risk calculators (CVRC) that use conventional risk factors, generally underestimate or overestimate the risk of cardiovascular disease (CVD) or stroke events primarily due to lack of integration of plaque burden. This study investigates the role of machine learning (ML)-based CVD/stroke risk calculators (CVRCML) and compares against statistically derived CVRC (CVRCStat) based on (I) conventional factors or (II) combined conventional with plaque burden (integrated factors). Methods The proposed study is divided into 3 parts: (I) statistical calculator: initially, the 10-year CVD/stroke risk was computed using 13 types of CVRCStat (without and with plaque burden) and binary risk stratification of the patients was performed using the predefined thresholds and risk classes; (II) ML calculator: using the same risk factors (without and with plaque burden), as adopted in 13 different CVRCStat, the patients were again risk-stratified using CVRCML based on support vector machine (SVM) and finally; (III) both types of calculators were evaluated using AUC based on ROC analysis, which was computed using combination of predicted class and endpoint equivalent to CVD/stroke events. Results An Institutional Review Board approved 202 patients (156 males and 46 females) of Japanese ethnicity were recruited for this study with a mean age of 69±11 years. The AUC for 13 different types of CVRCStat calculators were: AECRS2.0 (AUC 0.83, P<0.001), QRISK3 (AUC 0.72, P<0.001), WHO (AUC 0.70, P<0.001), ASCVD (AUC 0.67, P<0.001), FRScardio (AUC 0.67, P<0.01), FRSstroke (AUC 0.64, P<0.001), MSRC (AUC 0.63, P=0.03), UKPDS56 (AUC 0.63, P<0.001), NIPPON (AUC 0.63, P<0.001), PROCAM (AUC 0.59, P<0.001), RRS (AUC 0.57, P<0.001), UKPDS60 (AUC 0.53, P<0.001), and SCORE (AUC 0.45, P<0.001), while the AUC for the CVRCML with integrated risk factors (AUC 0.88, P<0.001), a 42% increase in performance. The overall risk-stratification accuracy for the CVRCML with integrated risk factors was 92.52% which was higher compared all the other CVRCStat. Conclusions ML-based CVD/stroke risk calculator provided a higher predictive ability of 10-year CVD/stroke compared to the 13 different types of statistically derived risk calculators including integrated model AECRS 2.0.

[1]  Hyuk-Jae Chang,et al.  Machine learning based risk prediction model for asymptomatic individuals who underwent coronary artery calcium score: Comparison with traditional risk prediction approaches. , 2020, Journal of cardiovascular computed tomography.

[2]  Ankush D. Jamthikar,et al.  Global perspective on carotid intima-media thickness and plaque: should the current measurement guidelines be revisited? , 2019, International angiology : a journal of the International Union of Angiology.

[3]  R. Durazo-Arvizu,et al.  Machine learning to predict cardiovascular risk , 2019, International journal of clinical practice.

[4]  Jasjit S Suri,et al.  Ultrasound-based carotid stenosis measurement and risk stratification in diabetic cohort: a deep learning paradigm. , 2019, Cardiovascular diagnosis and therapy.

[5]  Jasjit S Suri,et al.  A low-cost machine learning-based cardiovascular/stroke risk assessment system: integration of conventional factors with image phenotypes. , 2019, Cardiovascular diagnosis and therapy.

[6]  Takayuki Otsuka,et al.  Comparison of risk models for mortality and cardiovascular events between machine learning and conventional logistic regression analysis , 2019, PloS one.

[7]  Mainak Biswas,et al.  Statistical characterization and classification of colon microarray gene expression data using multiple machine learning paradigms , 2019, Comput. Methods Programs Biomed..

[8]  Jasjit S Suri,et al.  Wilson's disease: A new perspective review on its genetics, diagnosis and treatment. , 2019, Frontiers in bioscience.

[9]  J. H. Rudd,et al.  Cardiovascular disease risk prediction using automated machine learning: A prospective study of 423,604 UK Biobank participants , 2019, PloS one.

[10]  Jasjit S. Suri,et al.  Ranking of stroke and cardiovascular risk factors for an optimal risk calculator design: Logistic regression approach , 2019, Comput. Biol. Medicine.

[11]  Jasjit S. Suri,et al.  A Special Report on Changing Trends in Preventive Stroke/Cardiovascular Risk Assessment Via B-Mode Ultrasonography , 2019, Current Atherosclerosis Reports.

[12]  Harman S. Suri,et al.  Effect of carotid image-based phenotypes on cardiovascular risk calculator: AECRS1.0 , 2019, Medical & Biological Engineering & Computing.

[13]  Jasjit S. Suri,et al.  Performance evaluation of 10-year ultrasound image-based stroke/cardiovascular (CV) risk calculator by comparing against ten conventional CV risk calculators: A diabetic study , 2019, Comput. Biol. Medicine.

[14]  Jasjit S Suri,et al.  Nonlinear model for the carotid artery disease 10‐year risk prediction by fusing conventional cardiovascular factors to carotid ultrasound image phenotypes: A Japanese diabetes cohort study , 2019, Echocardiography.

[15]  Standards of Medical Care in Diabetes—2019 Abridged for Primary Care Providers , 2018, Clinical Diabetes.

[16]  Ioannis A. Kakadiaris,et al.  Machine Learning Outperforms ACC/AHA CVD Risk Calculator in MESA , 2018, Journal of the American Heart Association.

[17]  Jasjit S. Suri,et al.  Geometric Total Plaque Area Is an Equally Powerful Phenotype Compared With Carotid Intima-Media Thickness for Stroke Risk Assessment: A Deep Learning Approach , 2018, Journal for Vascular Ultrasound.

[18]  J. Suri,et al.  Prostate Cancer Imaging , 2018 .

[19]  S. Rantapää-Dahlqvist,et al.  Performance of the Expanded Cardiovascular Risk Prediction Score for Rheumatoid Arthritis Is Not Superior to the ACC/AHA Risk Calculator , 2018, The Journal of Rheumatology.

[20]  Jasjit S. Suri,et al.  Morphologic TPA (mTPA) and composite risk score for moderate carotid atherosclerotic plaque is strongly associated with HbA1c in diabetes cohort , 2018, Comput. Biol. Medicine.

[21]  Harman S. Suri,et al.  Deep learning fully convolution network for lumen characterization in diabetic patients using carotid ultrasound: a tool for stroke risk , 2018, Medical & Biological Engineering & Computing.

[22]  Konstantia Zarkogianni,et al.  Comparison of Machine Learning Approaches Toward Assessing the Risk of Developing Cardiovascular Disease as a Long-Term Diabetes Complication , 2018, IEEE Journal of Biomedical and Health Informatics.

[23]  Jasjit S Suri,et al.  Echolucency-based phenotype in carotid atherosclerosis disease for risk stratification of diabetes patients. , 2018, Diabetes research and clinical practice.

[24]  Jasjit S Suri,et al.  A Survey on Coronary Atherosclerotic Plaque Tissue Characterization in Intravascular Optical Coherence Tomography , 2018, Current Atherosclerosis Reports.

[25]  J. Hansen,et al.  Joint Effect of Carotid Plaque and C‐Reactive Protein on First‐Ever Ischemic Stroke and Myocardial Infarction? , 2018, Journal of the American Heart Association.

[26]  Ayman El-Baz,et al.  Accurate Diabetes Risk Stratification Using Machine Learning: Role of Missing Value and Outliers , 2018, Journal of Medical Systems.

[27]  Jasjit S. Suri,et al.  Symtosis: A liver ultrasound tissue characterization and risk stratification in optimized deep learning paradigm , 2018, Comput. Methods Programs Biomed..

[28]  R. Brook,et al.  2017 ACC/AHA/AAPA/ABC/ACPM/AGS/APhA/ASH/ASPC/NMA/PCNA Guideline for the Prevention, Detection, Evaluation, and Management of High Blood Pressure in Adults. A report of the American College of Cardiology/American Heart Association Task Force on Clinical Practice Guidelines. , 2018, Journal of the American Society of Hypertension : JASH.

[29]  Steven Shea,et al.  Cardiovascular Event Prediction by Machine Learning: The Multi-Ethnic Study of Atherosclerosis , 2017, Circulation research.

[30]  Luca Saba,et al.  Lung disease stratification using amalgamation of Riesz and Gabor transforms in machine learning framework , 2017, Comput. Biol. Medicine.

[31]  Jasjit S. Suri,et al.  Extreme Learning Machine Framework for Risk Stratification of Fatty Liver Disease Using Ultrasound Tissue Characterization , 2017, Journal of Medical Systems.

[32]  Ajay Gupta,et al.  Plaque Tissue Morphology-Based Stroke Risk Stratification Using Carotid Ultrasound: A Polling-Based PCA Learning Paradigm , 2017, Journal of Medical Systems.

[33]  J David Spence,et al.  Resistant Atherosclerosis: The Need for Monitoring of Plaque Burden , 2017, Stroke.

[34]  J. Hippisley-Cox,et al.  Development and validation of QRISK3 risk prediction algorithms to estimate future risk of cardiovascular disease: prospective cohort study , 2017, British Medical Journal.

[35]  J. Kai,et al.  Can machine-learning improve cardiovascular risk prediction using routine clinical data? , 2017, PloS one.

[36]  Naveen Garg,et al.  Comparison of different cardiovascular risk score calculators for cardiovascular risk prediction and guideline recommended statin uses , 2017, Indian heart journal.

[37]  G. Francis,et al.  2016 Canadian Cardiovascular Society Guidelines for the Management of Dyslipidemia for the Prevention of Cardiovascular Disease in the Adult. , 2016, The Canadian journal of cardiology.

[38]  S. Yusuf,et al.  Global and regional effects of potentially modifiable risk factors associated with acute stroke in 32 countries (INTERSTROKE): a case-control study , 2016, The Lancet.

[39]  Dinesh Kant Kumar,et al.  Development of Health Parameter Model for Risk Prediction of CVD Using SVM , 2016, Comput. Math. Methods Medicine.

[40]  Ajay Gupta,et al.  Accurate cloud-based smart IMT measurement, its validation and stroke risk stratification in carotid ultrasound: A web-based point-of-care tool for multicenter clinical trial , 2016, Comput. Biol. Medicine.

[41]  B. Goldstein,et al.  Moving beyond regression techniques in cardiovascular risk prediction: applying machine learning to address analytic challenges , 2016, European heart journal.

[42]  Achal Kumar Goyal,et al.  Cardiovascular risk prediction: a comparative study of Framingham and quantum neural network based approach , 2016, Patient preference and adherence.

[43]  Nilanjan Dey,et al.  Automated stratification of liver disease in ultrasound: An online accurate feature classification paradigm , 2016, Comput. Methods Programs Biomed..

[44]  Mark D. Huffman,et al.  Heart Disease and Stroke Statistics—2016 Update: A Report From the American Heart Association , 2016, Circulation.

[45]  M. Bots,et al.  Carotid Intima-media Thickness Measurements: Relations with Atherosclerosis, Risk of Cardiovascular Disease and Application in Randomized Controlled Trials , 2016, Chinese medical journal.

[46]  R. Townsend,et al.  Management of hypertension in chronic kidney disease , 2015, Nature Reviews Nephrology.

[47]  R. Sacco,et al.  The relationship between carotid intima-media thickness and carotid plaque in the Northern Manhattan Study. , 2015, Atherosclerosis.

[48]  Nadeem Qureshi,et al.  Cardiovascular risk assessment and lipid modification: NICE guideline. , 2015, The British journal of general practice : the journal of the Royal College of General Practitioners.

[49]  Mark E. Molitch,et al.  Management of diabetes mellitus in patients with chronic kidney disease , 2015, Clinical Diabetes and Endocrinology.

[50]  L. Gray,et al.  Statins and Cardiovascular Primary Prevention in CKD: A Meta-Analysis. , 2015, Clinical journal of the American Society of Nephrology : CJASN.

[51]  J. Vishram Prognostic interactions between cardiovascular risk factors. , 2014, Danish medical journal.

[52]  Jennifer G. Robinson,et al.  2013 ACC/AHA Guideline on the Assessment of Cardiovascular Risk: A Report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines , 2014, Circulation.

[53]  Stella S. Daskalopoulou,et al.  MyRisk_Stroke Calculator: A Personalized Stroke Risk Assessment Tool for the General Population , 2014, Journal of clinical neurology.

[54]  Ayman El-Baz,et al.  Prostate Tissue Characterization/Classification in 144 Patient Population Using Wavelet and Higher Order Spectra Features from Transrectal Ultrasound Images , 2013, Technology in cancer research & treatment.

[55]  Jasjit S. Suri,et al.  Multi-Modality Atherosclerosis Imaging and Diagnosis , 2013 .

[56]  Robert Dufour,et al.  2012 update of the Canadian Cardiovascular Society guidelines for the diagnosis and treatment of dyslipidemia for the prevention of cardiovascular disease in the adult. , 2013, The Canadian journal of cardiology.

[57]  U. Rajendra Acharya,et al.  Plaque Tissue Characterization and Classification in Ultrasound Carotid Scans: A Paradigm for Vascular Feature Amalgamation , 2013, IEEE Transactions on Instrumentation and Measurement.

[58]  J. Suri,et al.  Atherosclerotic plaque tissue characterization in 2D ultrasound longitudinal carotid scans for automated classification: a paradigm for stroke risk assessment , 2013, Medical & Biological Engineering & Computing.

[59]  U. Rajendra Acharya,et al.  Ultrasound IMT measurement on a multi-ethnic and multi-institutional database: Our review and experience using four fully automated and one semi-automated methods , 2012, Comput. Methods Programs Biomed..

[60]  E. Vicaut,et al.  Mannheim Carotid Intima-Media Thickness and Plaque Consensus (2004–2006–2011) , 2012, Cerebrovascular Diseases.

[61]  J. Suri,et al.  What is the correct distance measurement metric when measuring carotid ultrasound intima-media thickness automatically? , 2012, International angiology : a journal of the International Union of Angiology.

[62]  Filippo Molinari,et al.  Carotid IMT Variability (IMTV) and Its Validation in Symptomatic versus Asymptomatic Italian Population: Can This Be a Useful Index for Studying Symptomaticity? , 2012, Echocardiography.

[63]  U Rajendra Acharya,et al.  Data mining framework for fatty liver disease classification in ultrasound: A hybrid feature extraction paradigm. , 2012, Medical physics.

[64]  J. Suri,et al.  Atherosclerotic risk stratification strategy for carotid arteries using texture-based features. , 2012, Ultrasound in medicine & biology.

[65]  U. Rajendra Acharya,et al.  An Accurate and Generalized Approach to Plaque Characterization in 346 Carotid Ultrasound Scans , 2012, IEEE Transactions on Instrumentation and Measurement.

[66]  U. Rajendra Acharya,et al.  Completely Automated Multiresolution Edge Snapper—A New Technique for an Accurate Carotid Ultrasound IMT Measurement: Clinical Validation and Benchmarking on a Multi-Institutional Database , 2012, IEEE Transactions on Image Processing.

[67]  U Rajendra Acharya,et al.  Automated carotid IMT measurement and its validation in low contrast ultrasound database of 885 patient Indian population epidemiological study: results of AtheroEdge™ Software. , 2012, International angiology : a journal of the International Union of Angiology.

[68]  U. Rajendra Acharya,et al.  Hypothesis Validation of Far-Wall Brightness in Carotid-Artery Ultrasound for Feature-Based IMT Measurement Using a Combination of Level-Set Segmentation and Registration , 2012, IEEE Transactions on Instrumentation and Measurement.

[69]  Luca Saba,et al.  Intima Media Thickness Variability (IMTV) and its association with cerebrovascular events: a novel marker of carotid therosclerosis? , 2011, Cardiovascular diagnosis and therapy.

[70]  Joao Sanches,et al.  Ultrasound Imaging: Advances and Applications , 2011 .

[71]  Jasjit S. Suri,et al.  Inter-Greedy Technique for Fusion of Different Segmentation Strategies Leading to High-Performance Carotid IMT Measurement in Ultrasound Images , 2011, Journal of Medical Systems.

[72]  Ayman El-Baz,et al.  Lung imaging and computer-aided diagnosis , 2011 .

[73]  P. Libby,et al.  Progress and challenges in translating the biology of atherosclerosis , 2011, Nature.

[74]  Jasjit S. Suri,et al.  A state of the art review on intima-media thickness (IMT) measurement and wall segmentation techniques for carotid ultrasound , 2010, Comput. Methods Programs Biomed..

[75]  Shen-Chih Chang,et al.  Low glomerular filtration rate and risk of stroke: meta-analysis , 2010, BMJ : British Medical Journal.

[76]  S. Yusuf,et al.  Risk factors for ischaemic and intracerebral haemorrhagic stroke in 22 countries (the INTERSTROKE study): a case-control study , 2010, The Lancet.

[77]  J. Spence,et al.  Treating Arteries Instead of Risk Factors: A Paradigm Change in Management of Atherosclerosis , 2010, Stroke.

[78]  Filippo Molinari,et al.  Intima-media thickness: setting a standard for a completely automated method of ultrasound measurement , 2010, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[79]  G. Boysen,et al.  European Guidelines on Cardiovascular Disease Prevention , 2009, International journal of stroke : official journal of the International Stroke Society.

[80]  M. Desai,et al.  Strategies to reverse atherosclerosis: An imaging perspective , 2008, Current treatment options in cardiovascular medicine.

[81]  T. Therneau,et al.  High ten-year risk of cardiovascular disease in newly diagnosed rheumatoid arthritis patients: a population-based cohort study. , 2008, Arthritis and rheumatism.

[82]  M. Pencina,et al.  General Cardiovascular Risk Profile for Use in Primary Care: The Framingham Heart Study , 2008, Circulation.

[83]  Christopher B. Kendall,et al.  Use of carotid ultrasound to identify subclinical vascular disease and evaluate cardiovascular disease risk: a consensus statement from the American Society of Echocardiography Carotid Intima-Media Thickness Task Force. Endorsed by the Society for Vascular Medicine. , 2008, Journal of the American Society of Echocardiography : official publication of the American Society of Echocardiography.

[84]  G. Lip,et al.  The QRISK was less likely to overestimate cardiovascular risk than the Framingham or ASSIGN equations. , 2008, ACP journal club.

[85]  Stephen M Schwartz,et al.  Vascular Remodeling: Hemodynamic and Biochemical Mechanisms Underlying Glagov’s Phenomenon , 2007, Arteriosclerosis, thrombosis, and vascular biology.

[86]  C. Shear,et al.  Biomarkers in the Prevention and Treatment of Atherosclerosis: Need, Validation, and Future , 2007, Pharmacological Reviews.

[87]  N. Cook,et al.  Development and validation of improved algorithms for the assessment of global cardiovascular risk in women: the Reynolds Risk Score. , 2007, JAMA.

[88]  E. Vicaut,et al.  Mannheim Carotid Intima-Media Thickness Consensus (2004–2006) , 2006, Cerebrovascular Diseases.

[89]  R. Toto,et al.  Treatment of hypertension in chronic kidney disease. , 2005, Seminars in nephrology.

[90]  François Mach,et al.  Inflammation and Atherosclerosis , 2004, Herz.

[91]  Charles E McCulloch,et al.  Chronic kidney disease and the risks of death, cardiovascular events, and hospitalization. , 2004, The New England journal of medicine.

[92]  S. Yusuf,et al.  Effect of potentially modifiable risk factors associated with myocardial infarction in 52 countries (the INTERHEART study): case-control study , 2004, The Lancet.

[93]  B. Dahlöf,et al.  Surrogate markers for cardiovascular disease: structural markers. , 2004, Circulation.

[94]  J. Peters,et al.  Evaluating the performance of the Framingham risk equations in a population with diabetes , 2004, Diabetic medicine : a journal of the British Diabetic Association.

[95]  V. Gudnason,et al.  Erythrocyte sedimentation rate, an independent predictor of coronary heart disease in men and women: The Reykjavik Study. , 2003, American journal of epidemiology.

[96]  H. Tunstall-Pedoe,et al.  Estimation of ten-year risk of fatal cardiovascular disease in Europe: the SCORE project. , 2003, European heart journal.

[97]  Peter Libby,et al.  Vascular biology of atherosclerosis: overview and state of the art. , 2003, The American journal of cardiology.

[98]  J. David Spence,et al.  Carotid Plaque Area: A Tool for Targeting and Evaluating Vascular Preventive Therapy , 2002, Stroke.

[99]  R. Stevens,et al.  UKPDS 60: Risk of Stroke in Type 2 Diabetes Estimated by the UK Prospective Diabetes Study Risk Engine , 2002, Stroke.

[100]  G. Assmann,et al.  Simple Scoring Scheme for Calculating the Risk of Acute Coronary Events Based on the 10-Year Follow-Up of the Prospective Cardiovascular Münster (PROCAM) Study , 2002, Circulation.

[101]  B. Conrad,et al.  Elevated C-Reactive Protein Is Associated with an Increased Intima to Media Thickness of the Common Carotid Artery , 2002, Cerebrovascular Diseases.

[102]  R. Holman,et al.  The UKPDS risk engine: a model for the risk of coronary heart disease in Type II diabetes (UKPDS 56). , 2001, Clinical science.

[103]  K. Liestøl,et al.  Erythrocyte sedimentation rate: a possible marker of atherosclerosis and a strong predictor of coronary heart disease mortality. , 2000, European heart journal.

[104]  M. Rouis,et al.  [Role of macrophages in atherogenesis]. , 1991, Presse medicale.

[105]  C. Bengtsson,et al.  Erythrocyte sedimentation rate and cardiovascular disease. Results from a population study of women in Göteborg, Sweden. , 1982, Atherosclerosis.

[106]  G. Ruhenstroth-Bauer,et al.  Erythrocyte sedimentation rate and C-reactive protein. , 2015, Australian prescriber.

[107]  Ayman El-Baz,et al.  Stroke Risk Stratification and its Validation using Ultrasonic Echolucent Carotid Wall Plaque Morphology: A Machine Learning Paradigm , 2017, Comput. Biol. Medicine.

[108]  Jasjit S. Suri,et al.  3D Imaging Technologies in Atherosclerosis , 2015, Springer US.

[109]  E. Ritz,et al.  Dyslipidemia in chronic kidney disease , 2012 .

[110]  Jasjit S. Suri,et al.  Atherosclerosis disease management , 2011 .

[111]  Jeffrey L. Anderson,et al.  ACCF / AHA Guideline for Assessment of Cardiovascular Risk in Asymptomatic Adults , 2010 .

[112]  Giuseppe Mancia,et al.  World Health Organization (WHO) and International Society of Hypertension (ISH) risk prediction charts: assessment of cardiovascular risk for prevention and control of cardiovascular disease in low and middle-income countries. , 2007, Journal of hypertension.

[113]  Risk assessment chart for death from cardiovascular disease based on a 19-year follow-up study of a Japanese representative population. , 2006, Circulation journal : official journal of the Japanese Circulation Society.

[114]  J. Collet,et al.  Surrogate endpoints: A basis for a rational approach , 2006, European Journal of Clinical Pharmacology.

[115]  J. Mckenney,et al.  Executive Summary of The Third Report of The National Cholesterol Education Program (NCEP) Expert Panel on Detection, Evaluation, And Treatment of High Blood Cholesterol In Adults (Adult Treatment Panel III). , 2001, JAMA.

[116]  R B D'Agostino,et al.  Stroke risk profile: adjustment for antihypertensive medication. The Framingham Study. , 1994, Stroke.