Machine learning-based diagnosis for disseminated intravascular coagulation (DIC): Development, external validation, and comparison to scoring systems

The major challenge in the diagnosis of disseminated intravascular coagulation (DIC) comes from the lack of specific biomarkers, leading to developing composite scoring systems. DIC scores are simple and rapidly applicable. However, optimal fibrin-related markers and their cut-off values remain to be defined, requiring optimization for use. The aim of this study is to optimize the use of DIC-related parameters through machine learning (ML)-approach. Further, we evaluated whether this approach could provide a diagnostic value in DIC diagnosis. For this, 46 DIC-related parameters were investigated for both clinical findings and laboratory results. We retrospectively reviewed 656 DIC-suspected cases at an initial order for full DIC profile and labeled their evaluation results (Set 1; DIC, n = 228; non-DIC, n = 428). Several ML algorithms were tested, and an artificial neural network (ANN) model was established via independent training and testing using 32 selected parameters. This model was externally validated from a different hospital with 217 DIC-suspected cases (Set 2; DIC, n = 80; non-DIC, n = 137). The ANN model represented higher AUC values than the three scoring systems in both set 1 (ANN 0.981; ISTH 0.945; JMHW 0.943; and JAAM 0.928) and set 2 (AUC ANN 0.968; ISTH 0.946). Additionally, the relative importance of the 32 parameters was evaluated. Most parameters had contextual importance, however, their importance in ML-approach was different from the traditional scoring system. Our study demonstrates that ML could optimize the use of clinical parameters with robustness for DIC diagnosis. We believe that this approach could play a supportive role in physicians’ medical decision by integrated into electrical health record system. Further prospective validation is required to assess the clinical consequence of ML-approach and their clinical benefit.

[1]  W. Hoots,et al.  The scoring system of the Scientific and Standardisation Committee on Disseminated Intravascular Coagulation of the International Society on Thrombosis and Haemostasis: a 5‐year overview 1 , 2007, Journal of thrombosis and haemostasis : JTH.

[2]  P Thirup,et al.  LUC, what is that? Large unstained cells. , 1999, Clinical chemistry.

[3]  F B Taylor,et al.  Towards Definition, Clinical and Laboratory Criteria, and a Scoring System for Disseminated Intravascular Coagulation , 2001, Thrombosis and Haemostasis.

[4]  Jong Rak Choi,et al.  Delta Neutrophil Index: A Promising Diagnostic and Prognostic Marker for Sepsis , 2012, Shock.

[5]  Xavier Robin,et al.  pROC: an open-source package for R and S+ to analyze and compare ROC curves , 2011, BMC Bioinformatics.

[6]  T. Williamson,et al.  Automatic detection of diabetic retinopathy using an artificial neural network: a screening tool. , 1996, The British journal of ophthalmology.

[7]  Roland Eils,et al.  Complex heatmaps reveal patterns and correlations in multidimensional genomic data , 2016, Bioinform..

[8]  E. Topol,et al.  Adapting to Artificial Intelligence: Radiologists and Pathologists as Information Specialists. , 2016, JAMA.

[9]  A. Kharbach,et al.  Schistocytes in disseminated intravascular coagulation , 2014, International journal of laboratory hematology.

[10]  T Maekawa,et al.  Criteria for diagnosis of DIC based on the analysis of clinical and laboratory findings in 345 DIC patients collected by the Research Committee on DIC in Japan. , 1983, Bibliotheca haematologica.

[11]  K. Boudjeltia,et al.  Diagnosis and prognosis of overt disseminated intravascular coagulation in a general hospital—Meaning of the ISTH score system, fibrin monomers, and lipoprotein–C‐reactive protein complex formation , 2006, American journal of hematology.

[12]  Poul Thirup,et al.  LUC, What Is That? , 1999 .

[13]  Subhashini Venugopalan,et al.  Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus Photographs. , 2016, JAMA.

[14]  Carmen Cadarso-Suárez,et al.  OptimalCutpoints: An R Package for Selecting Optimal Cutpoints in Diagnostic Tests , 2014 .

[15]  E. Draper,et al.  APACHE II: A severity of disease classification system , 1985, Critical care medicine.

[16]  Kohji Okamoto,et al.  Proposal for new diagnostic criteria for DIC from the Japanese Society on Thrombosis and Hemostasis , 2016, Thrombosis Journal.

[17]  Yasuhiro Ohtomo,et al.  A multicenter, prospective validation of disseminated intravascular coagulation diagnostic criteria for critically ill patients: Comparing current criteria* , 2006, Critical care medicine.

[18]  M. Di Nisio,et al.  Diagnosis of overt and non-overt disseminated intravascular coagulation: A survey among experts and a call for action from the ISTH. , 2017, Thrombosis research.

[19]  Sebastian Thrun,et al.  Dermatologist-level classification of skin cancer with deep neural networks , 2017, Nature.

[20]  Qeethara Al-Shayea Artificial Neural Networks in Medical Diagnosis , 2024, International Journal of Research Publication and Reviews.

[21]  Martin Borggrefe,et al.  Use of soluble fibrin antigen instead of D-dimer as fibrin-related marker may enhance the prognostic power of the ISTH overt DIC score , 2004, Thrombosis and Haemostasis.

[22]  H K Kim,et al.  Prognostic value of platelet indices as determined by ADVIA 120 in patients suspected of having disseminated intravascular coagulation , 2008, International journal of laboratory hematology.

[23]  Nandor Gabor Than,et al.  DIC Score in Pregnant Women – A Population Based Modification of the International Society on Thrombosis and Hemostasis Score , 2014, PloS one.

[24]  W. J. Li,et al.  Efficacy evaluation of D‐dimer and modified criteria in overt and nonovert disseminated intravascular coagulation diagnosis , 2016, International journal of laboratory hematology.

[25]  M. Ringnér,et al.  Classification and diagnostic prediction of cancers using gene expression profiling and artificial neural networks , 2001, Nature Medicine.

[26]  Kaoru Koike,et al.  Comparison of diagnostic criteria for disseminated intravascular coagulation (DIC): diagnostic criteria of the International Society of Thrombosis and Hemostasis (ISTH) and of the Japanese Ministry of Health and Welfare for overt DIC , 2003, American journal of hematology.

[27]  Russell G. Death,et al.  An accurate comparison of methods for quantifying variable importance in artificial neural networks using simulated data , 2004 .

[28]  W. Baxt Use of an artificial neural network for the diagnosis of myocardial infarction. , 1991, Annals of internal medicine.

[29]  Heekuck Oh,et al.  Neural Networks for Pattern Recognition , 1993, Adv. Comput..

[30]  Young Keun Kim,et al.  Rapid Identification of Thrombocytopenia-Associated Multiple Organ Failure Using Red Blood Cell Parameters and a Volume/Hemoglobin Concentration Cytogram , 2011, Yonsei medical journal.

[31]  M. Levi,et al.  DIC: which laboratory tests are most useful. , 2011, Blood reviews.

[32]  Julian D. Olden,et al.  Illuminating the “black box”: a randomization approach for understanding variable contributions in artificial neural networks , 2002 .

[33]  K. Borgwardt,et al.  Machine Learning in Medicine , 2015, Mach. Learn. under Resour. Constraints Vol. 3.

[34]  R. Mcpherson,et al.  Widely Used Types and Clinical Applications of D-Dimer Assay. , 2016, Laboratory medicine.

[35]  T. Iba,et al.  [Disseminated intravascular coagulation]. , 2003, Nihon rinsho. Japanese journal of clinical medicine.

[36]  C. Toh,et al.  Current Pathological and Laboratory Considerations in the Diagnosis of Disseminated Intravascular Coagulation , 2016, Annals of laboratory medicine.

[37]  E. de Jonge,et al.  Prospective validation of the International Society of Thrombosis and Haemostasis scoring system for disseminated intravascular coagulation* , 2004, Critical care medicine.

[38]  Satoshi Gando,et al.  A multicenter, prospective validation study of the Japanese Association for Acute Medicine disseminated intravascular coagulation scoring system in patients with severe sepsis , 2013, Critical Care.