Temporal Pattern Detection to Predict Adverse Events in Critical Care: Case Study With Acute Kidney Injury

Background More than 20% of patients admitted to the intensive care unit (ICU) develop an adverse event (AE). No previous study has leveraged patients’ data to extract the temporal features using their structural temporal patterns, that is, trends. Objective This study aimed to improve AE prediction methods by using structural temporal pattern detection that captures global and local temporal trends and to demonstrate these improvements in the detection of acute kidney injury (AKI). Methods Using the Medical Information Mart for Intensive Care dataset, containing 22,542 patients, we extracted both global and local trends using structural pattern detection methods to predict AKI (ie, binary prediction). Classifiers were built on 17 input features consisting of vital signs and laboratory test results using state-of-the-art models; the optimal classifier was selected for comparisons with previous approaches. The classifier with structural pattern detection features was compared with two baseline classifiers that used different temporal feature extraction approaches commonly used in the literature: (1) symbolic temporal pattern detection, which is the most common approach for multivariate time series classification; and (2) the last recorded value before the prediction point, which is the most common approach to extract temporal data in the AKI prediction literature. Moreover, we assessed the individual contribution of global and local trends. Classifier performance was measured in terms of accuracy (primary outcome), area under the curve, and F-measure. For all experiments, we employed 20-fold cross-validation. Results Random forest was the best classifier using structural temporal pattern detection. The accuracy of the classifier with local and global trend features was significantly higher than that while using symbolic temporal pattern detection and the last recorded value (81.3% vs 70.6% vs 58.1%; P<.001). Excluding local or global features reduced the accuracy to 74.4% or 78.1%, respectively (P<.001). Conclusions Classifiers using features obtained from structural temporal pattern detection significantly improved the prediction of AKI onset in ICU patients over two baselines based on common previous approaches. The proposed method is a generalizable approach to predict AEs in critical care that may be used to help clinicians intervene in a timely manner to prevent or mitigate AEs.

[1]  D. Bates,et al.  Costs of adverse events in intensive care units* , 2007, Critical care medicine.

[2]  Ron Kohavi,et al.  Supervised and Unsupervised Discretization of Continuous Features , 1995, ICML.

[3]  Radoslaw Martin Cichy,et al.  Resolving human object recognition in space and time , 2014, Nature Neuroscience.

[4]  Yong Hu,et al.  Predicting Inpatient Acute Kidney Injury over Different Time Horizons: How Early and Accurate? , 2017, AMIA.

[5]  Yuval Shahar,et al.  Consistent discovery of frequent interval-based temporal patterns in chronic patients' data , 2017, J. Biomed. Informatics.

[6]  Kalpana Raja,et al.  Classification of clinically useful sentences in clinical evidence resources , 2016, J. Biomed. Informatics.

[7]  Chih-Ping Wei,et al.  Nearest-neighbor-based approach to time-series classification , 2012, Decis. Support Syst..

[8]  Daniel P. Siewiorek,et al.  Generalized feature extraction for structural pattern recognition in time-series data , 2001 .

[9]  Won Ho Kim,et al.  Clinical Risk Scoring Models for Prediction of Acute Kidney Injury after Living Donor Liver Transplantation: A Retrospective Observational Study , 2015, PloS one.

[10]  Dimitrios Gunopulos,et al.  Mining frequent arrangements of temporal intervals , 2009, Knowledge and Information Systems.

[11]  Eamonn J. Keogh,et al.  A symbolic representation of time series, with implications for streaming algorithms , 2003, DMKD '03.

[12]  Leif E. Peterson K-nearest neighbor , 2009, Scholarpedia.

[13]  Olivia R. Liu Sheng,et al.  Healthcare cost prediction: Leveraging fine-grain temporal patterns , 2019, J. Biomed. Informatics.

[14]  John A. Kellum,et al.  Utilizing electronic health records to predict acute kidney injury risk and outcomes: workgroup statements from the 15th ADQI Consensus Conference , 2016, Canadian journal of kidney health and disease.

[15]  Gang Yu,et al.  Discriminative Orderlet Mining for Real-Time Recognition of Human-Object Interaction , 2014, ACCV.

[16]  Margaret H. Wright,et al.  Direct search methods: Once scorned, now respectable , 1996 .

[17]  Alberto Maria Segre,et al.  Programs for Machine Learning , 1994 .

[18]  Donald J. Berndt,et al.  Using Dynamic Time Warping to Find Patterns in Time Series , 1994, KDD Workshop.

[19]  Wei-Yin Loh,et al.  Classification and regression trees , 2011, WIREs Data Mining Knowl. Discov..

[20]  Jessica Lin,et al.  Pattern Recognition in Time Series , 2012 .

[21]  A. Bottle,et al.  Investigating Adverse Event Free Admissions in Medicare Inpatients as a Patient Safety Indicator , 2017, Annals of surgery.

[22]  Ewout W. Steyerberg,et al.  Improving patient prostate cancer risk assessment: Moving from static, globally-applied to dynamic, practice-specific risk calculators , 2015, J. Biomed. Informatics.

[23]  Rodney X. Sturdivant,et al.  Applied Logistic Regression: Hosmer/Applied Logistic Regression , 2005 .

[24]  Eckart Michaelsen,et al.  Stochastic reasoning for structural pattern recognition: An example from image-based UAV navigation , 2014, Pattern Recognit..

[25]  R. Malacrida,et al.  Adverse event reporting in adult intensive care units and the impact of a multifaceted intervention on drug-related adverse events , 2012, Annals of Intensive Care.

[26]  Rohit J. Kate,et al.  Prediction and detection models for acute kidney injury in hospitalized older adults , 2016, BMC Medical Informatics and Decision Making.

[27]  Achim Zeileis,et al.  Bias in random forest variable importance measures: Illustrations, sources and a solution , 2007, BMC Bioinformatics.

[28]  Yuval Shahar,et al.  Medical Temporal-Knowledge Discovery via Temporal Abstraction , 2009, AMIA.

[29]  B. Prasad,et al.  Validating a scoring tool to predict acute kidney injury (AKI) following cardiac surgery , 2015, Canadian journal of kidney health and disease.

[30]  Nir Friedman,et al.  Bayesian Network Classifiers , 1997, Machine Learning.

[31]  Wei-Guo Zhang,et al.  Portfolio selection under possibilistic mean-variance utility and a SMO algorithm , 2009, Eur. J. Oper. Res..

[32]  K. Weinfurt,et al.  Repeated measures analyses : ANOVA MANOVA, and HLM , 2000 .

[33]  Junyi Shen,et al.  Classification of multivariate time series using two-dimensional singular value decomposition , 2008, Knowl. Based Syst..

[34]  Fabian Mörchen,et al.  Algorithms for time series knowledge mining , 2006, KDD '06.

[35]  L. Eshelman,et al.  Automated Continuous Acute Kidney Injury Prediction and Surveillance: A Random Forest Model , 2019, Mayo Clinic proceedings.

[36]  Francisco Herrera,et al.  A Survey of Discretization Techniques: Taxonomy and Empirical Analysis in Supervised Learning , 2013, IEEE Transactions on Knowledge and Data Engineering.

[37]  J. Schold,et al.  Predictive models for acute kidney injury following cardiac surgery. , 2012, American journal of kidney diseases : the official journal of the National Kidney Foundation.

[38]  A. Yusuf,et al.  Improving the management of Acute Kidney Injury in a District General Hospital: Introduction of the DONUT bundle , 2014, BMJ quality improvement reports.

[39]  Yuval Shahar,et al.  Classification of multivariate time series via temporal abstraction and time intervals mining , 2015, Knowledge and Information Systems.

[40]  I. Biederman Recognition-by-components: a theory of human image understanding. , 1987, Psychological review.

[41]  C. Ronco,et al.  The RIFLE criteria and mortality in acute kidney injury: A systematic review. , 2008, Kidney international.

[42]  Duc Thanh Anh Luong,et al.  A K-Means Approach to Clustering Disease Progressions , 2017, 2017 IEEE International Conference on Healthcare Informatics (ICHI).

[43]  R. Gamelli,et al.  Predicting Acute Kidney Injury Among Burn Patients in the 21st Century: A Classification and Regression Tree Analysis , 2012, Journal of burn care & research : official publication of the American Burn Association.

[44]  David D. Lewis,et al.  Naive (Bayes) at Forty: The Independence Assumption in Information Retrieval , 1998, ECML.

[45]  John J Dziak,et al.  Factorial experiments: efficient tools for evaluation of intervention components. , 2014, American journal of preventive medicine.

[46]  Milos Hauskrecht,et al.  A temporal pattern mining approach for classifying electronic health record data , 2013, ACM Trans. Intell. Syst. Technol..

[47]  Evert de Jonge,et al.  Temporal abstraction for feature extraction: A comparative case study in prediction from intensive care monitoring data , 2007, Artif. Intell. Medicine.

[48]  Peter Szolovits,et al.  MIMIC-III, a freely accessible critical care database , 2016, Scientific Data.

[49]  Juan José Rodríguez Diez,et al.  Support vector machines of interval-based features for time series classification , 2004, Knowl. Based Syst..

[50]  Yuval Shahar,et al.  Fast time intervals mining using the transitivity of temporal relations , 2013, Knowledge and Information Systems.

[51]  Harry Zhang,et al.  The Optimality of Naive Bayes , 2004, FLAIRS.

[52]  Milos Hauskrecht,et al.  Mining recent temporal patterns for event detection in multivariate time series data , 2012, KDD.

[53]  John A Kellum,et al.  Acute Kidney Injury Network: report of an initiative to improve outcomes in acute kidney injury , 2007, Critical care.

[54]  Kaveh G Shojania,et al.  The impact of adverse events in the intensive care unit on hospital mortality and length of stay , 2008, BMC health services research.

[55]  David W. Hosmer,et al.  Applied Logistic Regression , 1991 .

[56]  George Hripcsak,et al.  Prognosis of Clinical Outcomes with Temporal Patterns and Experiences with One Class Feature Selection , 2017, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[57]  James F. Allen Maintaining knowledge about temporal intervals , 1983, CACM.

[58]  G. Harinath,et al.  General surgical adverse events in a UK district general hospital-lessons to learn. , 2011, International journal of surgery.

[59]  Girish N. Nadkarni,et al.  Incorporating temporal EHR data in predictive models for risk stratification of renal function deterioration , 2014, J. Biomed. Informatics.

[60]  Paul R. Yarnold,et al.  Reading and understanding MORE multivariate statistics. , 2000 .

[61]  Jai Radhakrishnan,et al.  Notice , 2012, Kidney International Supplements.

[62]  Roger G. Mark,et al.  Empirical relationships among oliguria, creatinine, mortality, and renal replacement therapy in the critically ill , 2013, Intensive Care Medicine.

[63]  Yuval Shahar,et al.  Vaidurya: A multiple-ontology, concept-based, context-sensitive clinical-guideline search engine , 2009, J. Biomed. Informatics.

[64]  John A Kellum,et al.  Risk factors for acute kidney injury in older adults with critical illness: a retrospective cohort study. , 2015, American journal of kidney diseases : the official journal of the National Kidney Foundation.

[65]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[66]  Michael L. Baird Structural Pattern Recognition , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.