Utilizing temporal patterns for estimating uncertainty in interpretable early decision making

Early classification of time series is prevalent in many time-sensitive applications such as, but not limited to, early warning of disease outcome and early warning of crisis in stock market. \textcolor{black}{ For example,} early diagnosis allows physicians to design appropriate therapeutic strategies at early stages of diseases. However, practical adaptation of early classification of time series requires an easy to understand explanation (interpretability) and a measure of confidence of the prediction results (uncertainty estimates). These two aspects were not jointly addressed in previous time series early classification studies, such that a difficult choice of selecting one of these aspects is required. In this study, we propose a simple and yet effective method to provide uncertainty estimates for an interpretable early classification method. The question we address here is "how to provide estimates of uncertainty in regard to interpretable early prediction." In our extensive evaluation on twenty time series datasets we showed that the proposed method has several advantages over the state-of-the-art method that provides reliability estimates in early classification. Namely, the proposed method is more effective than the state-of-the-art method, is simple to implement, and provides interpretable results.

[1]  M. P. Griffin,et al.  Toward the early diagnosis of neonatal sepsis and sepsis-like illness using novel heart rate analysis. , 2001, Pediatrics.

[2]  B. E. Eckbo,et al.  Appendix , 1826, Epilepsy Research.

[3]  Hans-Peter Kriegel,et al.  Class Prediction from Time Series Gene Expression Profiles Using Dynamical Systems Kernels , 2005, Pacific Symposium on Biocomputing.

[4]  Ziv Bar-Joseph,et al.  Alignment and classification of time series gene expression in clinical studies , 2008, ISMB.

[5]  Philip S. Yu,et al.  Early prediction on time series: a nearest neighbor approach , 2009, IJCAI 2009.

[6]  Eamonn J. Keogh,et al.  Time series shapelets: a new primitive for data mining , 2009, KDD.

[7]  Philip S. Yu,et al.  Extracting Interpretable Features for Early Classification on Time Series , 2011, SDM.

[8]  Slobodan Vucetic,et al.  Tracking Concept Change with Incremental Boosting by Minimization of the Evolving Exponential Loss , 2011, ECML/PKDD.

[9]  Philip S. Yu,et al.  Early classification on time series , 2012, Knowledge and Information Systems.

[10]  Jenna Wiens,et al.  Patient Risk Stratification for Hospital-Associated C. diff as a Time-Series Classification Task , 2012, NIPS.

[11]  Mohamed F. Ghalwash,et al.  Early classification of multivariate temporal observations by extraction of interpretable shapelets , 2012, BMC Bioinformatics.

[12]  R. Longhi,et al.  Estimating Point and Interval Frequency of Antigen-Specific CD4+ T Cells Based on Short In Vitro Expansion and Improved Poisson Distribution Analysis , 2012, PloS one.

[13]  Mohamed F. Ghalwash,et al.  Early Diagnosis and Its Benefits in Sepsis Blood Purification Treatment , 2013, 2013 IEEE International Conference on Healthcare Informatics.

[14]  Hyrum S. Anderson,et al.  Classifying with confidence from incomplete information , 2013, J. Mach. Learn. Res..

[15]  Eamonn J. Keogh,et al.  Fast Shapelets: A Scalable Algorithm for Discovering Time Series Shapelets , 2013, SDM.

[16]  Mohamed F. Ghalwash,et al.  Extraction of Interpretable Multivariate Patterns for Early Diagnostics , 2013, 2013 IEEE 13th International Conference on Data Mining.