Bag of recurrence patterns representation for time-series classification

Time-series classification (TSC) has attracted a lot of attention in pattern recognition, because wide range of applications from different domains such as finance and health informatics deal with time-series signals. Bag-of-features (BoF) model has achieved a great success in TSC task by summarizing signals according to the frequencies of “feature words” of a data-learned dictionary. This paper proposes embedding the recurrence plots (RP), a visualization technique for analysis of dynamic systems, in the BoF model for TSC. While the traditional BoF approach extracts features from 1D signal segments, this paper uses the RP to transform time-series into 2D texture images and then applies the BoF on them. Image representation of time-series enables us to explore different visual descriptors that are not available for 1D signals and to treat TSC task as a texture recognition problem. Experimental results on the UCI time-series classification archive demonstrates a significant accuracy boost by the proposed bag of recurrence patterns, compared not only to the existing BoF models, but also to the state-of-the art algorithms.

[1]  Simon Malinowski,et al.  Dense Bag-of-Temporal-SIFT-Words for Time Series Classification , 2016, ArXiv.

[2]  Nima Hatami,et al.  Classification of time-series images using deep convolutional neural networks , 2017, International Conference on Machine Vision.

[3]  Laurent Itti,et al.  Classifying Time Series Using Local Descriptors with Hybrid Sampling , 2016, IEEE Transactions on Knowledge and Data Engineering.

[4]  Nima Hatami.  Thinned ECOC Decomposition for Gene Expression Based Cancer Classification , 2008, 2008 Eighth International Conference on Intelligent Systems Design and Applications.

[5]  Yannis Manolopoulos,et al.  Feature-based classification of time-series data , 2001 .

[6]  George C. Runger,et al.  Time series representation and similarity based on local autopatterns , 2016, Data Mining and Knowledge Discovery.

[7]  Karen O. Egiazarian,et al.  Texture Classification Using Dense Micro-Block Difference , 2016, IEEE Transactions on Image Processing.

[8]  Olufemi A. Omitaomu,et al.  Weighted dynamic time warping for time series classification , 2011, Pattern Recognit..

[9]  Saeid Nahavandi,et al.  Bag-of-words representation for biomedical time series classification , 2012, Biomed. Signal Process. Control..

[10]  U. Rajendra Acharya,et al.  Application of Recurrence Quantification Analysis for the Automated Identification of Epileptic EEG Signals , 2011, Int. J. Neural Syst..

[11]  J. Kurths,et al.  Recurrence-plot-based measures of complexity and their application to heart-rate-variability data. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[12]  Tim Oates,et al.  Time Warping Symbolic Aggregation Approximation with Bag-of-Patterns Representation for Time Series Classification , 2014, 2014 13th International Conference on Machine Learning and Applications.

[13]  Camelia Chira,et al.  Classifiers with a reject option for early time-series classification , 2013, 2013 IEEE Symposium on Computational Intelligence and Ensemble Learning (CIEL).

[14]  J. Kurths,et al.  Analytical Description of Recurrence Plots of White Noise and Chaotic Processes , 2003, nlin/0301027.

[15]  Nitin Kumar,et al.  Time-series Bitmaps: a Practical Visualization Tool for Working with Large Time Series Databases , 2005, SDM.

[16]  Stefano Bromuri,et al.  Multi-label classification of chronically ill patients with bag of words and supervised dimensionality reduction algorithms , 2014, J. Biomed. Informatics.

[17]  Camelia Chira,et al.  Error-Correcting Output Codes for Multi-Label Text Categorization , 2012, IIR.

[18]  Eamonn J. Keogh,et al.  Making Time-Series Classification More Accurate Using Learned Constraints , 2004, SDM.

[19]  Yongsheng Dong,et al.  Multiscale Sampling Based Texture Image Classification , 2017, IEEE Signal Processing Letters.

[20]  Juan José Rodríguez Diez,et al.  Interval and dynamic time warping-based decision trees , 2004, SAC '04.

[21]  Jürgen Kurths,et al.  Recurrence plots for the analysis of complex systems , 2009 .

[22]  J. Zbilut,et al.  Embeddings and delays as derived from quantification of recurrence plots , 1992 .

[23]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[24]  Hui Yang,et al.  Multiscale Recurrence Quantification Analysis of Spatial Cardiac Vectorcardiogram Signals , 2011, IEEE Transactions on Biomedical Engineering.

[25]  Xuelong Li,et al.  Texture Classification and Retrieval Using Shearlets and Linear Regression , 2015, IEEE Transactions on Cybernetics.

[26]  Mohand Saïd Allili,et al.  Wavelet Modeling Using Finite Mixtures of Generalized Gaussian Distributions: Application to Texture Discrimination and Retrieval , 2012, IEEE Transactions on Image Processing.

[27]  RungerGeorge,et al.  Time series representation and similarity based on local autopatterns , 2016 .

[28]  Gustavo K. Rohde,et al.  Stochastic analysis of recurrence plots with applications to the detection of deterministic signals , 2008 .

[29]  Zhouyu Fu,et al.  Music classification via the bag-of-features approach , 2011, Pattern Recognit. Lett..

[30]  Pierre Geurts,et al.  Pattern Extraction for Time Series Classification , 2001, PKDD.

[31]  Mi Zhang,et al.  Motion primitive-based human activity recognition using a bag-of-features approach , 2012, IHI '12.

[32]  Eamonn J. Keogh,et al.  On the Need for Time Series Data Mining Benchmarks: A Survey and Empirical Demonstration , 2002, Data Mining and Knowledge Discovery.

[33]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[34]  Patrick Schäfer.  The BOSS is concerned with time series classification in the presence of noise , 2014, Data Mining and Knowledge Discovery.

[35]  Vinícius M. A. de Souza,et al.  Time Series Classification Using Compression Distance of Recurrence Plots , 2013, 2013 IEEE 13th International Conference on Data Mining.

[36]  J. Theiler,et al.  Grammar-guided Feature Extraction for Time Series Classification , 2005 .

[37]  Dah-Jye Lee,et al.  Anytime Classification Using the Nearest Neighbor Algorithm with Applications to Stream Mining , 2006, Sixth International Conference on Data Mining (ICDM'06).

[38]  Yuan Li,et al.  Rotation-invariant similarity in time series using bag-of-patterns representation , 2012, Journal of Intelligent Information Systems.

[39]  Tim Oates,et al.  Pooling SAX-BoP Approaches with Boosting to Classify Multivariate Synchronous Physiological Time Series Data , 2015, FLAIRS.

[40]  Dan Stowell,et al.  Detection and Classification of Acoustic Scenes and Events , 2015, IEEE Transactions on Multimedia.

[41]  Til Aach,et al.  Texture Classification by Modeling Joint Distributions of Local Patterns With Gaussian Mixtures , 2010, IEEE Transactions on Image Processing.

[42]  Romain Tavenard,et al.  Bag-of-Temporal-SIFT-Words for Time Series Classification , 2015, AALTD@PKDD/ECML.

[43]  James Theiler,et al.  Online feature selection for pixel classification , 2005, ICML.

[44]  Nima Hatami,et al.  Some proposals for combining ensemble classifiers , 2012 .

[45]  D. Ruelle,et al.  Recurrence Plots of Dynamical Systems , 1987 .

[46]  Vinícius M. A. de Souza,et al.  Extracting Texture Features for Time Series Classification , 2014, 2014 22nd International Conference on Pattern Recognition.

[47]  Philip S. Yu,et al.  Early prediction on time series: a nearest neighbor approach , 2009, IJCAI 2009.

[48]  Juan José Rodríguez Diez,et al.  Support vector machines of interval-based features for time series classification , 2004, Knowl. Based Syst..

[49]  Nima Hatami,et al.  Thinned-ECOC ensemble based on sequential code shrinking , 2012, Expert Syst. Appl..

[50]  Yihong Gong,et al.  Linear spatial pyramid matching using sparse coding for image classification , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[51]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[52]  Reza Ebrahimpour,et al.  ECOC-based training of neural networks for face recognition , 2008, 2008 IEEE Conference on Cybernetics and Intelligent Systems.

[53]  Lars Schmidt-Thieme,et al.  Scalable Classification of Repetitive Time Series Through Frequencies of Local Polynomials , 2015, IEEE Transactions on Knowledge and Data Engineering.

[54]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[55]  George C. Runger,et al.  A Bag-of-Features Framework to Classify Time Series , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[56]  Sergey Malinchik,et al.  SAX-VSM: Interpretable Time Series Classification Using SAX and Vector Space Model , 2013, 2013 IEEE 13th International Conference on Data Mining.

[57]  P. Herrera,et al.  RECURRENCE QUANTIFICATION ANALYSIS FEATURES FOR AUDITORY SCENE CLASSIFICATION , 2013 .

[58]  Norbert Marwan,et al.  Comment on “Stochastic analysis of recurrence plots with applications to the detection of deterministic signals” by Rohde et al. [Physica D 237 (2008) 619–629] , 2009 .

[59]  Yihong Gong,et al.  Locality-constrained Linear Coding for image classification , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[60]  Hui Yang,et al.  Multiscale recurrence analysis of long-term nonlinear and nonstationary time series , 2012 .