Temporal representation learning for time series classification

Recent years have witnessed the exponential growth of time series data as the popularity of sensing devices and development of IoT techniques; time series classification has been considered as one of the most challenging studies in time series data mining, attracting great interest over the last two decades. According to the empirical evidences, temporal representation learning-based time series classification has more superiority of accuracy, efficiency and interpretability as compared to hundreds of existing time series classification methods. However, due to the high time complexity of feature process, the performance of these methods has been severely restricted. In this paper, we first presented an efficient shapelet transformation method to improve the overall efficiency of time series classification, and then, we further developed a novel enhanced recurrent neural network model for deep representation learning to further improve the classification accuracy. Experimental results on typical real-world datasets have justified the superiority of our models over several shallow and deep representation learning competitors.

[1]  Xueqing Li,et al.  A Continuous Segmentation Algorithm for Streaming Time Series , 2016, CollaborateCom.

[2]  Jingjing Li,et al.  Robust Structured Graph Clustering , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[3]  Lars Schmidt-Thieme,et al.  Learning time-series shapelets , 2014, KDD.

[4]  Richang Hong,et al.  Augmented Collaborative Filtering for Sparseness Reduction in Personalized POI Recommendation , 2017, ACM Trans. Intell. Syst. Technol..

[5]  Mohan S. Kankanhalli,et al.  MMALFM , 2018, ACM Trans. Inf. Syst..

[6]  Calton Pu,et al.  Collaborative Computing: Networking, Applications and Worksharing , 2009 .

[7]  Jason Lines,et al.  Time-Series Classification with COTE: The Collective of Transformation-Based Ensembles , 2015, IEEE Trans. Knowl. Data Eng..

[8]  Jason Lines,et al.  A shapelet transform for time series classification , 2012, KDD.

[9]  Jason Lines,et al.  Classification of time series by shapelet transformation , 2013, Data Mining and Knowledge Discovery.

[10]  Panagiotis Papapetrou,et al.  Generalized random shapelet forests , 2016, Data Mining and Knowledge Discovery.

[11]  Ke Lu,et al.  Transfer Independently Together: A Generalized Framework for Domain Adaptation , 2019, IEEE Transactions on Cybernetics.

[12]  Cun Ji,et al.  A novel multi-resolution representation for time series sensor data analysis , 2020, Soft Comput..

[13]  Jason Lines,et al.  Time-Series Classification with COTE: The Collective of Transformation-Based Ensembles , 2015, IEEE Transactions on Knowledge and Data Engineering.

[14]  Lina Yao,et al.  Unveiling Correlations via Mining Human-Thing Interactions in the Web of Things , 2017, ACM Trans. Intell. Syst. Technol..

[15]  Eamonn J. Keogh,et al.  Logical-shapelets: an expressive primitive for time series classification , 2011, KDD.

[16]  Chaoran Cui,et al.  Improving image annotation via ranking‐oriented neighbor search and learning‐based keyword propagation , 2014, J. Assoc. Inf. Sci. Technol..

[17]  Jingjing Li,et al.  Discrete Optimal Graph Clustering , 2019, IEEE Transactions on Cybernetics.

[18]  Shijun Liu,et al.  A fast shapelet selection algorithm for time series classification , 2019, Comput. Networks.

[19]  Lars Schmidt-Thieme,et al.  Fast classification of univariate and multivariate time series through shapelet discovery , 2016, Knowledge and Information Systems.

[20]  Tim Oates,et al.  Time series classification from scratch with deep neural networks: A strong baseline , 2016, 2017 International Joint Conference on Neural Networks (IJCNN).

[21]  Eamonn J. Keogh,et al.  The great time series classification bake off: a review and experimental evaluation of recent algorithmic advances , 2016, Data Mining and Knowledge Discovery.

[22]  Zhang Qi,et al.  Edge Computing Application: Real-Time Anomaly Detection Algorithm for Sensing Data , 2018 .

[23]  Yilong Yin,et al.  Distribution-Oriented Aesthetics Assessment With Semantic-Aware Hybrid Network , 2019, IEEE Transactions on Multimedia.

[24]  Eamonn J. Keogh,et al.  Time series shapelets: a novel technique that allows accurate, interpretable and fast classification , 2010, Data Mining and Knowledge Discovery.

[25]  Eamonn J. Keogh,et al.  Time series shapelets: a new primitive for data mining , 2009, KDD.

[26]  Xueqing Li,et al.  A K-Motifs Discovery Approach for Large Time-Series Data Analysis , 2016, APWeb.

[27]  George C. Runger,et al.  GCRNN: Group-Constrained Convolutional Recurrent Neural Network , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[28]  Houshang Darabi,et al.  Insights Into LSTM Fully Convolutional Networks for Time Series Classification , 2019, IEEE Access.

[29]  Wei Luo,et al.  Multi-resolution representation with recurrent neural networks application for streaming time series in IoT , 2019, Comput. Networks.

[30]  Jason Lines,et al.  HIVE-COTE: The Hierarchical Vote Collective of Transformation-Based Ensembles for Time Series Classification , 2016, 2016 IEEE 16th International Conference on Data Mining (ICDM).

[31]  Lars Schmidt-Thieme,et al.  Learning DTW-Shapelets for Time-Series Classification , 2016, CODS.

[32]  Ke Lu,et al.  Heterogeneous Domain Adaptation Through Progressive Alignment , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[33]  Eamonn J. Keogh,et al.  Fast Shapelets: A Scalable Algorithm for Discovering Time Series Shapelets , 2013, SDM.

[34]  Maria Rifqi,et al.  Random-shapelet: An algorithm for fast shapelet discovery , 2015, 2015 IEEE International Conference on Data Science and Advanced Analytics (DSAA).

[35]  Fuzhen Zhuang,et al.  Fast Time Series Classification Based on Infrequent Shapelets , 2012, 2012 11th International Conference on Machine Learning and Applications.

[36]  Xueqing Li,et al.  A Novel Segmentation and Representation Approach for Streaming Time Series , 2019, IEEE Access.

[37]  Lior Rokach,et al.  Fast and space-efficient shapelets-based time-series classification , 2015, Intell. Data Anal..