STenSr: Spatio-temporal tensor streams for anomaly detection and pattern discovery

The focus of this paper is anomaly detection and pattern discovery in spatio-temporal tensor streams. As an example, sensor networks comprising of multiple individual sensor streams generate spatio-temporal data, which can be captured in tensor streams. Anomaly detection in such data is considered challenging because of the potential complexity and high order of the tensor data from spatio-temporal sources such as sensor networks. In this paper, we propose an innovative approach for anomaly detection and pattern discovery in such tensor streams. We model the tensor stream itself as a single incremental tensor, for example representing the entire sensor network, instead of dealing with each individual tensor in the stream separately. Such a model provides a global view of the tensor stream and enables subsequent in-depth analysis of it. The proposed approach is designed for online analysis of tensor streams with fast runtime. We evaluate our approach for detecting anomalies under different conditions and for identifying complex data patterns. We also compare the proposed approach with the existing tensor stream analysis method (Sun et al. in ACM Trans Knowl Discov Data 2, 2008). Our evaluation uses synthetic data as well as real-world data showing the efficiency and effectiveness of the proposed approach.

[1]  Amnon Shashua,et al.  Linear image coding for regression and classification using the tensor-rank principle , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[2]  Joos Vandewalle,et al.  A Multilinear Singular Value Decomposition , 2000, SIAM J. Matrix Anal. Appl..

[3]  L. Tucker,et al.  Some mathematical notes on three-mode factor analysis , 1966, Psychometrika.

[4]  Hongyuan Zha,et al.  On Updating Problems in Latent Semantic Indexing , 1997, SIAM J. Sci. Comput..

[5]  Tamara G. Kolda,et al.  Higher-order Web link analysis using multilinear algebra , 2005, Fifth IEEE International Conference on Data Mining (ICDM'05).

[6]  Philip S. Yu,et al.  Incremental tensor analysis: Theory and applications , 2008, TKDD.

[7]  Tamara G. Kolda,et al.  Tensor Decompositions and Applications , 2009, SIAM Rev..

[8]  Jimeng Sun,et al.  Streaming Pattern Discovery in Multiple Time-Series , 2005, VLDB.

[9]  Charu C. Aggarwal,et al.  On Abnormality Detection in Spuriously Populated Data Streams , 2005, SDM.

[10]  Chris H. Q. Ding,et al.  Simultaneous tensor subspace selection and clustering: the equivalence of high order svd and k-means clustering , 2008, KDD.

[11]  Anukool Lakhina,et al.  Multivariate Online Anomaly Detection Using Kernel Recursive Least Squares , 2007, IEEE INFOCOM 2007 - 26th IEEE International Conference on Computer Communications.

[12]  Vijayalakshmi Atluri,et al.  Spatial neighborhood based anomaly detection in sensor datasets , 2009, Data Mining and Knowledge Discovery.

[13]  Tamara G. Kolda,et al.  Temporal Analysis of Semantic Graphs Using ASALSAN , 2007, Seventh IEEE International Conference on Data Mining (ICDM 2007).

[14]  Demetri Terzopoulos,et al.  Multilinear image analysis for facial recognition , 2002, Object recognition supported by user interaction for service robots.

[15]  S. Muthukrishnan,et al.  Data streams: algorithms and applications , 2005, SODA '03.

[16]  Aleksandar Lazarevic,et al.  Incremental Local Outlier Detection for Data Streams , 2007, 2007 IEEE Symposium on Computational Intelligence and Data Mining.

[17]  Tamara G. Kolda,et al.  Cross-language information retrieval using PARAFAC2 , 2007, KDD '07.

[18]  Jennifer Widom,et al.  Models and issues in data stream systems , 2002, PODS.

[19]  Svetha Venkatesh,et al.  Effective Anomaly Detection in Sensor Networks Data Streams , 2009, 2009 Ninth IEEE International Conference on Data Mining.

[20]  T. Landauer,et al.  Indexing by Latent Semantic Analysis , 1990 .

[21]  Aryya Gangopadhyay,et al.  Temporal Neighborhood Discovery Using Markov Models , 2009, 2009 Ninth IEEE International Conference on Data Mining.

[22]  Narendra Ahuja,et al.  Facial expression decomposition , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[23]  Philip S. Yu,et al.  Window-based Tensor Analysis on High-dimensional and Multi-aspect Streams , 2006, Sixth International Conference on Data Mining (ICDM'06).