Towards Burst Detection for Non-Stationary Stream Data

Detecting bursts in data streams is an important and challenging task, especially in stock market, traffic control or sensor network streams. Burst detection means the identification of non regular behavior within data streams. A specifically crucial challenge on burst detection is to identify bursts in the case of non-stationary data. One approach is to apply thresholds to discover such bursts. In this paper, we propose a new approach to dynamically identify suitable thresholds using techniques known from time series forecasting. We present fundamentals and discuss requirements for threshold-based burst detection on stream data containing arbitrary trends and periods.

[1]  Christos Faloutsos,et al.  Data mining meets performance evaluation: fast algorithms for modeling bursty traffic , 2002, Proceedings 18th International Conference on Data Engineering.

[2]  Kenji Yamanishi,et al.  A unifying framework for detecting outliers and change points from non-stationary time series data , 2002, KDD.

[3]  Dimitrios Gunopulos,et al.  Identifying similarities, periodicities and bursts for online search queries , 2004, SIGMOD '04.

[4]  Chris Chatfield,et al.  Holt‐Winters Forecasting: Some Practical Issues , 1988 .

[5]  Eamonn J. Keogh,et al.  Finding surprising patterns in a time series database in linear time and space , 2002, KDD.

[6]  Dirk Habich,et al.  Analyzing Data Streams by Online DFT , 2006 .

[7]  D. Marquardt An Algorithm for Least-Squares Estimation of Nonlinear Parameters , 1963 .

[8]  Dennis Shasha,et al.  High Performance Discovery In Time Series: Techniques And Case Studies (Monographs in Computer Science) , 2004 .

[9]  Funda Ergün,et al.  Sublinear Methods for Detecting Periodic Trends in Data Streams , 2004, LATIN.

[10]  Cyrus Shahabi,et al.  TSA-tree: a wavelet-based approach to improve the efficiency of multi-level surprise and trend queries on time-series data , 2000, Proceedings. 12th International Conference on Scientific and Statistica Database Management.

[11]  Xin Zhang,et al.  Better Burst Detection , 2006, 22nd International Conference on Data Engineering (ICDE'06).

[12]  Christos Faloutsos,et al.  AWSOM: Adaptive, Hands-Off Stream Mining , 2003 .