Microblog bursty feature detection based on dynamics model

Microblog is becoming more and more popular in our life. Due to the numerous information on this platform, it is very useful to detect bursty topic in real-time to help people get essential information quickly. As a necessary stage, detecting busty feature effectively is important for bursty topic detection. Based on dynamics model, we propose a new microblog bursty feature detection method. Firstly, we compute term weight taking account of both term frequency and tweet weight, where tweet weight factors include retweet number, comments number and time fading factor. After computing all terms' weight, a bursty feature detection method is proposed based on dynamics model. On the analogy of physical dynamics model, we compute each term's momentum by using MACD (Moving Average Convergence/Divergence) and determine whether it is a bursty feature in a given time interval. We employ our method to detect the bursty terms of Sina tweets with a series of experiments. It is demonstrated that our method is able to detect bursts for news terms accurately and efficiently.

[1]  D. Stott Parker,et al.  Topic dynamics: an alternative model of bursts in streams of topics , 2010, KDD.

[2]  Hector Garcia-Molina,et al.  Overview of multidatabase transaction management , 2005, The VLDB Journal.

[3]  Yi Wang,et al.  Detecting Lasting and Abrupt Bursts in Data Streams Using Two-Layered Wavelet Tree , 2006, Advanced Int'l Conference on Telecommunications and Int'l Conference on Internet and Web Applications and Services (AICT-ICIW'06).

[4]  Ming-Syan Chen,et al.  LIPED: HMM-based life profiles for adaptive event detection , 2005, KDD '05.

[5]  Chien Chin Chen,et al.  An Aging Theory for Event Life-Cycle Modeling , 2007, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[6]  J. Murphy Technical Analysis of the Financial Markets , 1999 .

[7]  Philip S. Yu,et al.  Parameter Free Bursty Events Detection in Text Streams , 2005, VLDB.

[8]  Christos Faloutsos,et al.  Data mining meets performance evaluation: fast algorithms for modeling bursty traffic , 2002, Proceedings 18th International Conference on Data Engineering.

[9]  Aoying Zhou,et al.  Adaptively Detecting Aggregation Bursts in Data Streams , 2005, DASFAA.

[10]  Dennis Shasha,et al.  Efficient elastic burst detection in data streams , 2003, KDD '03.

[11]  Han Ren,et al.  Semi-automatic Hot Event Detection , 2006, ADMA.

[12]  Qian Weining,et al.  Fractal-Based Algorithms for Burst Detection over Data Streams , 2006 .

[13]  A. L. Narasimha Reddy,et al.  Real-time detection and containment of network attacks using QoS regulation , 2005, IEEE International Conference on Communications, 2005. ICC 2005. 2005.

[14]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..