HMM-based state prediction for Internet hot topic

In this paper, we build an on-line topic detection and state prediction system, which can automatically collect Internet web pages, cluster them into topics, and predict the hot topics' states. A HMM-based prediction model is proposed to predict the Internet hot topic's state, and the prediction method is testified in an actual network environment. In this system, we train the observations of the topics by the hidden Markov model and save the models in a HMM library for the topic's prediction. Topics with similar life cycle are recorded and share a same model. Experimental results are shown.

[1]  Xu Jungang,et al.  IPOMS: an Internet Public Opinion Monitoring System , 2009, 2009 Second International Conference on the Applications of Digital Information and Web Technologies.

[2]  Hong Liu,et al.  Internet Public Opinion Hotspot Detection and Analysis Based on Kmeans and SVM Algorithm , 2010, 2010 International Conference of Information Science and Management Engineering.

[3]  Yiming Yang,et al.  Learning approaches for detecting and tracking news events , 1999, IEEE Intell. Syst..

[4]  Jianping Zeng,et al.  Predictive Model for Internet Public Opinion , 2007, Fourth International Conference on Fuzzy Systems and Knowledge Discovery (FSKD 2007).

[5]  Yiming Yang,et al.  Topic Detection and Tracking Pilot Study Final Report , 1998 .

[6]  Bin Xu,et al.  Quick tendency forecast on Internet public opinions , 2010, 2010 Seventh International Conference on Fuzzy Systems and Knowledge Discovery.

[7]  James Allan,et al.  On-Line New Event Detection and Tracking , 1998, SIGIR.

[8]  Hengqing Tong,et al.  Internet Users' Psychosocial Attention Prediction: Web Hot Topic Prediction Based on Adaptive AR Model , 2008, 2008 International Conference on Computer Science and Information Technology.

[9]  Kuo Zhang,et al.  New event detection based on indexing-tree and named entity , 2007, SIGIR.

[10]  Linfeng Wei,et al.  Research and Design of Internet Public Opinion Analysis System , 2009, 2009 IITA International Conference on Services Science, Management and Engineering.

[11]  Ming-Syan Chen,et al.  LIPED: HMM-based life profiles for adaptive event detection , 2005, KDD '05.

[12]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.