Temporal awareness of changes in afflicted people's needs after East Japan Great Earthquake

This paper proposes a time series topic detection method to investigate changes in afflicted people's needs after the East Japan Great Earthquake using latent semantic analysis and singular vectors' pattern similarities. Our target data is a blog about afflicted people's needs provided by a non-profit organization in Tohoku, Japan. The method crawls blog messages, extracts terms, and forms document-term matrix over time. Then, it adopts the latent semantic analysis to extract people's needs as hidden topics from each snapshot matrix. We form time series hidden topic-term matrix as 3rd order tensor, so that changes in topics (people's needs) are detected by investigating time-series similarities between hidden topics. In this paper, to show the effectiveness of our proposed method, we also provide the experimental results.

[1]  Evgeniy Gabrilovich,et al.  A word at a time: computing word relatedness using temporal semantic analysis , 2011, WWW.

[2]  Hongyuan Zha,et al.  Discovering Temporal Communities from Social Network Documents , 2007, Seventh IEEE International Conference on Data Mining (ICDM 2007).

[3]  Bernardo A. Huberman,et al.  Trends in Social Media: Persistence and Decay , 2011, ICWSM.

[4]  P. Jaccard.  THE DISTRIBUTION OF THE FLORA IN THE ALPINE ZONE.1 , 1912 .

[5]  Susan T. Dumais,et al.  The latent semantic analysis theory of knowledge , 1997 .

[6]  M E J Newman,et al.  Modularity and community structure in networks. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[7]  Guangwei Wang,et al.  A Graphic Reputation Analysis System for Mining Japanese Weblog Based on both Unstructured and Structured Information , 2008, 22nd International Conference on Advanced Information Networking and Applications - Workshops (aina workshops 2008).

[8]  Derek Greene,et al.  Tracking the Evolution of Communities in Dynamic Social Networks , 2010, 2010 International Conference on Advances in Social Networks Analysis and Mining.

[9]  Andrzej Cichocki,et al.  Nonnegative Matrix and Tensor Factorization T , 2007 .

[10]  Changjie Tang,et al.  Discovering Organizational Structure in Dynamic Social Network , 2009, 2009 Ninth IEEE International Conference on Data Mining.

[11]  Basabi Chakraborty,et al.  Discovering Topic Transition about the East Japan Great Earthquake in Dynamic Social Media , 2012, 2012 IEEE Global Humanitarian Technology Conference.

[12]  Richard Sproat,et al.  Mining correlated bursty topic patterns from coordinated text streams , 2007, KDD '07.