Real-time event detection for online behavioral analysis of big social data

Abstract Social networking services are becoming increasingly popular during the daily lives of Internet citizens, especially since the advent of smart mobile devices with integrated utility modules such as 4G/WIFI connectivity, global positioning services, cameras, and heart beat sensors. Many devices are available for sharing information at any time, which can be listed by posting a photo, sharing a status, or narrating an event. The behavior of users means that the flow of data (or a social data stream) has real-time characteristics, which actually comprise notifications about your friends’ posts after a short delay for diffusion over the network. The data stream contains news pieces related to real social facts as well as unfocused information. In addition, important information (or events) attracts more public attention, which is demonstrated by the number of relevant messages or communication interactions between people interested in specific topics. From a technical perspective, the characteristics of data in the aforementioned scenario provide us with an opportunity to construct a model that can automatically determine the occurrence of events based on a social data stream. In this study, we propose an approach to solve the problem of early event identification, which requires appropriate approaches for processing incoming data in terms of the processing performance and number of data.

[1]  Hans-Peter Kriegel,et al.  OPTICS: ordering points to identify the clustering structure , 1999, SIGMOD '99.

[2]  David A. Shamma,et al.  Peaks and persistence: modeling the shape of microblog conversations , 2011, CSCW '11.

[3]  Jason J. Jung Ubiquitous conference management system for mobile recommendation services based on mobilizing social networks: A case study of u-conference , 2011, Expert Syst. Appl..

[4]  Yiannis Kompatsiaris,et al.  Sensing Trending Topics in Twitter , 2013, IEEE Transactions on Multimedia.

[5]  Jason J. Jung,et al.  Real-time Event Detection on Social Data Stream , 2014, Mobile Networks and Applications.

[6]  T. Murata,et al.  Breaking News Detection and Tracking in Twitter , 2010, 2010 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology.

[7]  Gobinda G. Chowdhury,et al.  Introduction to Modern Information Retrieval , 1999 .

[8]  Bu-Sung Lee,et al.  Event Detection in Twitter , 2011, ICWSM.

[9]  Hanan Samet,et al.  TwitterStand: news in tweets , 2009, GIS.

[10]  Hila Becker,et al.  Beyond Trending Topics: Real-World Event Identification on Twitter , 2011, ICWSM.

[11]  Brendan T. O'Connor,et al.  TweetMotif: Exploratory Search and Topic Summarization for Twitter , 2010, ICWSM.

[12]  Jeffrey Nichols,et al.  Home Location Identification of Twitter Users , 2014, TIST.

[13]  Rui Li,et al.  TEDAS: A Twitter-based Event Detection and Analysis System , 2012, 2012 IEEE 28th International Conference on Data Engineering.

[14]  Yutaka Matsuo,et al.  Earthquake shakes Twitter users: real-time event detection by social sensors , 2010, WWW '10.

[15]  Miles Osborne,et al.  Streaming First Story Detection with application to Twitter , 2010, NAACL.

[16]  Jure Leskovec,et al.  Patterns of temporal variation in online media , 2011, WSDM '11.

[17]  John G. Proakis,et al.  Digital Signal Processing: Principles, Algorithms, and Applications , 1992 .

[18]  Tom White,et al.  Hadoop: The Definitive Guide , 2009 .

[19]  Ee-Peng Lim,et al.  Analyzing feature trajectories for event detection , 2007, SIGIR.