Finding "interesting" trends in social networks using frequent pattern mining and self organizing maps

This paper introduces a technique that uses frequent pattern mining and SOM techniques to identify, group and analyse trends in sequences of time stamped social networks so as to identify ''interesting'' trends. In this study, trends are defined in terms of a series of occurrence counts associated with frequent patterns that may be identified within social networks. Typically a large number of frequent patterns, and by extension a large number of trends, are discovered. Thus, to assist with the analysis of the discovered trends, the use of SOM techniques is advocated so that similar trends can be grouped together. To identify ''interesting'' trends a sequences of SOMs are generated which can be interpreted by considering how trends move from one SOM to the next. The further a trend moves from one SOM to the next, the more ''interesting'' the trend is deemed to be. The study is focused two types of network, Star networks and Complex star networks, exemplified by two real applications: the Cattle Tracing System in operation in Great Britain and a car insurance quotation application.

[1]  Jawad Raza,et al.  An integrated qualitative trend analysis approach to identify process abnormalities: A case of oil export pumps in an offshore oil and gas production facility , 2009 .

[2]  Ee-Peng Lim,et al.  Social Network Discovery by Mining Spatio-Temporal Events , 2005, Comput. Math. Organ. Theory.

[3]  Munmun De Choudhury,et al.  Can blog communication dynamics be correlated with stock market activity? , 2008, Hypertext.

[4]  Stanley Wasserman,et al.  Social Network Analysis: Methods and Applications , 1994, Structural analysis in the social sciences.

[5]  Matthew Richardson,et al.  Mining knowledge-sharing sites for viral marketing , 2002, KDD.

[6]  Frans Coenen,et al.  Computing Association Rules Using Partial Totals , 2001, PKDD.

[7]  Olga Streibel,et al.  Trend Mining with Semantic-Based Learning , 2008 .

[8]  M. V. Velzen,et al.  Self-organizing maps , 2007 .

[9]  Miltos Petridis,et al.  Research and Development in Intelligent Systems XXVI, Incorporating Applications and Innovations in Intelligent Systems XVII, Peterhouse College, Cambridge, UK, 15-17 December 2009 , 2010, SGAI Conferences.

[10]  Syed Sibte Raza Abidi,et al.  Analyzing Sub-Classifications of Glaucoma via SOM Based Clustering of Optic Nerve Images , 2005, MIE.

[11]  Ramakrishnan Srikant,et al.  Mining sequential patterns , 1995, Proceedings of the Eleventh International Conference on Data Engineering.

[12]  Pawan Lingras,et al.  Temporal Cluster Migration Matrices for Web Usage Mining , 2004, IEEE/WIC/ACM International Conference on Web Intelligence (WI'04).

[13]  Hisashi Kashima,et al.  Unsupervised Change Analysis Using Supervised Learning , 2008, PAKDD.

[14]  Jinyan Li,et al.  Efficient mining of emerging patterns: discovering trends and differences , 1999, KDD '99.

[15]  Detlef Schoder,et al.  Web Science 2.0: Identifying Trends through Semantic Social Network Analysis , 2008, 2009 International Conference on Computational Science and Engineering.

[16]  Arash Ghanbari,et al.  Integration of genetic fuzzy systems and artificial neural networks for stock price forecasting , 2010, Knowl. Based Syst..

[17]  Jesús Bobadilla,et al.  A new collaborative filtering metric that improves the behavior of recommender systems , 2010, Knowl. Based Syst..

[18]  Junbai Wang,et al.  Clustering of the SOM easily reveals distinct gene expression patterns: results of a reanalysis of lymphoma study , 2002, BMC Bioinformatics.

[19]  Tomasz Imielinski,et al.  Mining association rules between sets of items in large databases , 1993, SIGMOD Conference.

[20]  Erkki Oja,et al.  Engineering applications of the self-organizing map , 1996, Proc. IEEE.

[21]  Graham J. Williams,et al.  ReDSOM: Relative Density Visualization of Temporal Changes in Cluster Structures Using Self-Organizing Maps , 2008, 2008 Eighth IEEE International Conference on Data Mining.

[22]  Heikki Mannila,et al.  Discovery of Frequent Episodes in Event Sequences , 1997, Data Mining and Knowledge Discovery.

[23]  M. Sulaiman Khan,et al.  A sliding windows based dual support framework for discovering emerging trends from temporal data , 2010, Knowl. Based Syst..

[24]  Freimut Bodendorf,et al.  Warning system for online market research - Identifying critical situations in online opinion formation , 2011, Knowl. Based Syst..

[25]  Patrick Rousset,et al.  The Kohonen Algorithm: A Powerful Tool for Analyzing and Representing Multidimensional Quantitative and Qualitative Data , 1997, IWANN.

[26]  Sung Jin Hur,et al.  Improved trust-aware recommender system using small-worldness of trust networks , 2010, Knowl. Based Syst..

[27]  V. P. Subramanyam Rallabandi,et al.  Knowledge-based image retrieval system , 2008, Knowl. Based Syst..

[28]  Teuvo Kohonen,et al.  The self-organizing map , 1990, Neurocomputing.