An SVD-based Multimodal Clustering method for Social Event Detection

With the rapid development of social media sites such as Flickr, user-generated multimedia content on the Web has shown an explosive growth in recent years. Social event detection from these large multimedia collections has become one of the hottest topics in analysis of Web content. In this paper, an SVD-based Multimodal Clustering (SVDMC) algorithm is proposed to detect social events from multimodal data. SVDMC is a completely unsupervised approach aiming to take full advantage of the data at hand. Through using the binary adjacency matrix and Singular Value Decomposition (SVD), SVDMC is robust to data incompleteness for datasets in real world. Experiments conducted on the MediaEval Social Event Detection (SED) 2012 dataset demonstrate the effectiveness of the proposed method as well as discriminative power of different features.

[1]  Wolfgang Nejdl,et al.  Bringing order to your photos: event-driven classification of flickr images based on social knowledge , 2010, CIKM.

[2]  Susan T. Dumais,et al.  Using Linear Algebra for Intelligent Information Retrieval , 1995, SIAM Rev..

[3]  D. Sorensen.  IMPLICITLY RESTARTED ARNOLDI/LANCZOS METHODS FOR LARGE SCALE EIGENVALUE CALCULATIONS , 1996 .

[4]  T. Landauer,et al.  Indexing by Latent Semantic Analysis , 1990 .

[5]  Nikos Paragios,et al.  Data fusion through cross-modality metric learning using similarity-sensitive hashing , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[6]  Xiaowei Xu,et al.  SCAN: a structural clustering algorithm for networks , 2007, KDD '07.

[7]  Changsheng Xu,et al.  Social event detection with robust high-order co-clustering , 2013, ICMR.

[8]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[9]  Petros Daras,et al.  Search and Retrieval of Rich Media Objects Supporting Multiple Multimodal Queries , 2012, IEEE Transactions on Multimedia.

[10]  Ishwar K. Sethi,et al.  Multimedia content processing through cross-modal association , 2003, MULTIMEDIA '03.

[11]  Jacob Ratkiewicz,et al.  Detecting and Tracking Political Abuse in Social Media , 2011, ICWSM.

[12]  Yiannis Kompatsiaris,et al.  The 2012 social event detection dataset , 2013, MMSys.

[13]  Joydeep Ghosh,et al.  Cluster Ensembles --- A Knowledge Reuse Framework for Combining Multiple Partitions , 2002, J. Mach. Learn. Res..

[14]  Francesco G. B. De Natale,et al.  The Watershed-based Social Events Detection Method with Support from External Data Sources , 2012, MediaEval.

[15]  Cong Yu,et al.  Dynamic relationship and event discovery , 2011, WSDM '11.

[16]  Irfan A. Essa,et al.  Clustering Social Event Images Using Kernel Canonical Correlation Analysis , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[17]  R. Sinnott.  Virtues of the Haversine , 1984 .

[18]  Jiebo Luo,et al.  The wisdom of social multimedia: using flickr for prediction and forecast , 2010, ACM Multimedia.

[19]  Krithi Ramamritham,et al.  Real Time Discovery of Dense Clusters in Highly Dynamic Graphs: Identifying Real World Events in Highly Dynamic Environments , 2012, Proc. VLDB Endow..

[20]  Christian Breiteneder,et al.  Automated social event detection in large photo collections , 2013, ICMR.

[21]  Michael S. Bernstein,et al.  Twitinfo: aggregating and visualizing microblogs for event exploration , 2011, CHI.

[22]  Benoit Huet,et al.  Heterogeneous features and model selection for event-based media classification , 2013, ICMR.

[23]  Sergei Vassilvitskii,et al.  k-means++: the advantages of careful seeding , 2007, SODA '07.

[24]  James Allan,et al.  Topic detection and tracking: event-based information organization , 2002 .

[25]  Patrick Seemann,et al.  Matrix Factorization Techniques for Recommender Systems , 2014 .

[26]  Nitish Srivastava,et al.  Multimodal learning with deep Boltzmann machines , 2012, J. Mach. Learn. Res..

[27]  Yi Yang,et al.  Ranking with local regression and global alignment for cross media retrieval , 2009, ACM Multimedia.

[28]  Ling Chen,et al.  Event detection from flickr data through wavelet-based spatial analysis , 2009, CIKM.

[29]  Yiannis Kompatsiaris,et al.  Graph-Based Multimodal Clustering for Social Event Detection in Large Collections of Images , 2014, MMM.

[30]  Ebroul Izquierdo,et al.  QMUL @ MediaEval 2012: Social Event Detection in Collaborative Photo Collections , 2012, MediaEval.

[31]  Yiannis Kompatsiaris,et al.  Social Event Detection at MediaEval 2012: Challenges, Dataset and Evaluation , 2012, MediaEval.

[32]  Yiannis Kompatsiaris,et al.  Social event detection using multimodal clustering and integrating supervisory signals , 2012, ICMR.

[33]  Hong Zhang,et al.  Measuring Multi-modality Similarities Via Subspace Learning for Cross-Media Retrieval , 2006, PCM.

[34]  Feiping Nie,et al.  Heterogeneous image feature integration via multi-modal spectral clustering , 2011, CVPR 2011.

[35]  Laks V. S. Lakshmanan,et al.  Incremental cluster evolution tracking from highly dynamic network data , 2014, 2014 IEEE 30th International Conference on Data Engineering.

[36]  Trevor Darrell,et al.  Factorized Latent Spaces with Structured Sparsity , 2010, NIPS.

[37]  Roger Levy,et al.  A new approach to cross-modal multimedia retrieval , 2010, ACM Multimedia.

[38]  Yutaka Matsuo,et al.  Earthquake shakes Twitter users: real-time event detection by social sensors , 2010, WWW '10.

[39]  Mohan S. Kankanhalli,et al.  Multimodal fusion for multimedia analysis: a survey , 2010, Multimedia Systems.