Analysing Facebook features to support event detection for photo-based Facebook applications

Facebook witnesses an explosion of the number of shared photos: With 100 million photo uploads a day it creates as much as a whole Flickr each two months in terms of volume. Facebook has also one of the healthiest platforms to support third party applications, many of which deal with photos and related events. While it is essential for many Facebook applications, until now there is no easy way to detect and link photos that are related to the same events, which are usually distributed between friends and albums. In this work, we introduce an approach that exploits Facebook features to link photos related to the same event. In the current situation where the EXIF header of photos is missing in Facebook, we extract visual-based, tagged areas-based, friendship-based and structure-based features. We evaluate each of these features and use the results in our approach. We introduce and evaluate a semi-supervised probabilistic approach that takes into account the evaluation of these features. In this approach we create a lookup table of the initialization values of our model variables and make it available for other Facebook applications or researchers to use. The evaluation of our approach showed promising results and it outperformed the other the baseline method of using the unsupervised EM algorithm in estimating the parameters of a Gaussian mixture model. We also give two examples of the applicability of this approach to help Facebook applications in better serving the user.

[1]  Alexander C. Loui,et al.  Using Genetic Algorithms for Album Page Layouts , 2003, IEEE Multim..

[2]  Susanne Boll,et al.  Automatic creation of photo books from stories in social media , 2011, TOMCCAP.

[3]  Luc Van Gool,et al.  World-scale mining of objects and events from community photo collections , 2008, CIVR '08.

[4]  Lexing Xie,et al.  Modeling personal and social network context for event annotation in images , 2007, JCDL '07.

[5]  J.E. Gentile,et al.  Profile Face Detection: A Subset Multi-Biometric Approach , 2008, 2008 IEEE Second International Conference on Biometrics: Theory, Applications and Systems.

[6]  Yiannis Kompatsiaris,et al.  A Joint Content-Event Model for Event-Centric Multimedia Indexing , 2010, 2010 IEEE Fourth International Conference on Semantic Computing.

[7]  Nozha Boujemaa,et al.  Large scale visual-based event matching , 2011, ICMR.

[8]  Mingjing Li,et al.  Automated annotation of human faces in family albums , 2003, MULTIMEDIA '03.

[9]  Raphaël Troncy,et al.  Finding media illustrating events , 2011, ICMR '11.

[10]  Daniel Gatica-Perez,et al.  Analyzing Flickr groups , 2008, CIVR '08.

[11]  Minglun Gong,et al.  Organizing and browsing photos using different feature vectors and their evaluations , 2009, CIVR '09.

[12]  Ramesh Jain,et al.  Toward a Common Event Model for Multimedia Applications , 2007, IEEE MultiMedia.

[13]  Bernard Mérialdo,et al.  Saliency moments for image categorization , 2011, ICMR.

[14]  Raphaël Troncy,et al.  Linking events with media , 2010, I-SEMANTICS '10.

[15]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[16]  Susanne Boll,et al.  Large scale flexible event-based clustering from photos in social media , 2011, ICIMCS '11.

[17]  Mary Czerwinski,et al.  PhotoTOC: automatic clustering for browsing personal photographs , 2003, Fourth International Conference on Information, Communications and Signal Processing, 2003 and the Fourth Pacific Rim Conference on Multimedia. Proceedings of the 2003 Joint.

[18]  J. C. Platt.  AutoAlbum: clustering digital photographs using probabilistic model merging , 2000, 2000 Proceedings Workshop on Content-based Access of Image and Video Libraries.

[19]  Tao Mei,et al.  Probabilistic Multimodality Fusion for Event based Home Photo Clustering , 2006, 2006 IEEE International Conference on Multimedia and Expo.