Connecting people in photo-sharing sites by photo content and user annotations

Popular photo-sharing sites have attracted millions of people and helped construct massive social networks in Cyberspace. Different from traditional social relationships, users actively interact in groups where common interests are shared on certain types of events or topics captured by photos and videos. Contributing images to an interest group would greatly promote interactions between users and expand their social networks. In this work, we intend to produce automatic recommendations of a user's images to suitable photo-sharing groups. To this end, we begin with analyzing user annotations and modeling the shared images in a group. Both visual content and annotation context are then integrated to understand the events or topics depicted in those images. Experiments on over 14000 user images demonstrate the feasibility of the proposed approach.

[1]  Mor Naaman,et al.  Why we tag: motivations for annotation in mobile and online media , 2007, CHI.

[2]  Antonio Torralba,et al.  Modeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope , 2001, International Journal of Computer Vision.

[3]  Daniel Gatica-Perez,et al.  Analyzing Flickr groups , 2008, CIVR '08.

[4]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..

[5]  Antonio Torralba,et al.  Object and scene recognition in tiny images , 2010 .

[6]  Ja-Ling Wu,et al.  SheepDog: group and tag recommendation for flickr photos by automatic search-based learning , 2008, ACM Multimedia.

[7]  Mark Steyvers,et al.  Finding scientific topics , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[8]  Thomas Hofmann,et al.  Probabilistic latent semantic indexing , 1999, SIGIR '99.

[9]  R. Fergus,et al.  Tiny images , 2007 .