PhotoSense: emergent semantics based approach to image annotation

Tagging of images using descriptive keywords (tags), contributed by ordinary users, is a powerful way of organizing them. However, due to the richness of the image content, it is often difficult to choose tags that best describe the content of the image to the viewing audience and ensure access to the image. In this paper, we present a novel tagging framework based on the theory of emergent semantics to assist the user in the tag selection process. Our idea is to enrich the current "looking at" experience of tagging with the "looking for" experience of searching. We describe the design of our approach along with a preliminary user study conducted with a prototype Flickr application.

[1]  Laura A. Dabbish,et al.  Labeling images with a computer game , 2004, AAAI Spring Symposium: Knowledge Collection from Volunteer Contributors.

[2]  Simone Santini,et al.  Emergent Semantics through Interaction in Image Databases , 2001, IEEE Trans. Knowl. Data Eng..

[3]  Mor Naaman,et al.  Why we tag: motivations for annotation in mobile and online media , 2007, CHI.

[4]  Lizabeth Barclay,et al.  Tagging: People-Powered Metadata for the Social Web (Smith, G.; 2008) [Book Review] , 2009, IEEE Transactions on Professional Communication.

[5]  Nenghai Yu,et al.  Learning to tag , 2009, WWW '09.

[6]  Roelof van Zwol,et al.  Flickr tag recommendation based on collective knowledge , 2008, WWW.