Automatic mobile photo tagging using context

The market of smartphones has been exploding, and taking pictures is a basic, maybe one of the most important functions of a smartphone. In this paper we address the problem of managing a large amount of mobile photos by automatically tagging the photos, so they can be easily browsed or searched later. Unlike other content-based photo tagging approaches, this paper's main contribution is to explore an alternative opportunity of automatic photo tagging using contextual information. Both clustering and similarity-based approaches were studied for photo tagging using context such as date, time, location, environment noise, and human faces. The results show that there are intrinsic connections between contextual information and photo tags, and similarity-based approach outperforms clustering-based tagging significantly.

[1]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[2]  Marc Davis,et al.  Metadata creation system for mobile images , 2004, MobiSys '04.

[3]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Mor Naaman,et al.  Leveraging context to resolve identity in photo albums , 2005, Proceedings of the 5th ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL '05).

[5]  James Ze Wang,et al.  Image retrieval: Ideas, influences, and trends of the new age , 2008, CSUR.

[6]  Chuan Qin,et al.  TagSense: a smartphone-based approach to automatic image tagging , 2011, MobiSys '11.

[7]  Gustavo Carneiro,et al.  Supervised Learning of Semantic Classes for Image Annotation and Retrieval , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Simon King,et al.  From context to content: leveraging context to infer media metadata , 2004, MULTIMEDIA '04.