Combining Context and Content for Automatic Image Annotation on Mobile Phones

Nowadays, the explosive use of mobile phones leads to generate a large number of personal photos. The requirements of effective image retrieval becomes evident. In this paper, we overview image retrieval techniques with special emphasis on different works that consider automatic image annotation as solution to retrieve images in mobile environment. In most automatic image annotation systems, the high-level concepts are generated based, exclusively, on visual analysis or context analysis of the image. Emerging approaches consider that the fusion of content and context analysis is beneficial for automatic image annotation. We focus in this paper on the type of information, visual and contextual, used to generate semantic that describes the image and the new methods that combine both content and context for automatic image annotation.

[1]  Mor Naaman,et al.  Why we tag: motivations for annotation in mobile and online media , 2007, CHI.

[2]  A. Sbihi.  MIR system for mobile information retrieval by image querying , 2008 .

[3]  Moncef Gabbouj,et al.  A generic content-based image retrieval framework for mobile devices , 2010, Multimedia Tools and Applications.

[4]  Jérôme Gensel,et al.  Towards the semantic and context-aware management of mobile multimedia , 2010, Multimedia Tools and Applications.

[5]  Yunyoung Nam,et al.  mCLOVER: mobile content-based leaf image retrieval system , 2005, MULTIMEDIA '05.

[7]  Xiangyang Gong,et al.  Context-Aware Image Annotation and Retrieval on Mobile Device , 2010, 2010 Second International Conference on Multimedia and Information Technology.

[8]  Maozhen Li,et al.  FARM: file annotation and retrieval on mobile devices , 2011, Personal and Ubiquitous Computing.

[9]  H. Bouyerbou,et al.  Hybrid image representation methods for automatic image annotation: A survey , 2012, 2012 International Conference on Signals and Electronic Systems (ICSES).

[10]  Sung-Bae Cho,et al.  A mobile picture tagging system using tree-structured layered Bayesian networks , 2013, Mob. Inf. Syst..

[11]  Masashi Inoue.  On the need for annotation-based image retrieval , 2004 .

[12]  Anita Shinde,et al.  A Study on Image Annotation Techniques , 2012 .

[13]  Jonathon S. Hare,et al.  Content-based image retrieval using a mobile device as a novel interface , 2005, IS&T/SPIE Electronic Imaging.

[14]  Hyeran Byun,et al.  A fast image retrieval system using index lookup table on mobile device , 2008, 2008 19th International Conference on Pattern Recognition.

[15]  Wichian Premchaiswadi,et al.  Mobile image search for tourist information using ACCC algorithm , 2010, 21st Annual IEEE International Symposium on Personal, Indoor and Mobile Radio Communications.

[16]  Marc Davis,et al.  Photo annotation on a camera phone , 2004, CHI EA '04.

[17]  Sungyong Park,et al.  Fast and Accurate Home Photo Categorization for Handheld Devices using MPEG-7 Descriptors , 2013, Int. J. Comput. Commun. Control.

[18]  Kien A. Hua,et al.  Client-Side Relevance Feedback Approach for Image Retrieval in Mobile Environment , 2007, ICME.

[19]  Chihli Hung and Chih-Fong Tsai,et al.  Automatically Annotating Images with Keywords: A Review of Image Annotation Systems , 2008 .

[20]  Winston H. Hsu,et al.  Sketch-based image retrieval on mobile devices using compact hash bits , 2012, ACM Multimedia.

[21]  Hyunsuk Im,et al.  A method for searching photos on a mobile phone by using the fisheye view technique , 2011 .

[22]  Jérôme Gensel,et al.  PhotoMap - Automatic Spatiotemporal Annotation for Mobile Photos , 2007, W2GIS.

[23]  Matt Jones,et al.  Improving photo searching interfaces for small-screen mobile computers , 2006, Mobile HCI.

[24]  Masayuki Nakajima,et al.  Mobile Image Retrieval using Morphological Color Segmentation , 2006 .

[25]  Rui Li,et al.  Survey on social tagging techniques , 2010, SKDD.

[26]  Zhen Li,et al.  Context-aware mobile image annotation for media search and sharing , 2013, Signal Process. Image Commun..

[27]  Marcel Worring,et al.  Content-Based Image Retrieval at the End of the Early Years , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  H. Garcia-Molina,et al.  Automatic organization for digital photographs with geographic coordinates , 2004, Proceedings of the 2004 Joint ACM/IEEE Conference on Digital Libraries, 2004..

[29]  Henning Müller,et al.  Mobile Medical Visual Information Retrieval , 2012, IEEE Transactions on Information Technology in Biomedicine.

[30]  Moncef Gabbouj,et al.  Content-based image indexing and retrieval framework on symbian based mobile platform , 2005, 2005 13th European Signal Processing Conference.

[31]  Gregory D. Abowd,et al.  Towards a Better Understanding of Context and Context-Awareness , 1999, HUC.

[32]  Andrea Kutics,et al.  MOSIR: Image and Segment-Based Retrieval for Mobile Phones , 2010, PCM.

[33]  Chuan Qin,et al.  TagSense: a smartphone-based approach to automatic image tagging , 2011, MobiSys '11.

[34]  Randi Karlsen,et al.  A Context Centric Approach for Semantic Image Annotation and Retrieval , 2009, 2009 Computation World: Future Computing, Service Computation, Cognitive, Adaptive, Content, Patterns.