AUTOMATIC IMAGE TAGGING BY USING IMAGE CONTENT ANALYSIS

Image analysis and in particular automatic image classification or annotation, often begins with feature extraction for content representation. The content representation can be based on low level and high level feature extraction. In this paper, we present a simple image classifier which attempts to classify building images based on their low level features which are colour and edges. The classifier is developed by using Bayesian Inference method provided by Infer.net tool. Equivalently, the classifier can be regarded as an annotator which aims to annotate images with a specific tag when appropriate. In this example, the image classifier is developed to identify and distinguish building and non images. The method could be extended into other classes such as mountains, beaches and forest. This image classification is important because it can enable users to retrieve images that may not be well tagged and also to annotate images with information that they may want to use for retrieval purposes but not necessarily for explicit annotation. The performances are assessed using confusion matrices and ROC curves.

[1]  Andrew Zisserman,et al.  Video Google: a text retrieval approach to object matching in videos , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[2]  Aude Oliva,et al.  Global semantic classification of scenes using power spectrum templates , 1999 .

[3]  Jiebo Luo,et al.  Improved scene classification using efficient low-level features and semantic cues , 2004, Pattern Recognit..

[4]  Mor Naaman,et al.  Why we tag: motivations for annotation in mobile and online media , 2007, CHI.

[5]  Cordelia Schmid,et al.  Local Features and Kernels for Classification of Texture and Object Categories: A Comprehensive Study , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[6]  Jiebo Luo,et al.  Indoor vs outdoor classification of consumer photographs using low-level and semantic features , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[7]  Amanda Spink,et al.  How are we searching the World Wide Web? A comparison of nine search engine transaction logs , 2006, Inf. Process. Manag..

[8]  Jonathon S. Hare,et al.  Automatically annotating the MIR Flickr dataset: experimental protocols, openly available data and semantic spaces , 2010, MIR '10.

[9]  Martin Szummer,et al.  Indoor-outdoor image classification , 1998, Proceedings 1998 IEEE International Workshop on Content-Based Access of Image and Video Database.

[10]  Anil K. Jain,et al.  Image classification for content-based indexing , 2001, IEEE Trans. Image Process..

[11]  Mingjing Li,et al.  Boosting image orientation detection with indoor vs. outdoor classification , 2002, Sixth IEEE Workshop on Applications of Computer Vision, 2002. (WACV 2002). Proceedings..

[12]  Koen E. A. van de Sande,et al.  Evaluating Color Descriptors for Object and Scene Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Sameer Singh,et al.  Indoor vs. outdoor scene classification in digital photographs , 2005, Pattern Recognit..

[14]  Nigel Shadbolt,et al.  Image annotation with Photocopain , 2006 .

[15]  Nicolas Hervé,et al.  Image annotation: which approach for realistic databases? , 2007, CIVR '07.