Automatic Annotation of Digital Images using Colour Structure and Edge Direction

The focus of this paper is on automatic annotation for semantic image retrieval. This work is aimed at identifying visual descriptors that are most relevant, effective and suitable for semantic annotation tasks. We propose an image annotation system based on support vector machines and a combination of descriptors that includes a gradient direction histogram and several MPEG-7 visual descriptors. The system is tested on a large database of 7200 cityscape and landscape images. The results indicate that when descriptors are used individually, the proposed gradient direction histogram performs best. However, when descriptors are combined, the accuracy is improved. The presented results confirm that combining the gradient direction histogram and colour structure produces the best results.

[1]  Anil K. Jain,et al.  On image classification: city vs. landscape , 1998, Proceedings. IEEE Workshop on Content-Based Access of Image and Video Libraries (Cat. No.98EX173).

[2]  Martin Szummer,et al.  Indoor-outdoor image classification , 1998, Proceedings 1998 IEEE International Workshop on Content-Based Access of Image and Video Database.

[3]  Yixin Chen,et al.  Machine Learning and Statistical Modeling Approaches to Image Retrieval , 2004, The Information Retrieval Series.

[4]  Son Lam Phung,et al.  Automatic Image Annotation for Semantic Image Retrieval , 2007, VISUAL.

[5]  Tat-Seng Chua,et al.  A Novel Approach to Auto Image Annotation Based on Pairwise Constrained Clustering and Semi-Naïve Bayesian Model , 2005, 11th International Multimedia Modelling Conference.

[6]  Anil K. Jain,et al.  Content-based hierarchical classification of vacation images , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[7]  B. S. Manjunath,et al.  Introduction to MPEG-7: Multimedia Content Description Interface , 2002 .

[8]  Fuhui Long,et al.  Fundamentals of Content-Based Image Retrieval , 2003 .

[9]  A. Dorado,et al.  Semi-automatic image annotation using frequent keyword mining , 2003, Proceedings on Seventh International Conference on Information Visualization, 2003. IV 2003..

[10]  James Ze Wang,et al.  Content-based image retrieval: approaches and trends of the new age , 2005, MIR '05.

[11]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[12]  Marcel Worring,et al.  Content-Based Image Retrieval at the End of the Early Years , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Rainer Lienhart,et al.  Classifying images on the web automatically , 2002, J. Electronic Imaging.