Research on Constructing a Multi-Label Image Annotation and Retrieval System

In this paper, we design and construct a multi-label image annotation and retrieval system. Various MPEG-7 low level visual features are employed for representing images. For image annotation, a bi-coded genetic algorithm is employed to select optimal feature subsets and corresponding optimal weights for every one vs. one SVM classifiers. After an unlabelled image is segmented into several regions, pre-trained SVMs are used to annotate each region, final label is obtained by merging all the region labels. Based on multi-label of image, image retrieval system provides keyword-based image retrieval service. Multi-labels can provide abundant descriptions for image content in semantic level, high precision annotation algorithm further improve annotation performance.

[1]  Fakhri Karray,et al.  Distributed Genetic Algorithm with Bi-Coded Chromosomes and a New Evaluation Function for Features Selection , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[2]  Henry Schneiderman,et al.  Learning a restricted Bayesian network for object detection , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[3]  Jianjiang Lu,et al.  Feature selection based-on genetic algorithm for image annotation , 2008, Knowl. Based Syst..

[4]  Shumeet Baluja,et al.  Pagerank for product image search , 2008, WWW.

[5]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[6]  Yong Wang,et al.  Coherent image annotation by learning semantic distance , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Antonio Torralba,et al.  Ieee Transactions on Pattern Analysis and Machine Intelligence 1 80 Million Tiny Images: a Large Dataset for Non-parametric Object and Scene Recognition , 2022 .

[8]  Changhu Wang,et al.  Scalable Markov model-based image annotation , 2008, CIVR '08.

[9]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[10]  David Nistér,et al.  Scalable Recognition with a Vocabulary Tree , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[11]  Xiaojun Qi,et al.  Incorporating multiple SVMs for automatic image annotation , 2007, Pattern Recognit..

[12]  James D. Johnston.  MPEG-audio draft, description as of Dec. 10, 1990-ISO/IEC JTC1/SC2/WG11 , 1991, COMPCON Spring '91 Digest of Papers.

[13]  Wei-Ying Ma,et al.  AnnoSearch: Image Auto-Annotation by Search , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[14]  Wei-Ying Ma,et al.  Image annotation by large-scale content-based image retrieval , 2006, MM '06.

[15]  Paul A. Viola,et al.  Robust Real-time Object Detection , 2001 .