A Framework of Large-Scale and Real-Time Image Annotation System

In this paper, we propose a novel framework of large-scale and real-time image annotation system. The large-scale image set is constructed based on current web image search engines and re-ranking algorithm. Various global and local features are employed for representing images with parallel extraction mechanism for the real-time requirements. At training stage, the distance between class centers in image set are calculated, on which numbers of local neighbor areas are formed. In each local neighbor area, a bi-coded genetic algorithm is employed to select optimal feature subsets and corresponding optimal weights for every one vs. one SVM classifiers. At annotation stage, after finding the nearest class center for an unlabeled image, a set of pre-trained SVMs in local neighbor area are used to vote and obtain the final annotation. All the above strategies guarantee the annotation precision while shorten the annotation time of system.

[1]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[2]  David Nistér,et al.  Scalable Recognition with a Vocabulary Tree , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[3]  Wei-Ying Ma,et al.  Image annotation by large-scale content-based image retrieval , 2006, MM '06.

[4]  Changhu Wang,et al.  Scalable Markov model-based image annotation , 2008, CIVR '08.

[5]  Xiaojun Qi,et al.  Incorporating multiple SVMs for automatic image annotation , 2007, Pattern Recognit..

[6]  Sergey Brin,et al.  The Anatomy of a Large-Scale Hypertextual Web Search Engine , 1998, Comput. Networks.

[7]  Antonio Torralba,et al.  Ieee Transactions on Pattern Analysis and Machine Intelligence 1 80 Million Tiny Images: a Large Dataset for Non-parametric Object and Scene Recognition , 2022 .

[8]  Fakhri Karray,et al.  Distributed Genetic Algorithm with Bi-Coded Chromosomes and a New Evaluation Function for Features Selection , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[9]  Henry Schneiderman,et al.  Learning a restricted Bayesian network for object detection , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[10]  Shumeet Baluja,et al.  Pagerank for product image search , 2008, WWW.

[11]  Wei-Ying Ma,et al.  AnnoSearch: Image Auto-Annotation by Search , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[12]  Yong Wang,et al.  Coherent image annotation by learning semantic distance , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  John Tait,et al.  CLAIRE: A modular support vector image indexing and classification system , 2006, TOIS.

[14]  Paul A. Viola,et al.  Robust Real-time Object Detection , 2001 .