Image classification using color, texture and regions

Abstract A new classification method using color, texture and regions is proposed in this study. Image-based features related to color and local edge patterns are used to prune irrelevant database images for each query image. The proposed region matching is then applied to find the match to the query image from among the set of candidate images in the database. The dissimilarity of each pair of images can be calculated on the basis of the matching results. Finally, all the database images in the candidate set can be sorted by ascending dissimilarity values. To achieve the classification goal, the k-NN rule is used to assign a class label to the query image. Note that the main contribution of this paper is to select proper features for representing color, texture and region, which, in turn, are used to achieve effective classification results. More important, all features used in the proposed method, no matter color or texture, are presented in the simple form of histogram, yet leading to effective results. Even in the stage of region matching, color and texture features in histograms are also used to obtain homogeneous regions and to measure dissimilarity. In addition, the proposed classification method can be applied to all kinds of color image databases rather than specific databases. The number of classes can be as versatile as required by the application. The effectiveness and practicability of the proposed method has been demonstrated by various experiments.

[1]  Sang Uk Lee,et al.  Color image retrieval using hybrid graph representation , 1999, Image Vis. Comput..

[2]  Thomas S. Huang,et al.  Relevance feedback: a power tool for interactive content-based image retrieval , 1998, IEEE Trans. Circuits Syst. Video Technol..

[3]  B. S. Manjunath,et al.  NeTra: A toolbox for navigating large image databases , 1997, Proceedings of International Conference on Image Processing.

[4]  John R. Smith,et al.  Image Classification and Querying Using Composite Region Templates , 1999, Comput. Vis. Image Underst..

[5]  Dragutin Petkovic,et al.  Query by Image and Video Content: The QBIC System , 1995, Computer.

[6]  Shu-Yuan Chen,et al.  General Image Classification Using Adaptive Cellular Color Decomposition , 2003, Int. J. Pattern Recognit. Artif. Intell..

[7]  Shih-Fu Chang,et al.  VisualSEEk: a fully automated content-based image query system , 1997, MULTIMEDIA '96.

[8]  Ramin Zabih,et al.  Histogram refinement for content-based image retrieval , 1996, Proceedings Third IEEE Workshop on Applications of Computer Vision. WACV'96.

[9]  Shu-Yuan Chen,et al.  Color texture segmentation using feature distributions , 2002, Pattern Recognit. Lett..

[10]  Matti Pietikäinen,et al.  Unsupervised texture segmentation using feature distributions , 1997, Pattern Recognit..

[11]  Amarnath Gupta,et al.  Virage image search engine: an open framework for image management , 1996, Electronic Imaging.

[12]  Chiou-Shann Fuh,et al.  Hierarchical color image region segmentation for content-based image retrieval system , 2000, IEEE Trans. Image Process..

[13]  Michael J. Swain,et al.  Color indexing , 1991, International Journal of Computer Vision.

[14]  Serge J. Belongie,et al.  Region-based image querying , 1997, 1997 Proceedings IEEE Workshop on Content-Based Access of Image and Video Libraries.

[15]  Anil K. Jain,et al.  On image classification: city images vs. landscapes , 1998, Pattern Recognit..

[16]  Martin Szummer,et al.  Indoor-outdoor image classification , 1998, Proceedings 1998 IEEE International Workshop on Content-Based Access of Image and Video Database.

[17]  Alex Pentland,et al.  Photobook: Content-based manipulation of image databases , 1996, International Journal of Computer Vision.

[18]  Anil K. Jain,et al.  Image classification for content-based indexing , 2001, IEEE Trans. Image Process..