Spatial color component matching of images

Color and color neighborhood statistics have been used extensively in image matching and retrieval. However the effective incorporation of color layout information remains a challenging issue. In this paper we present a novel method for color layout based image matching called Spatial Color Component Matching (SCCM). First perceptually dominant colors are extracted from an image and are back-projected to segment the image into various areas. Then, each dominant color area, depending on its size, is segmented into a number of spatial units using a multilevel graph partitioning algorithm. Each unit is described in terms of its color and a set of spatial attributes to form a Spatial Color Component (SCC). All SCCs form a list that summarizes the color layout information in an image. The distance between two images is then defined by the minimum distance mapping between the two corresponding SCC lists. The algorithm has been evaluated using an image database of wall paper patterns and another database of natural images. It has been judged by human subjects to be highly effective in both cases.

[1]  Gunther Wyszecki,et al.  Color Science: Concepts and Methods, Quantitative Data and Formulae, 2nd Edition , 2000 .

[2]  Michael J. Swain,et al.  Color indexing , 1991, International Journal of Computer Vision.

[3]  Christos Faloutsos,et al.  QBIC project: querying images by content, using color, texture, and shape , 1993, Electronic Imaging.

[4]  George Karypis,et al.  Multilevel k-way Partitioning Scheme for Irregular Graphs , 1998, J. Parallel Distributed Comput..

[5]  J. Cohen,et al.  Color Science: Concepts and Methods, Quantitative Data and Formulas , 1968 .

[6]  Edward K. Wong,et al.  Augmented image histogram for image and video similarity search , 1998, Electronic Imaging.

[7]  W. Eric L. Grimson,et al.  Configuration based scene classification and image indexing , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[8]  Shih-Fu Chang,et al.  Tools and techniques for color image retrieval , 1996, Electronic Imaging.

[9]  Harold Neil Gabow,et al.  Implementation of algorithms for maximum matching on nonbipartite graphs , 1973 .

[10]  Jianying Hu,et al.  Matching and retrieval based on the vocabulary and grammar of color patterns , 2000, IEEE Trans. Image Process..

[11]  Y. J. Tejwani,et al.  Robot vision , 1989, IEEE International Symposium on Circuits and Systems,.

[12]  Jianying Hu,et al.  Optimal color composition matching of images , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[13]  G. Wyszecki,et al.  Color Science Concepts and Methods , 1982 .

[14]  Jing Huang,et al.  Image indexing using color correlograms , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[15]  Markus A. Stricker,et al.  Color indexing with weak spatial constraints , 1996, Electronic Imaging.

[16]  Joshua R. Smith,et al.  Multi-stage classi cation of images from features and related text , 1997 .

[17]  Jianying Hu,et al.  Extraction of perceptually important colors and similarity measurement for image matching , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[18]  Jitendra Malik,et al.  Color- and texture-based image segmentation using EM and its application to content-based image retrieval , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[19]  William I. Grosky,et al.  Spatial color indexing: a novel approach for content-based image retrieval , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.