Enhancing HSV histograms with achromatic points detection for video retrieval

Color is one of the most meaningful features used in content based retrieval of visual data. In video content based retrieval, color features computed on selected frames are integrated with other low-level features concerning texture, shape and motion in order to find clip similarities. For example, the Scalable Color feature defined in the MPEG-7 standard exploits HSV histograms to create color feature vectors. HSV is a widely adopted space in image and video retrieval, but its quantization for histogram generation can create misleading errors in classification of achromatic and low saturated colors. In this paper we propose an Enhanced HSV Histogram with achromatic point detection based on a single Hue and Saturation parameter that can correct this limitation. The enhanced histograms have proven to be effective in color analysis and they have been used in a system for automatic clip annotation called PEANO, where pictorial concepts are extracted by a clip clustering and used for similarity based automatic annotation.

[1]  Shih-Fu Chang,et al.  A fully automated content-based video search engine supporting spatiotemporal queries , 1998, IEEE Trans. Circuits Syst. Video Technol..

[2]  T. John Stonham,et al.  Fuzzy Colour Category Map for Content Based Image Retrieval , 1999, BMVC.

[3]  Shamik Sural,et al.  Segmentation and histogram generation using the HSV color space for image retrieval , 2002, Proceedings. International Conference on Image Processing.

[4]  Rita Cucchiara,et al.  A Semi-Automatic Video Annotation tool with MPEG-7 Content Collections , 2006, Eighth IEEE International Symposium on Multimedia (ISM'06).

[5]  Alberto Del Bimbo,et al.  Video Annotation with Pictorially Enriched Ontologies , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[6]  Din-Chang Tseng,et al.  Color segmentation using perceptual attributes , 1992, Proceedings., 11th IAPR International Conference on Pattern Recognition. Vol. III. Conference C: Image, Speech and Signal Analysis,.

[7]  Wei-Ying Ma,et al.  Multimedia information retrieval: what is it, and why isn't anyone using it? , 2005, MIR '05.

[8]  Alberto Del Bimbo,et al.  PEANO: pictorial enriched annotation of video , 2006, MM '06.

[9]  Anil K. Jain,et al.  Algorithms for Clustering Data , 1988 .

[10]  Steve McLaughlin,et al.  Comparative study of textural analysis techniques to characterise tissue from intravascular ultrasound , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[11]  J. C. Dunn,et al.  A Fuzzy Relative of the ISODATA Process and Its Use in Detecting Compact Well-Separated Clusters , 1973 .

[12]  Horst M. Eidenberger,et al.  Statistical analysis of content-based MPEG-7 descriptors for image retrieval , 2004, Multimedia Systems.