Modeling Color Dynamics for the Semantics of Commercials

Retrieval of video based on content semantics requires that models are developed to map low level perceptual features into high level semantic concepts. Commercials are a video category where the link between low level perceptual features and high level semantics is stressed, since the way colors are chosen and modified throughout a commercial creates a large part of its message. In this chapter, we propose a model for the representation and comparison of video content based on dynamics of color regions in the video. A model is presented to define an intermediate level representation of color dynamics in terms of spatial arrangement of color flows. The model for representation and comparison of spatial relationships between extended sets of pixels in a 3D space is introduced by developing on the concept of weighted walkthroughs. Results of preliminary experiments are reported for a library of video commercials.

[1]  Shi-Kuo Chang,et al.  Image sequence compression by iconic indexing , 1989, [Proceedings] 1989 IEEE Workshop on Visual Languages.

[2]  SUH-YIN LEE,et al.  Spatial reasoning and similarity retrieval of images using 2D C-string knowledge representation , 1992, Pattern Recognit..

[3]  Michael A. Arbib,et al.  Color Image Segmentation using Competitive Learning , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  J. Floch.  Sémiotique, marketing et communication , 2002 .

[5]  Shi-Kuo Chang,et al.  Iconic Indexing by 2-D Strings , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Vijay V. Raghavan,et al.  Design and evaluation of algorithms for image retrieval by spatial similarity , 1995, TOIS.

[7]  Alberto Del Bimbo,et al.  Symbolic Description and Visual Querying of Image Sequences Using Spatio-Temporal Logic , 1995, IEEE Trans. Knowl. Data Eng..

[8]  Alberto Del Bimbo,et al.  Retrieval of Commercials by Semantic Content: The Semiotic Perspective , 2004, Multimedia Tools and Applications.

[9]  Alberto Del Bimbo,et al.  Semantics in Visual Information Retrieval , 1999, IEEE Multim..

[10]  Alberto Del Bimbo,et al.  Weighted walkthroughs between extended entities for retrieval by spatial arrangement , 2003, IEEE Trans. Multim..

[11]  Alberto Del Bimbo,et al.  Visual information retrieval , 1999 .

[12]  Alberto Del Bimbo,et al.  Retrieval of Commercials based on Dynamics of Color Flows , 2000, J. Vis. Lang. Comput..

[13]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[14]  Alberto Del Bimbo,et al.  Weighting spatial arrangement of colors in content based image retrieval , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[15]  Simone Santini,et al.  Querying multiple-perspective video , 1998, Electronic Imaging.

[16]  Anil K. Jain,et al.  Algorithms for Clustering Data , 1988 .

[17]  Dragutin Petkovic,et al.  Key to effective video retrieval: effective cataloging and browsing , 1998, MULTIMEDIA '98.

[18]  J. Floch.  Sémiotique, marketing et communication : sous les signes, les stratégies , 1990 .