Content Representation of Video Sequences Based on Salient Region

In order to provide more efficient content-based functionalities for video applications, it is necessary to extract meaningful regions from scenes as perceptual oriented representation of video content. We present a novel approach for salient region extraction, and simple visual features bound to salient regions will better represent the video content in perceptual manner. Since perceptual saliency for visual information is a subjective concept, a class-related fuzzy information granulation is constructed for mapping original feature space to concepts space. To detect salient regions, segmented homogenous regions are classified according to their salient importance. The experimental results using different types of video sequences are presented to demonstrate the efficiency and accuracy of our proposed algorithm.

[1]  Patrick Le Callet,et al.  A coherent computational approach to model bottom-up visual attention , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  I. Patras,et al.  Spatiotemporal salient points for visual recognition of human actions , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[3]  C. Koch,et al.  A saliency-based search mechanism for overt and covert shifts of visual attention , 2000, Vision Research.

[4]  Hyeran Byun,et al.  SVM-based salient region(s) extraction method for image retrieval , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[5]  Jonathan Lawry,et al.  A mass assignment method for prototype induction , 1999, Int. J. Intell. Syst..

[6]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Witold Pedrycz,et al.  On elicitation of membership functions , 2002, IEEE Trans. Syst. Man Cybern. Part A.

[8]  M. Brady,et al.  Scale Saliency: a novel approach to salient feature and scale selection , 2003 .

[9]  S Ullman,et al.  Shifts in selective visual attention: towards the underlying neural circuitry. , 1985, Human neurobiology.