Format-Independent Motion Content Description based on Spatiotemporal Visual Sensitivity

With the extensive application of digital video technology, developing format-independent motion describing method is of great significance for retrieving and searching video content in different formats. In this paper, a format-independent motion describing method for video content is proposed. The features based on visual sensitivity are extracted from spatiotemporal slice. Since the same video content gives the same visual stimuli to visual perception, the method based on this kind of visual sensitivity related feature is format-independent. The experiments show the feature proposed is sensitive to the variation of video content and robust to the variation of video format. The motion describing method proposed is format-independent.

[1]  S.-L. Peng,et al.  Interpretation of image sequences by spatio-temporal analysis , 1989, [1989] Proceedings. Workshop on Visual Motion.

[2]  Dawei W. Dong,et al.  Spatiotemporal Inseparability of Natural Images and Visual Sensitivities , 2001 .

[3]  Chong-Wah Ngo,et al.  Motion analysis and segmentation through spatio-temporal slices processing , 2003, IEEE Trans. Image Process..

[4]  Amir Averbuch,et al.  Fast gradient methods based on global motion estimation for video compression , 2003, IEEE Trans. Circuits Syst. Video Technol..

[5]  B. S. Manjunath,et al.  A Motion Activity Descriptor and Its Extraction in Compressed Domain , 2001, IEEE Pacific Rim Conference on Multimedia.

[6]  Ajay Divakaran,et al.  MPEG-7 visual motion descriptors , 2001, IEEE Trans. Circuits Syst. Video Technol..

[7]  Ali N. Akansu,et al.  Low-level motion activity features for semantic characterization of video , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[8]  Ruud M. Bolle,et al.  Comparison of sequence matching techniques for video copy detection , 2001, IS&T/SPIE Electronic Imaging.

[9]  Sanjeev R. Kulkarni,et al.  Rapid estimation of camera motion from compressed video with application to video annotation , 2000, IEEE Trans. Circuits Syst. Video Technol..

[10]  Frédéric Dufaux,et al.  Efficient, robust, and fast global motion estimation for video coding , 2000, IEEE Trans. Image Process..

[11]  Iain E. G. Richardson,et al.  Video Codec Design: Developing Image and Video Compression Systems , 2002 .

[12]  J. Atick,et al.  STATISTICS OF NATURAL TIME-VARYING IMAGES , 1995 .

[13]  B. Vasudev,et al.  Spatiotemporal sequence matching for efficient video copy detection , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[14]  J. H. van Hateren,et al.  Modelling the Power Spectra of Natural Images: Statistics and Information , 1996, Vision Research.

[15]  Ahmed K. Elmagarmid,et al.  InsightVideo: toward hierarchical video content organization for efficient browsing, summarization and retrieval , 2005, IEEE Transactions on Multimedia.