Qualitative Camera Motion Classification for Content-Based Video Indexing

Due to the fact that the camera motion usually imply some hints which are helpful in bridging the gap between computationally available features and semantic interpretations, extensive researches have been executed to extract them for various purposes. However, these strategies fail to classify the camera rotation; furthermore, their performance might be significantly reduced by considerable noise or error in extracted features. In this paper, a robust camera motion classification strategy is proposed. We use the mutual relationship between motion vectors for motion classification. Given any two motion vectors in each P-frame, four types of mutual relationships between them are classified, then, a 14-bins feature vector is constructed to characterize the statistical motion information for the P-frame. Finally, the qualitative classification is executed by considering all achieved statistical information.

[1]  Xiangyang Xue,et al.  Using mutual relationship between motion vectors for qualitative camera motion classification in MPEG video , 2002, Other Conferences.

[2]  Chong-Wah Ngo,et al.  On clustering and retrieval of video shots , 2001, MULTIMEDIA '01.

[3]  Harpreet S. Sawhney,et al.  Compact Representations of Videos Through Dominant and Multiple Motion Estimation , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Chong-Wah Ngo,et al.  Motion characterization by temporal slices analysis , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[5]  Chitra Dorai,et al.  Perceived visual motion descriptors from MPEG-2 for content-based HDTV annotation and retrieval , 1999, 1999 IEEE Third Workshop on Multimedia Signal Processing (Cat. No.99TH8451).

[6]  Svetha Venkatesh,et al.  Qualitative estimation of camera motion parameters from video sequences , 1997, Pattern Recognition.

[7]  Sanjeev R. Kulkarni,et al.  Rapid estimation of camera motion from compressed video with application to video annotation , 2000, IEEE Trans. Circuits Syst. Video Technol..

[8]  Wei Xiong,et al.  Efficient Scene Change Detection and Camera Motion Annotation for Video Classification , 1998, Comput. Vis. Image Underst..

[9]  Ramesh C. Jain,et al.  Direct Computation of the Focus of Expansion , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Edward H. Adelson,et al.  Layered representation for motion analysis , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Richard Szeliski,et al.  Video mosaics for virtual environments , 1996, IEEE Computer Graphics and Applications.