Efficient Scene Change Detection and Camera Motion Annotation for Video Classification

With the fast growth of video sources, efficient video classification and management is becoming more and more important. Video partitioning and video feature extraction are two of the key issues in video classification. In this paper, we introduce our innovative approaches to scene change detection and camera motion extraction.The video partitioning process involves the detection of boundaries between uninterrupted segments (video shots) of scenes. Shot boundaries can be classified into two categories, gradual transition and instantaneous change (called a camera break). Detection of a gradual transition is considered to be a difficult problem. Few methods have been reported for gradual transition detection. We discuss an efficient method which is calledStep-variable.In this paper, a novel method is derived to classify the dominant camera motions in video shots. The method is to analyze the optical flow in a decomposed manner. Images are divided into subregions according to our camera model. The projectedxandycomponents of optical flow are analyzed separately in the different subregions of the images. Different camera motions are recognized by comparing the computed result with the prior known patterns. Our method is efficient and effective because only some mean values and standard deviations are used. The analysis and a detailed description of our method are presented in this paper. Experimental results are given to show the effectiveness of the proposed method.

[1]  Svetha Venkatesh,et al.  Qualitative estimation of camera motion parameters from video sequences , 1997, Pattern Recognition.

[2]  Yoshinobu Tonomura,et al.  Projection Detecting Filter for Video Cut Detection , 1993, ACM Multimedia.

[3]  Sanjeev R. Kulkarni,et al.  A new method for camera motion parameter estimation , 1995, Proceedings., International Conference on Image Processing.

[4]  Takafumi Miyatake,et al.  IMPACT: an interactive natural-motion-picture dedicated multimedia authoring system , 1991, CHI.

[5]  Akio Nagasaka,et al.  Automatic Video Indexing and Full-Video Search for Object Appearances , 1991, VDB.

[6]  Boon-Lock Yeo,et al.  Rapid scene analysis on compressed video , 1995, IEEE Trans. Circuits Syst. Video Technol..

[7]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[8]  Jonathan D. Courtney Automatic video indexing via object motion analysis , 1997, Pattern Recognit..

[9]  Shinji Abe,et al.  Scene retrieval method for video database applications using temporal condition changes , 1989, International Workshop on Industrial Applications of Machine Intelligence and Vision,.

[10]  John Chung-Mong Lee,et al.  Video Annotation by Motion Interpretation Using Optical Flow Streams , 1996, J. Vis. Commun. Image Represent..

[11]  Michael Hoetter Differential estimation of the global motion parameters zoom and pan , 1989 .

[12]  Wei Xiong,et al.  Automatic video data structuring through shot partitioning and key-frame computing , 1997, Machine Vision and Applications.

[13]  Masato Kurokawa,et al.  Method for retrieving sequences of images on the basis of motion analysis , 1992, Electronic Imaging.

[14]  Behzad Shahraray,et al.  Scene change detection and content-based sampling of video sequences , 1995, Electronic Imaging.

[15]  Wei Xiong,et al.  Net comparison: a fast and effective method for classifying image sequences , 1995, Electronic Imaging.

[16]  Nobuyuki Yagi,et al.  Estimation of camera parameters from image sequence for model-based video coding , 1994, IEEE Trans. Circuits Syst. Video Technol..

[17]  Stefano Spaccapietra,et al.  Visual Database Systems 3 , 1995, IFIP — The International Federation for Information Processing.