Analysis and Review of Formal Approaches to Automatic Video Shot Boundary Detection

Today, large volume of digital videos has become available online to the masses. There is the drastic growth in the amount of the multimedia data, because of the improvements in data storage, acquisition and communication technologies, which are supported by improvements in processing of audio and video signals. People are looking for the videos that contain certain information of their interest. Such a search is facilitated by Content Based Video Retrieval methods. Three major steps of CBVR are, dividing the videos into the segments, extracting the features from video, and after that retrieving videos based on information in query. Out of these 3 steps segmentation of video is most prominent step as the retrieval results are based on the segmentation boundaries. Segmentation divides the video into shots. A shot is a segment of the video that consists of one continuous action in time domain. The boundaries of such shots can be detected by using various different techniques like histogram, discrete cosine transforms, motion vector, edge tracking, and block matching methods. But due to the motion of objects and camera these shot boundaries can be detected falsely. This paper presents a comparative study of different methods/algorithms that have been proposed in literature.

[1]  B. G. Hogade,et al.  Abrupt Scene Change Detection , 2008 .

[2]  Ioannis Pitas,et al.  Information theory-based shot cut/fade detection and video summarization , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  Young-Min Kim,et al.  Fast scene change detection using direct feature extraction from MPEG compressed videos , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[4]  Qingming Huang,et al.  JDL at TRECVID 2006 Shot Boundary Detection , 2006, TRECVID.

[5]  Pong C. Yuen,et al.  Shot Boundary Detection: An Information Saliency Approach , 2008, 2008 Congress on Image and Signal Processing.

[6]  Qingning Zeng,et al.  Shot Boundary Detection Based on Difference Sequences of Mutual Information , 2007, Fourth International Conference on Image and Graphics (ICIG 2007).

[7]  Markus Rupp,et al.  SCENE CHANGE DETECTION FOR H.264 USING DYNAMIC THRESHOLD TECHNIQUES , 2005 .

[8]  Keiichiro Hoashi,et al.  SVM-Based Shot Boundary Detection with a Novel Feature , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[9]  Ting Liu,et al.  Video Segmentation via Temporal Pattern Classification , 2007, IEEE Transactions on Multimedia.

[10]  Shih-Fu Chang,et al.  A Framework for Sub-Window Shot Detection , 2005, 11th International Multimedia Modelling Conference.

[11]  Nikolas P. Galatsanos,et al.  Scene Detection in Videos Using Shot Clustering and Sequence Alignment , 2009, IEEE Transactions on Multimedia.

[12]  W. Marsden.  I and J , 2012 .

[13]  Steven C. H. Hoi,et al.  Chinese University of Hong Kong at TRECVID 2006: Shot Boundary Detection and Video Search , 2006, TRECVID.

[14]  Xinbo Gao,et al.  A Video Shot Boundary Detection Algorithm Based on Feature Tracking , 2006, RSKT.

[15]  Rangasami L. Kashyap,et al.  Video scene change detection method using unsupervised segmentation and object tracking , 2001, IEEE International Conference on Multimedia and Expo, 2001. ICME 2001..

[16]  Georges Quénot,et al.  CLIPS at TRECVID : Shot Boundary Detection and Feature Detection , 2003, TRECVID.

[17]  Sarah V. Porter,et al.  Video Segmentation and Indexing using Motion Estimation , 2004 .

[18]  Bo Zhang,et al.  A Formal Study of Shot Boundary Detection , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[19]  G. Camara-Chavez,et al.  Shot Boundary Detection by a Hierarchical Supervised Approach , 2007, 2007 14th International Workshop on Systems, Signals and Image Processing and 6th EURASIP Conference focused on Speech and Image Processing, Multimedia Communications and Services.

[20]  J. Jiang,et al.  An Effective and Fast Scene Change Detection Algorithm for MPEG Compressed Videos , 2006, ICIAR.

[21]  Xiangyang Xue,et al.  Shot boundary detection using unsupervised clustering and hypothesis testing , 2004, 2004 International Conference on Communications, Circuits and Systems (IEEE Cat. No.04EX914).

[22]  Jaroslav Polec,et al.  Fast Algorithm of Shot Cut Detection , 2012 .

[23]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[24]  Uday B. Desai,et al.  Performance Evaluation of Shot Boundary Detection Metrics in the Presence of Object and Camera Motion , 2011 .

[25]  Liang Bai,et al.  Video shot boundary detection using Petri-Net , 2008, 2008 International Conference on Machine Learning and Cybernetics.

[26]  J. Amudha,et al.  Video Shot Detection using Saliency Measure , 2012 .

[27]  Yuchou Chang,et al.  Unsupervised Video Shot Detection Using Clustering Ensemble with a Color Global Scale-Invariant Feature Transform Descriptor , 2008, EURASIP J. Image Video Process..

[28]  Tiecheng Liu,et al.  Summarization of Visual Content in Instructional Videos , 2007, IEEE Transactions on Multimedia.