Dissolve detection in videos using an ensemble approach

Detection of shot transitions is an important preprocessing step for content based video retrieval systems. Out of the various types of transitions present in videos, dissolve detection is the most challenging one. This is due to the inherent complexity induced by the component frames making up the dissolve transition. In this work, a two-phased approach is presented for detecting the dissolve sequences. The first phase is concerned with identifying candidate dissolve sequences based on the parabolic nature of the mean fuzzy entropy data computed on the composing frames of the video. In the second phase, the candidates are filtered through multiple stages where each stage is based on a low-level feature of the video stream. The threshold in each stage is based on the data obtained for that feature from the constituent frames of the video. The final set of dissolve sequences are obtained at the end of the filtration stage. The proposed method is also able to detect the span of the dissolve sequence with an error of maximum one frame. Comparisons reveal that the proposed method outperforms the state-of-the-art methods in terms of both recall and precision.

[1]  Athanassios N. Skodras,et al.  A New Approach to Gradual Video Transition Detection , 2012, 2012 16th Panhellenic Conference on Informatics.

[2]  Siddhartha Bhattacharyya,et al.  Video Shot Segmentation Using Spatio-temporal Fuzzy Hostility Index and Automatic Threshold , 2014, 2014 Fourth International Conference on Communication Systems and Network Technologies.

[3]  Bede Liu,et al.  Temporal segmentation of video using frame and histogram space , 2000, IEEE Transactions on Multimedia.

[4]  A. Savitzky,et al.  Smoothing and Differentiation of Data by Simplified Least Squares Procedures. , 1964 .

[5]  Chih-Wen Su,et al.  A motion-tolerant dissolve detection algorithm , 2002, Proceedings. IEEE International Conference on Multimedia and Expo.

[6]  Ramin Zabih,et al.  A feature-based algorithm for detecting and classifying production effects , 1999, Multimedia Systems.

[7]  Hugh E. Williams,et al.  Gradual Transition Detection Using Average Frame Similarity , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[8]  Junaid Baber,et al.  Shot boundary detection from videos using entropy and local descriptor , 2011, 2011 17th International Conference on Digital Signal Processing (DSP).

[9]  Rainer Lienhart,et al.  Comparison of automatic shot boundary detection algorithms , 1998, Electronic Imaging.

[10]  Patrick Lambert,et al.  Dissolve detection in abstract video contents , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[11]  Antonio Albiol,et al.  GRADUAL TRANSITION DETECTION FOR VIDEO PARTITIONING USING MORPHOLOGICAL OPERATORS , 2011 .

[12]  Kuo-Chin Fan,et al.  A motion-tolerant dissolve detection algorithm , 2005, IEEE Transactions on Multimedia.

[13]  Bijal Talati,et al.  Analysis of Popular Video Shot Boundary Detection Techniques in Uncompressed Domain , 2012 .

[14]  Ullas Gargi,et al.  Performance characterization of video-shot-change detection methods , 2000, IEEE Trans. Circuits Syst. Video Technol..

[15]  Ujjwal Maulik,et al.  High-speed target tracking by fuzzy hostility-induced segmentation of optical flow field , 2009, Appl. Soft Comput..

[16]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Bede Liu,et al.  Temporal segmentation of video using frame and histogram space , 2006, IEEE Trans. Multim..

[18]  M. M.,et al.  GRADUAL TRANSITION DETECTION FOR VIDEO PARTITIONING USING MORPHOLOGICAL OPERATORS , 2007 .