A Model-Based Shot Boundary Detection Technique Using Frame Transition Parameters

We have presented a unified model for detecting different types of video shot transitions. Based on the proposed model, we formulate frame estimation scheme using the previous and the next frames. Unlike other shot boundary detection algorithms, instead of properties of frames, frame transition parameters and frame estimation errors based on global and local features are used for boundary detection and classification. Local features include scatter matrix of edge strength and motion matrix. Finally, the frames are classified as no change (within shot frame), abrupt change, or gradual change frames using a multilayer perceptron network. The proposed method is relatively less dependent on user defined thresholds and is free from sliding window size as widely used by various schemes found in the literature. Moreover, handling both abrupt and gradual transitions along with non-transition frames under a single framework using model guided visual feature is another unique aspect of the work.

[1]  Jong-Un Won,et al.  Adaptive video-dissolve detection method based on correlation between successive scenes , 2003 .

[2]  Rainer Lienhart,et al.  Reliable dissolve detection , 2001, IS&T/SPIE Electronic Imaging.

[3]  Nilesh V. Patel,et al.  Video shot detection and characterization for video databases , 1997, Pattern Recognit..

[4]  Siba Haidar,et al.  The SAMOVA Shot Boundary Detection for TRECVID Evaluation 2004 , 2004, TRECVID.

[5]  Li Zhan-Ming,et al.  Rapid Shot Boundary Detection Algorithm Based on Rough Sets in Video Compressed Domain , 2009 .

[6]  Nasser M. Nasrabadi,et al.  Pattern Recognition and Machine Learning , 2006, Technometrics.

[7]  Bo Zhang,et al.  A unified shot boundary detection framework based on graph partition model , 2005, MULTIMEDIA '05.

[8]  Liang-Tien Chia,et al.  A motion based scene tree for browsing and retrieval of compressed videos , 2004, MMDB '04.

[9]  Majid Mirmehdi,et al.  Detection and Classification of Shot Transitions , 2001, BMVC.

[10]  Chung-Lin Huang,et al.  A robust scene-change detection method for video segmentation , 2001, IEEE Trans. Circuits Syst. Video Technol..

[11]  Zhao Huan,et al.  Shot Boundary Detection Based on Mutual Information and Canny Edge Detector , 2008, 2008 International Conference on Computer Science and Software Engineering.

[12]  Wen Gao,et al.  Illumination Invariant Shot Boundary Detection , 2003, IDEAL.

[13]  Dong-Sik Jang,et al.  Video scene change detection using neural network: Improved ART2 , 2006, Expert Syst. Appl..

[14]  José Manuel Menéndez,et al.  A unified model for techniques on video-shot transition detection , 2005, IEEE Transactions on Multimedia.

[15]  Ramin Zabih,et al.  A feature-based algorithm for detecting and classifying scene breaks , 1995, MULTIMEDIA '95.

[16]  Boon-Lock Yeo,et al.  Rapid scene analysis on compressed video , 1995, IEEE Trans. Circuits Syst. Video Technol..

[17]  Ioannis Pitas,et al.  Information theory-based shot cut/fade detection and video summarization , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[18]  Dong-Sik Jang,et al.  Gradual shot boundary detection using localized edge blocks , 2006, Multimedia Tools and Applications.

[19]  Ting Liu,et al.  Video Segmentation via Temporal Pattern Classification , 2007, IEEE Transactions on Multimedia.

[20]  Lap-Pui Chau,et al.  A fast octagon-based search algorithm for motion estimation , 2003, Signal Process..

[21]  Tsuhan Chen,et al.  Shot boundary detection using temporal statistics modeling , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[22]  Liang-Hua Chen,et al.  Movie scene segmentation using background information , 2008, Pattern Recognit..

[23]  Li Huan,et al.  A General Method for Shot Boundary Detection , 2008, 2008 International Conference on Multimedia and Ubiquitous Engineering (mue 2008).

[24]  Bo Zhang,et al.  A Formal Study of Shot Boundary Detection , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[25]  Hironobu Fujiyoshi,et al.  Shot boundary detection using co-occurrence of global motion in video stream , 2008, 2008 19th International Conference on Pattern Recognition.

[26]  Yiannis Kompatsiaris,et al.  Gradual transition detection using color coherence and other criteria in a video shot meta-segmentation framework , 2008, 2008 15th IEEE International Conference on Image Processing.

[27]  Bhabatosh Chanda,et al.  Shot Boundary Detection Using Frame Transition Parameters and Edge Strength Scatter , 2007, PReMI.

[28]  Alan Hanjalic,et al.  Shot-boundary detection: unraveled and resolved? , 2002, IEEE Trans. Circuits Syst. Video Technol..

[29]  Jae-Gark Choi,et al.  Correlation based video-dissolve detection , 2003, International Conference on Information Technology: Research and Education, 2003. Proceedings. ITRE2003..

[30]  Ramesh C. Jain,et al.  Production model based digital video segmentation , 1995, Multimedia Tools and Applications.

[31]  Rita Cucchiara,et al.  Linear Transition Detection as a Unified Shot Detection Approach , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[32]  Jonathan Foote,et al.  Discriminative techniques for keyframe selection , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[33]  Donald A. Adjeroh,et al.  Adaptive Edge-Oriented Shot Boundary Detection , 2009, EURASIP J. Image Video Process..

[34]  Atreyi Kankanhalli,et al.  Automatic partitioning of full-motion video , 1993, Multimedia Systems.