An Object-Based Shot Boundary Detection Using Edge Tracing and Tracking

Abstract With the upcoming development of MPEG-7, research in shot boundary detection has become more popular. Traditionally, shot boundary has been detected by measuring the differences between the features of adjacent frames, and the threshold was constructed based on a trial and error basis, which usually achieved an accuracy of nearly 90%. However, the remaining errors were left unresolved. In this paper, we will tackle the problem by using object-based detection, which utilizes information from multiple frames through a time stamp transferring mechanism. Unlike classical techniques, our method can handle a gradual transition of any length. The concept of edge object tracking is developed to track moving objects as well as unbounded objects across the gradual transition scenes. We will also prove that object-based detection is not merely an algorithm that can detect shot boundary, but is superior to traditional indicators for detecting gradual transition. Such a technique works very well with frames containing skipped blocks and is independent of the transition period and the amount of disturbances within the sequence, which cannot be handled by indicators based on adjacent frame comparison.

[1]  Ramin Zabih,et al.  A feature-based algorithm for detecting and classifying scene breaks , 1995, MULTIMEDIA '95.

[2]  Boon-Lock Yeo,et al.  Rapid scene analysis on compressed video , 1995, IEEE Trans. Circuits Syst. Video Technol..

[3]  R. Brunelli,et al.  A Survey on the Automatic Indexing of Video Data, , 1999, J. Vis. Commun. Image Represent..

[4]  Wei Xiong,et al.  Efficient Scene Change Detection and Camera Motion Annotation for Video Classification , 1998, Comput. Vis. Image Underst..

[5]  King Ngi Ngan,et al.  Post shot boundary detection technique: flashlight scene determination , 1999, ISSPA '99. Proceedings of the Fifth International Symposium on Signal Processing and its Applications (IEEE Cat. No.99EX359).

[6]  Suchendra M. Bhandarkar,et al.  Motion-based parsing of compressed video , 1998, Proceedings International Workshop on Multi-Media Database Management Systems (Cat. No.98TB100249).

[7]  Jian Feng,et al.  Scene change detection algorithm for MPEG video sequence , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[8]  Sethuraman Panchanathan,et al.  Review of Image and Video Indexing Techniques , 1997, J. Vis. Commun. Image Represent..

[9]  Hang-Bong Kang.  A new content-based scene change detection method on compressed video , 1997, TENCON '97 Brisbane - Australia. Proceedings of IEEE TENCON '97. IEEE Region 10 Annual Conference. Speech and Image Technologies for Computing and Telecommunications (Cat. No.97CH36162).

[10]  Ralph M. Ford,et al.  Metrics for scene change detection in digital video sequences , 1997, Proceedings of IEEE International Conference on Multimedia Computing and Systems.

[11]  Wen-Chin Chen,et al.  Computational similarity based on chromatic barycenter algorithm , 1996 .

[12]  Riccardo Leonardi,et al.  Scene break detection: a comparison , 1998, Proceedings Eighth International Workshop on Research Issues in Data Engineering. Continuous-Media Databases and Applications.

[13]  K. N. Ngan,et al.  Performance of chromatic barycenter with MPEG elements for low-level shot boundary detection and its improvements , 1998 .

[14]  Warnakulasuriya Anil Chandana Fernando,et al.  Automatic detection of fade-in and fade-out in video sequences , 1999, ISCAS'99. Proceedings of the 1999 IEEE International Symposium on Circuits and Systems VLSI (Cat. No.99CH36349).

[15]  Nasser Kehtarnavaz,et al.  Real-Time Imaging VI , 2002 .

[16]  King Ngi Ngan,et al.  Comparison of MPEG Domain Elements for Low-Level Shot Boundary Detection , 1999, Real Time Imaging.

[17]  Gregory L. Zick,et al.  Scene decomposition of MPEG-compressed video , 1995, Electronic Imaging.

[18]  Akio Yoneyama,et al.  Universal scene change detection on MPEG-coded data domain , 1997, Electronic Imaging.

[19]  Stuart Jay Golin.  New metric to detect wipes and other gradual transitions in video , 1998, Electronic Imaging.

[20]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Jinwoong Kim,et al.  Hierarchical scene change detection in an MPEG-2 compressed video sequence , 1998, ISCAS '98. Proceedings of the 1998 IEEE International Symposium on Circuits and Systems (Cat. No.98CH36187).

[22]  Masaru Sugano,et al.  A fast scene change detection on MPEG coding parameter domain , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[23]  A. Murat Tekalp,et al.  Object-based indexing of MPEG-4 compressed video , 1997, Electronic Imaging.

[24]  Nilesh V. Patel,et al.  Compressed Video Processing for Cut Detection , 1996 .

[25]  Thomas D. C. Little,et al.  A Survey of Technologies for Parsing and Indexing Digital Video1 , 1996, J. Vis. Commun. Image Represent..