SHOT BOUNDARY DETECTION USING HILBERT TRANSFORM BASED FEATURES

The first and foremost step in the shot boundary detection is the extraction of features from the video sequences. To obtain better performance in shot boundary detection, a new method is proposed in this paper, where texture and local binary information extracted from the hilbert transformed frames are processed and represented as features. The similarity between the frames is constructed as continuity signal. The boundaries between the shots are identified by applying the shot transition identification procedure on the continuity signals. The proposed method is evaluated over the TRECVID 2007 SBD dataset and the performance is compared to the top performers of TRECVID 2007 SBD task.

[1]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[2]  Ramin Zabih,et al.  A feature-based algorithm for detecting and classifying scene breaks , 1995, MULTIMEDIA '95.

[3]  Rainer Lienhart,et al.  Comparison of automatic shot boundary detection algorithms , 1998, Electronic Imaging.

[4]  Wolfgang Effelsberg,et al.  The MoCA Project - Movie Content Analysis Research at the University of Mannheim , 1998, GI Jahrestagung.

[5]  Warnakulasuriya Anil Chandana Fernando,et al.  Fade and dissolve detection in uncompressed and compressed video sequences , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[6]  A. Salam.  Hilbert transform in image processing , 1999, ISIE '99. Proceedings of the IEEE International Symposium on Industrial Electronics (Cat. No.99TH8465).

[7]  Alan Hanjalic,et al.  Shot-boundary detection: unraveled and resolved? , 2002, IEEE Trans. Circuits Syst. Video Technol..

[8]  Eyas El-Qawasmeh,et al.  Scene Change Detection Schemes for Video Indexing in Uncompressed Domain , 2003, Informatica.

[9]  Yap-Peng Tan,et al.  An effective post-refinement method for shot boundary detection , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[10]  Yap-Peng Tan,et al.  Modified Kolmogorov-Smirnov metric for shot boundary detection , 2003 .

[11]  Alan F. Smeaton,et al.  A Comparison of Score, Rank and Probability-Based Fusion Methods for Video Shot Retrieval , 2005, CIVR.

[12]  Atreyi Kankanhalli,et al.  Automatic partitioning of full-motion video , 1993, Multimedia Systems.

[13]  Jeho Nam,et al.  Detection of gradual transitions in video sequences using B-spline interpolation , 2005, IEEE Transactions on Multimedia.

[14]  Ioannis Pitas,et al.  Information theory-based shot cut/fade detection and video summarization , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[15]  Prosenjit Bose,et al.  Feature-based cut detection with automatic threshold selection , 2006, TRECVID.

[16]  David C. Gibbon,et al.  AT&T Research at TRECVID 2006 , 2006, TRECVID.

[17]  Hui Fang,et al.  A fuzzy logic approach for detection of video shot boundaries , 2006, Pattern Recognit..

[18]  Dong-Sik Jang,et al.  Gradual shot boundary detection using localized edge blocks , 2006, Multimedia Tools and Applications.

[19]  Bede Liu,et al.  Temporal segmentation of video using frame and histogram space , 2000, IEEE Transactions on Multimedia.

[20]  Rainer Stiefelhagen,et al.  Universität Karlsruhe (TH) at TRECVID 2008 , 2008, TRECVID.

[21]  Juan Chen,et al.  Determination of Shot Boundary in MPEG Videos for TRECVID 2007 , 2007, TRECVID.

[22]  Dong Wang,et al.  THU and ICRC at TRECVID 2007 , 2007, TRECVID.

[23]  Bernd Freisleben,et al.  University of Marburg at TRECVID 2007: Shot Boundary Detection and High Level Feature Extraction , 2007, TRECVID.

[24]  Nobuyuki Yagi,et al.  Shot Boundary Detection at TRECVID 2007 , 2007, TRECVID.

[25]  Paul Over,et al.  TREC video retrieval evaluation TRECVID , 2008 .

[26]  Adrian Ulges,et al.  Keyframe Extraction for Video Tagging & Summarization , 2008, Informatiktage.

[27]  C.J.H. Mann,et al.  Color Image Processing – Methods and Applications , 2008 .

[28]  Donald A. Adjeroh,et al.  Adaptive Edge-Oriented Shot Boundary Detection , 2009, EURASIP J. Image Video Process..

[29]  Tudor Barbu,et al.  Novel automatic video cut detection technique using Gabor filtering , 2009, Comput. Electr. Eng..

[30]  Paul Over,et al.  Video shot boundary detection: Seven years of TRECVid activity , 2010, Comput. Vis. Image Underst..

[31]  Shiguo Lian,et al.  Automatic video temporal segmentation based on multiple features , 2011, Soft Comput..

[32]  Dejing Dou,et al.  Calculating Feature Weights in Naive Bayes with Kullback-Leibler Measure , 2011, 2011 IEEE 11th International Conference on Data Mining.