Efficient Shot Boundary Detection Based on Scale Invariant Features

Shot boundary detection is an important fundamental process in video analysis. A novel shot boundary detection is proposed in this paper. To improve the performance of the algorithm and reduce the computational cost, frames that are clearly not shot boundaries are first removed from the original video. After that, new features are proposed to capture the changing statistics of different kinds of shot transitions so as to identify, not only abrupt shot transitions, but also gradual transitions accordingly. At last, use different algorithms for different kinds of shot transitions to help us to get a better solution for shot boundary detection problem. Numerical experiments in a variety of videos demonstrate that our method is capable of accurately detecting shot transitions, and could greatly reduce the computational cost.

[1]  Rita Cucchiara,et al.  Linear Transition Detection as a Unified Shot Detection Approach , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  Zhao Huan,et al.  Shot Boundary Detection Based on Mutual Information and Canny Edge Detector , 2008, 2008 International Conference on Computer Science and Software Engineering.

[3]  Gary Marchionini,et al.  Open video: A framework for a test collection , 2000, J. Netw. Comput. Appl..

[4]  Sang Wook Lee,et al.  Efficient Shot Boundary Detection for Action Movies Using Blockwise Motion-Based Features , 2005, ISVC.

[5]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[6]  Bo Zhang,et al.  A Formal Study of Shot Boundary Detection , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  Ponnuthurai N. Suganthan,et al.  An Accumulation Algorithm for Video Shot Boundary Detection , 2004, Multimedia Tools and Applications.

[8]  Alan Hanjalic,et al.  Shot-boundary detection: unraveled and resolved? , 2002, IEEE Trans. Circuits Syst. Video Technol..

[9]  Angelo Chianese,et al.  Foveated shot detection for video segmentation , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[10]  Xuelong Hu,et al.  Video object matching based on SIFT algorithm , 2008, 2008 International Conference on Neural Networks and Signal Processing.

[11]  N. Nikolaidis,et al.  Video shot detection and condensed representation. a review , 2006, IEEE Signal Processing Magazine.

[12]  Dai Xiao-wen An Algorithm of Video Shot Detection Based on Partitioning Image Wavelet Entropy , 2008 .

[13]  Atreyi Kankanhalli,et al.  Automatic partitioning of full-motion video , 1993, Multimedia Systems.

[14]  Nikolas P. Galatsanos,et al.  Simultaneous detection of abrupt cuts and dissolves in videos using support vector machines , 2009, Pattern Recognit. Lett..

[15]  Hong Heather Yu,et al.  A Hierarchical Multiresolution Video Shot Transition Detection Scheme , 1999, Comput. Vis. Image Underst..

[16]  Nobuyuki Yagi,et al.  Shot Boundary Detection at TRECVID 2007 , 2007, TRECVID.

[17]  Li Huan,et al.  A General Method for Shot Boundary Detection , 2008, 2008 International Conference on Multimedia and Ubiquitous Engineering (mue 2008).

[18]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .