Shot Boundary Detection and Keyframe Extraction Based on Scale Invariant Feature Transform

In shot boundary detection, the key technology is to compute the visual content discontinuity values between consecutive video frames. In this paper, a unified framework is proposed to detect the shot boundaries and extract the keyframes of a shot. Firstly, the Scale invariant feature transform (SIFT) is adopted to compute the visual content discontinuity values. Then a new method, which is called the Local Double Threshold Shot Boundary Detection (LDT-SBD), is used to detect shot boundaries. Lastly, two mechanisms are proposed to extract keyframe. Experimental results show the framework is effective and has a good performance.

[1]  Nicole Vincent,et al.  Efficient and robust shot change detection , 2007, Journal of Real-Time Image Processing.

[2]  Li Huan,et al.  A General Method for Shot Boundary Detection , 2008, 2008 International Conference on Multimedia and Ubiquitous Engineering (mue 2008).

[3]  Guo-Shiang Lin,et al.  An Effective Shot Boundary Detection Algorithm for Movies and Sports , 2008, 2008 3rd International Conference on Innovative Computing Information and Control.

[4]  Sang Wook Lee,et al.  Shot boundary detection using scale invariant feature matching , 2006, Electronic Imaging.

[5]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[6]  Glorianna Davenport,et al.  Cinematic primitives for multimedia , 1991, IEEE Computer Graphics and Applications.

[7]  Andrew P. Witkin,et al.  Scale-space filtering: A new approach to multi-scale description , 1984, ICASSP.

[8]  Alan Hanjalic,et al.  Content-Based Analysis of Digital Video , 2004, Springer US.