Shot reconstruction degree: a novel criterion for key frame selection

Abstract In this paper, the authors treat the key frame extraction problem from a viewpoint of shot reconstruction. As a result, a novel criterion called shot reconstruction degree (SRD) is proposed for key frame selection based on the degree of retaining motion dynamics of a video shot. Compared with the widely used fidelity criterion, the key frame set produced by SRD can better capture the detailed dynamics of the shot. Using the new SRD criterion, a novel inflexion-based key frame selection algorithm is developed. Simulation results show that the new algorithm results in good performance in terms of both fidelity and shot reconstruction degree.

[1]  Azriel Rosenfeld,et al.  Extraction of key frames from videos by polygon simplification , 2001, Proceedings of the Sixth International Symposium on Signal Processing and its Applications (Cat.No.01EX467).

[2]  Sang Uk Lee,et al.  Efficient video indexing scheme for content-based retrieval , 1999, IEEE Trans. Circuits Syst. Video Technol..

[3]  Tie-Yan Liu,et al.  Dynamic selection and effective compression of key frames for video abstraction , 2003, Pattern Recognit. Lett..

[4]  Tie-Yan Liu,et al.  Frame interpolation scheme using inertia motion prediction , 2003, Signal Process. Image Commun..

[5]  Bernard Mérialdo,et al.  Comparison of Multiepisode Video Summarization Algorithms , 2003, EURASIP J. Adv. Signal Process..

[6]  Bernard Mérialdo,et al.  Image similarity for automatic video summarization , 2002, 2002 11th European Signal Processing Conference.

[7]  Seong-Dae Kim,et al.  Rate-driven key frame selection using temporal variation of visual content , 2002 .

[8]  Stephen W. Smoliar,et al.  Video parsing and browsing using compressed data , 1995, Multimedia Tools and Applications.

[9]  Gian Luca Foresti,et al.  Real-time thresholding with Euler numbers , 2003, Pattern Recognit. Lett..

[10]  Wayne H. Wolf,et al.  Key frame selection by motion analysis , 1996, 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings.

[11]  Jian Feng,et al.  Inertia-based cut detection technique: a step to the integration of video coding and content-based retrieval , 2000, WCC 2000 - ICSP 2000. 2000 5th International Conference on Signal Processing Proceedings. 16th World Computer Congress 2000.

[12]  Dragutin Petkovic,et al.  Content-Based Representation and Retrieval of Visual Media: A State-of-the-Art Review , 1996 .

[13]  Bernard Mérialdo,et al.  Comparison of multi-episode video summarisation algorithms , 2001, 2001 IEEE Fourth Workshop on Multimedia Signal Processing (Cat. No.01TH8564).