Behavior key frame extraction using invariant moment and unsupervised clustering

Key frame extraction technique plays an important role in video analysis and content-based video retrieval. Key frame has been used to reduce the use of video indexing data greatly and it also provides a framework to video summaries and retrieval. This paper proposes a novel method based on invariant moments for key frame extraction, according to the changes of independent objectpsilas shape and brightness. We first extract a moving object from the video sequence and compute the invariant moments in the area. Then cluster consecutive frames of similar invariant moments by unsupervised clustering. Finally, extract the typical data from each cluster as the key frame. The experimental results of different scenes show the feasibility of this method.

[1]  Zhang Xiu-li Content-based Video Retrieval Techniques , 2004 .

[2]  Zhang Chun-qing Video Abstraction Technique Based on the Hierarchical Clustering Algorithm , 2004 .

[3]  Robert B. McGhee,et al.  Aircraft Identification by Moment Invariants , 1977, IEEE Transactions on Computers.

[4]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.

[5]  Stephen W. Smoliar,et al.  An integrated system for content-based video retrieval and browsing , 1997, Pattern Recognit..

[6]  Wayne H. Wolf,et al.  Key frame selection by motion analysis , 1996, 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings.

[7]  Demetri Psaltis,et al.  Image Normalization by Complex Moments , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.