Adaptive Key Frames Selection Algorithms for Summarizing Video Data

As multimedia applications are rapidly spread at an ever-increasing rate, the call for efficient and effective methodologies for organizing and manipulating these data becomes a necessity. One of the basic problems that encounters such systems is to find efficient ways to summarize the huge amount of data involved. In this work two sets of algorithms are proposed in order to effectively select key frames from segmented video shots. The algorithms in both sets apply a two-level adaptation mechanism. The first level is done based on the size of the input MPEG file while the second level is performed on a shot-by-shot basis in order to account for the fact that different shots have different levels of activity inside them. Experimental results show the efficiency and robustness of the proposed algorithms in selecting the near optimal set of key frames required to represent each shot in the video stream.

[1]  Gregory K. Wallace,et al.  The JPEG still picture compression standard , 1991, CACM.

[2]  Thomas S. Huang,et al.  Browsing and retrieving video content in a unified framework , 1998, 1998 IEEE Second Workshop on Multimedia Signal Processing (Cat. No.98EX175).

[3]  Charles A. Bouman,et al.  ViBE video database system: an update and further studies , 1999, Electronic Imaging.

[4]  Boon-Lock Yeo,et al.  Rapid scene analysis on compressed video , 1995, IEEE Trans. Circuits Syst. Video Technol..

[5]  Mark S. Drew,et al.  Video keyframe production by efficient clustering of compressed chromaticity signatures (poster session) , 2000, ACM Multimedia.

[6]  Stefanos D. Kollias,et al.  A stochastic framework for optimal key frame extraction from MPEG video databases , 1999, 1999 IEEE Third Workshop on Multimedia Signal Processing (Cat. No.99TH8451).

[7]  Andreas Girgensohn,et al.  Time-Constrained Keyframe Selection Technique , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[8]  Waleed Farag,et al.  A New Paradigm for Detecting Scene Changes on MPEG Compressed Videos , 2001 .

[9]  Minerva M. Yeung,et al.  Efficient matching and clustering of video shots , 1995, Proceedings., International Conference on Image Processing.

[10]  D. Legall,et al.  MPEG : A video compression standard for multimedia applications , 1991 .

[11]  Stephen W. Smoliar,et al.  An integrated system for content-based video retrieval and browsing , 1997, Pattern Recognit..

[12]  Akio Nagasaka,et al.  Automatic Video Indexing and Full-Video Search for Object Appearances , 1991, VDB.

[13]  NagasakaAkio,et al.  Automatic video indexing and full-video search for object appearances (abstract) , 1992 .

[14]  Wayne H. Wolf,et al.  Key frame selection by motion analysis , 1996, 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings.

[15]  Alberto Del Bimbo,et al.  Visual information retrieval , 1999 .

[16]  Yueting Zhuang,et al.  Adaptive key frame extraction using unsupervised clustering , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[17]  Yoshinobu Tonomura,et al.  VideoMAP and VideoSpaceIcon: tools for anatomizing video content , 1993, INTERCHI.