Digital library creation based on wavelet coefficients for video stream indexing and retrieving

The increased availability and usage of on-line digital video has created a need for automated video content analysis techniques including indexing and retrieving. Most research on video content involves automatically detecting the boundaries between camera shots. After shot detection there is a need for shots indexing in a library which enables retrieving for the required stream based on shot. There is a need to build an efficient digital library for those shots, saving the proper features for each shot/frames, which will enable efficient retrieval for user's requirement. This paper presents an automation technique for video indexing and creation of a digital library. We will present how to detect shots cuts and features, which will be saved for the video shots/frames. Also build a video digital library composed of the stream shots/frames plus wavelet coefficients for video stream shot's key or all frames (for full search function in all frames of the indexed video). The digital library represents full video streams frames indexed into shots with overhead in the stored size just 16.2 % as wavelet coefficients. The retrieving efficiency for a shot while having an input frame is ranged from 100%, if the input frame is saved keyframe, down to 94% if the input frame is any other frame. Our digital library is valid for any number of video streams, any number of shots/ streams and any number of frames/shot.

[1]  Nasser Kehtarnavaz,et al.  Real-Time Image and Video Processing: From Research to Reality , 2006, Real-Time Image and Video Processing: From Research to Reality.

[2]  Ji-Wei Liu,et al.  Automatic scene change detection for h.264 video coding , 2007, 2007 International Conference on Wavelet Analysis and Pattern Recognition.

[3]  Francesca Odone,et al.  A Sparsity-Enforcing Method for Learning Face Features , 2009, IEEE Transactions on Image Processing.

[4]  Yves Meyer,et al.  Wavelets - tools for science and technology , 1987 .

[5]  James S. Walker,et al.  A Primer on Wavelets and Their Scientific Applications , 1999 .

[6]  Zhou Shunyong,et al.  A System of Video Shot Detection Using Multi-stage Algorithm , 2009, 2009 International Conference on Information Technology and Computer Science.

[7]  Kuan-sheng Zou,et al.  Improved SPIHT Algorithm Based on Associative Memory Neural Network and Human Visual System , 2008, 2008 International Conference on Intelligent Computation Technology and Automation (ICICTA).

[8]  Mark S. Nixon,et al.  Feature Extraction and Image Processing , 2002 .

[9]  Sujit K. Ghosh,et al.  Essential Wavelets for Statistical Applications and Data Analysis , 2001, Technometrics.

[10]  Stéphane Jaffard,et al.  Wavelets: Tools for Science & Technology , 1987 .

[11]  Xiangdong Zhou,et al.  A Novel Active Learning Approach for SVM Based Web Image Retrieval , 2007, PCM.

[12]  Xiaofan Yang,et al.  iDistance Based Interactive Visual Surveillance Retrieval Algorithm , 2008, 2008 International Conference on Intelligent Computation Technology and Automation (ICICTA).

[13]  Nouna Kettaneh,et al.  Statistical Modeling by Wavelets , 1999, Technometrics.

[14]  Gang Song,et al.  Object Detection Combining Recognition and Segmentation , 2007, ACCV.

[15]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[16]  Lai-Man Po,et al.  A Novel Fast Motion Estimation Algorithm Based on SSIM for H.264 Video Coding , 2007, PCM.

[17]  C. Morand,et al.  Object-Based Indexing of Compressed Video Content: From SD to HD Video , 2007, 14th International Conference of Image Analysis and Processing - Workshops (ICIAPW 2007).

[18]  Wenbin Chen,et al.  Three-Stage Motion Deblurring from a Video , 2007, ACCV.

[19]  William J. Christmas,et al.  Video Shot Cut Detection using Adaptive Thresholding , 2000, BMVC.

[20]  Du-Ming Tsai,et al.  Independent Component Analysis-Based Background Subtraction for Indoor Surveillance , 2009, IEEE Transactions on Image Processing.