Automatic thumbnail extraction for DVR based on production technique estimation

The automatic recording function of DVR is a powerful tool for users. However, increase of the stored content makes it difficult to access desired content. To solve this issue, this paper proposes a new method of providing suitable thumbnails of TV programs by detecting important objects from them. Our approach is based on identifying typical shooting and editing techniques, which are estimated from camera motion and visual features density. The proposed method is independent of types of target object and it achieves detection accuracy of about 79%, which outperforms the existing object-dependent approaches. The method is applied to the prototype application on the DVR. It enables the user to find desired content intuitively and access important scenes easily.

[1]  Masayuki Kimura,et al.  Chapter generation for digital video recorder based on perceptual clustering , 2006, IEEE Transactions on Consumer Electronics.

[2]  D. Arijon,et al.  Grammar of Film Language , 1976 .

[3]  Masaru Sugano,et al.  Generic Summarization Technology for Consumer Video , 2004, PCM.

[4]  Christof Koch,et al.  Modeling attention to salient proto-objects , 2006, Neural Networks.

[5]  Xinghua Sun,et al.  Informedia @ TRECVID2008: Exploring New Frontiers , 2008, TRECVID.

[6]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[7]  C Tomasi,et al.  Shape and motion from image streams: a factorization method. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[8]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[9]  Keiichiro Hoashi,et al.  High-Level Feature Extraction Experiments for TRECVID 2007 , 2007, TRECVID.

[10]  Bin Zhang,et al.  BUPT at TRECVID 2008 , 2008, TRECVID.

[11]  Weisi Lin,et al.  Modeling visual attention's modulatory aftereffects on visual sensitivity and quality evaluation , 2005, IEEE Transactions on Image Processing.

[12]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.