TV Commercial Detection Based on Shot Change and Text Extraction

A new algorithm is proposed for TV commercial detection from color video in this paper. High shot change frequency and "still" shots of the trademark information, which are two basic characteristics of TV commercial, are exploited to distinguish commercials from general programs. Our commercial retrieval system based on shot change and text detection is realized through a slide window. First, histogram difference is computed on consecutive images and then the four common shot transitions including cut, dissolve, fade in/out and wipe are detected. Our text detection algorithm based on maximum gradient difference, allows fast filtering of scan lines without text. A commercial is determined either if its shot change frequency is satisfied or if its trademark information is detected. Performance evaluation shows that our algorithm performs well with relatively high detection accuracy for different kinds of programs when we involved the text detection, which is an important contribution of this paper.

[1]  Ramin Zabih,et al.  A feature-based algorithm for detecting and classifying scene breaks , 1995, MULTIMEDIA '95.

[2]  Anil K. Jain,et al.  Locating text in complex color images , 1995, Pattern Recognit..

[3]  Edward K. Wong,et al.  A new robust algorithm for video text extraction , 2003, Pattern Recognit..

[4]  Shumeet Baluja,et al.  Advertisement Detection and Replacement using Acoustic and Visual Repetition , 2006, 2006 IEEE Workshop on Multimedia Signal Processing.

[5]  Nicole Vincent,et al.  A review of real-time segmentation of uncompressed video sequences for content-based search and retrieval , 2003, Real Time Imaging.

[6]  Edward M. Riseman,et al.  TextFinder: An Automatic System to Detect and Recognize Text In Images , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Lie Lu,et al.  Robust learning-based TV commercial detection , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[8]  Anil K. Jain,et al.  Text information extraction in images and video: a survey , 2004, Pattern Recognit..

[9]  B. Satterwhite,et al.  Automatic detection of TV commercials , 2004, IEEE Potentials.

[10]  John M. Gauch,et al.  Identification of new commercials using repeated video sequence detection , 2005, IEEE International Conference on Image Processing 2005.

[11]  Chong-Wah Ngo,et al.  On clustering and retrieval of video shots through temporal slices analysis , 2002, IEEE Trans. Multim..