Finding and identifying unknown commercials using repeated video sequence detection

Automated commercial detection can be performed by matching features extracted from commercials or by detecting embedded codes that are hidden within the commercial. In both cases, it is necessary to create a database of known commercials that contain the information necessary for detection. In this paper, we present an automated technique for locating previously unknown commercials by continuously monitoring broadcast television signals. Our system has two components: repeated video sequence detection, and feature-based classification of video sequences as commercials or non-commercials. Our system utilizes customized temporal video segmentation techniques to automatically partition the digital video signal into semantically sensible shots and scenes. As each frame of the video source is processed, we extract auxiliary information to facilitate repeated sequence detection. When the video transition marking the end of the shot/scene is detected, we are able to rapidly locate all previous occurrences of the video clip. In order to classify video sequences as commercials or non-commercials, we extract a number of features from each video sequence that characterize the temporal and chromatic variations within the clip. We have evaluated three classification approaches using this information and have consistently achieved over 93% accuracy identifying new commercials and non-commercials as they are broadcast.

[1]  Z. Meral Özsoyoglu,et al.  Indexing large metric spaces for similarity search queries , 1999, TODS.

[2]  Michael J. Swain,et al.  Color indexing , 1991, International Journal of Computer Vision.

[3]  John M. Gauch,et al.  Story tracking in video news broadcasts , 2004 .

[4]  Ramin Zabih,et al.  A feature-based algorithm for detecting and classifying production effects , 1999, Multimedia Systems.

[5]  Michael J. Witbrock,et al.  Story segmentation and detection of commercials in broadcast news video , 1998, Proceedings IEEE International Forum on Research and Technology Advances in Digital Libraries -ADL'98-.

[6]  Wolfgang Effelsberg,et al.  On the detection and recognition of television commercials , 1997, Proceedings of IEEE International Conference on Multimedia Computing and Systems.

[7]  Ramin Zabih,et al.  A feature-based algorithm for detecting and classifying scene breaks , 1995, MULTIMEDIA '95.

[8]  Tao Qin,et al.  Time-constraint boost for TV commercials detection , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[9]  Grainne Gormley.  Scene Break Detection Classification In Digital Video Sequences , 1999 .

[10]  Alan F. Smeaton,et al.  An evaluation of alternative techniques for automatic detection of shot boundaries in digital video , 1999 .

[11]  Ullas Gargi,et al.  Evaluation of video sequence indexing and hierarchical video indexing , 1995, Electronic Imaging.

[12]  John M. Gauch,et al.  Real time repeated video sequence identification , 2004, Comput. Vis. Image Underst..

[13]  Justin Zobel,et al.  Fast video matching with signature alignment , 2003, MIR '03.

[14]  Edward J. Delp,et al.  Video scene change detection using the generalized sequence trace , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[15]  Jonathan Foote,et al.  Scene boundary detection via video self-similarity analysis , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[16]  Shin Satoh.  News video analysis based on identical shot detection , 2002, Proceedings. IEEE International Conference on Multimedia and Expo.

[17]  J. David Schaffer,et al.  Evolvable visual commercial detector , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[18]  Regunathan Radhakrishnan,et al.  Audio-visual event detection based on mining of semantic audio-visual labels , 2003, IS&T/SPIE Electronic Imaging.

[19]  Angelo Chianese,et al.  Foveated shot detection for video segmentation , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[20]  Noel E. O'Connor,et al.  Audio and video processing for automatic TV advertisement detection , 2001 .

[21]  Chaman L. Sabharwal,et al.  Perfect hash table algorithm for image databases using negative associated values , 1995, Pattern Recognit..

[22]  박상현,et al.  Similarity-Based Subsequence Search in Image Sequence Databases , 2003 .

[23]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[24]  Atreyi Kankanhalli,et al.  Automatic partitioning of full-motion video , 1993, Multimedia Systems.

[25]  John R. Smith,et al.  IBM Research TRECVID-2009 Video Retrieval System , 2009, TRECVID.

[26]  Akio Nagasaka,et al.  Automatic Video Indexing and Full-Video Search for Object Appearances , 1991, VDB.

[27]  Pinar Duygulu Sahin,et al.  Comparison and combination of two novel commercial detection methods , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[28]  Peter J. L. van Beek,et al.  Detection of slow-motion replay segments in sports video for highlights generation , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[29]  Ichiro Ide,et al.  Visualizing the Structure of a Large-Scale News Video Corpus Based on Topic Segmentation and Tracking , 2002 .

[30]  K. Wakimoto,et al.  Efficient and Effective Querying by Image Content , 1994 .

[31]  Marios Hadjieleftheriou,et al.  R-Trees - A Dynamic Index Structure for Spatial Searching , 2008, ACM SIGSPATIAL International Workshop on Advances in Geographic Information Systems.

[32]  Vishal Chitkara.  Color-Based Image Retrieval Using Compact Binary Signatures , 2001 .

[33]  Jordi Vitrià,et al.  Local Color Analysis for Scene Break Detection Applied to TV Commercials Recognition , 1999, VISUAL.

[34]  Ba Tu Truong,et al.  New enhancements to cut, fade, and dissolve detection processes in video segmentation , 2000, ACM Multimedia.

[35]  Edward J. Delp,et al.  A fast algorithm for video parsing using MPEG compressed sequences , 1995, Proceedings., International Conference on Image Processing.

[36]  Ramesh C. Jain,et al.  Digital video segmentation , 1994, MULTIMEDIA '94.

[37]  David A. Forsyth,et al.  Towards auto-documentary: tracking the evolution of news stories , 2004, MULTIMEDIA '04.

[38]  Chaman L. Sabharwal,et al.  Near perfect hash table for image databases , 1996, SAC '96.

[39]  Ton Kalker,et al.  Visual hashing of digital video: applications and techniques , 2001, Optics + Photonics.