Shot-change detection based on multifractal analysis

This paper presents a new algorithm for detection of abrupt shot changes in video sequence based on Multifractal Analysis (MA). Video sequence is decoded into series of frames, and low level feature for texture and color are extracted from each of them. Content difference between adjacent frames is calculated based on correlation of frame low level features. MA is used for description of content difference arrays in multifractal singularity domain (α - domain) with emphasized local singularities. The detection of abrupt changes is realized using fixed thresholds technique and singularity shape analysis. Proposed algorithm is tested on more than 600 000 frames, with high efficiency of detection.

[1]  Benoit B. Mandelbrot,et al.  Fractal Geometry of Nature , 1984 .

[2]  Jenny Benois-Pineau,et al.  Shot Boundary Detection In The Framework of Rough Indexing Paradigm , 2004, TRECVID.

[3]  Kenneth Falconer,et al.  Fractal Geometry: Mathematical Foundations and Applications , 1990 .

[4]  Alan Hanjalic,et al.  Shot-boundary detection: unraveled and resolved? , 2002, IEEE Trans. Circuits Syst. Video Technol..

[5]  Duy-Dinh Le,et al.  A text segmentation based approach to video shot boundary detection , 2008, 2008 IEEE 10th Workshop on Multimedia Signal Processing.

[6]  Nacim Betrouni,et al.  Fractal and multifractal analysis: A review , 2009, Medical Image Anal..

[7]  Dong Wang,et al.  THU and ICRC at TRECVID 2007 , 2007, TRECVID.

[8]  Janko Calic,et al.  Temporal Segmentation of MPEG Video Streams , 2002, EURASIP J. Adv. Signal Process..

[9]  Pablo Toharia,et al.  Using Adaptive Thresholds for Automatic Video Cut Detection , 2004, TRECVID.

[10]  Aderemi A. Atayero,et al.  Detection of Teletraffic Anomalies Using Multifractal Analysis , 2011 .

[11]  I. Rakocevic,et al.  Multifractal analysis of gray-scale images , 2000, 2000 10th Mediterranean Electrotechnical Conference. Information Technology and Electrotechnology for the Mediterranean Countries. Proceedings. MeleCon 2000 (Cat. No.00CH37099).

[12]  Shengrui Wang,et al.  Motion Insensitive Detection of Cuts and Gradual Transitions in Digital Videos , 2002 .

[13]  Bohn Stafleu van Loghum,et al.  Online … , 2002, LOG IN.

[14]  N. Nikolaidis,et al.  Video shot detection and condensed representation. a review , 2006, IEEE Signal Processing Magazine.

[15]  John B. Shoven,et al.  I , Edinburgh Medical and Surgical Journal.

[16]  David C. Gibbon,et al.  AT&T Research at 2007 , 2007, TRECVID.

[17]  Christos Grecos,et al.  An improved rate control algorithm based on a novel shot detection scheme for the H.264/AVC standard , 2008, Journal of Real-Time Image Processing.

[18]  Stevan Rudinac,et al.  Accelerating of Image Retrieval in CBIR System with Relevance Feedback , 2007, EURASIP J. Adv. Signal Process..

[19]  Marcin Grzegorzek,et al.  Shot boundary detection using spectral clustering , 2007, 2007 15th European Signal Processing Conference.

[20]  Nihat Adar,et al.  Fractal Dimension Based Shot Transition Detection in Sport Videos , 2011, J. Softw. Eng. Appl..

[21]  Heinz-Otto Peitgen,et al.  Fractal geometry and analysis : the Mandelbrot festschrift, Curaçao 1995 , 1996 .

[22]  Hugh E. Williams,et al.  RMIT University at TRECVID 2004 , 2004, TRECVID.

[23]  John R. Smith,et al.  IBM Research TRECVID-2009 Video Retrieval System , 2009, TRECVID.

[24]  John Watkinson.  The MPEG handbook : MPEG-1, MPEG-2, MPEG-4 , 2001 .

[25]  Jun Li,et al.  DWT-Based Shot Boundary Detection Using Support Vector Machine , 2009, 2009 Fifth International Conference on Information Assurance and Security.

[26]  Rainer Stiefelhagen,et al.  Universität Karlsruhe (TH) at TRECVID 2008 , 2008, TRECVID.