Video Shot Boundary Detection Using QR-Decomposition and Gaussian Transition Detection

This article explores the problem of video shot boundary detection and examines a novel shot boundary detection algorithm by using QR-decomposition and modeling of gradual transitions by Gaussian functions. Specifically, the authors attend to the challenges of detecting gradual shots and extracting appropriate spatiotemporal features that affect the ability of algorithms to efficiently detect shot boundaries. The algorithm utilizes the properties of QR-decomposition and extracts a block-wise probability function that illustrates the probability of video frames to be in shot transitions. The probability function has abrupt changes in hard cut transitions, and semi-Gaussian behavior in gradual transitions. The algorithm detects these transitions by analyzing the probability function. Finally, we will report the results of the experiments using large-scale test sets provided by the TRECVID 2006, which has assessments for hard cut and gradual shot boundary detection. These results confirm the high performance of the proposed algorithm.

[1]  Noel E. O'Connor,et al.  Evaluating and combining digital video shot boundary detection algorithms , 2000 .

[2]  Ioannis Pitas,et al.  Information theory-based shot cut/fade detection and video summarization , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  Dragutin Petkovic,et al.  Query by Image and Video Content: The QBIC System , 1995, Computer.

[4]  Rita Cucchiara,et al.  Linear Transition Detection as a Unified Shot Detection Approach , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Otthein Herzog,et al.  Advanced And Adapted Shot Boundary Detection , 2001 .

[6]  Li Huan,et al.  A Method for Fast Shot Boundary Detection Based on SVM , 2008, 2008 Congress on Image and Signal Processing.

[7]  Xin Liu,et al.  Video shot segmentation and classification , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[8]  Ioannis Pitas,et al.  Content-based video parsing and indexing based on audio-visual interaction , 2001, IEEE Trans. Circuits Syst. Video Technol..

[9]  Myron Flickner,et al.  Query by Image and Video Content , 1995 .

[10]  Diane J. Cook,et al.  Automatic Video Classification: A Survey of the Literature , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[11]  Alan Hanjalic,et al.  Shot-boundary detection: unraveled and resolved? , 2002, IEEE Trans. Circuits Syst. Video Technol..

[12]  Okyay Kaynak,et al.  Complexity reduction of rule based models: a survey , 2002, 2002 IEEE World Congress on Computational Intelligence. 2002 IEEE International Conference on Fuzzy Systems. FUZZ-IEEE'02. Proceedings (Cat. No.02CH37291).

[13]  Alvaro Pardo Probabilistic Shot Boundary Detection Using Interframe Histogram Differences , 2006, CIARP.

[14]  Lihi Zelnik-Manor,et al.  Temporal Factorization vs. Spatial Factorization , 2004, ECCV.

[15]  Jian Yuan,et al.  A shot boundary detection method for news video based on object segmentation and tracking , 2008, 2008 International Conference on Machine Learning and Cybernetics.

[16]  Rainer Lienhart,et al.  Comparison of automatic shot boundary detection algorithms , 1998, Electronic Imaging.

[17]  Nilesh V. Patel,et al.  Video shot detection and characterization for video databases , 1997, Pattern Recognit..

[18]  Shih-Fu Chang,et al.  A fully automated content-based video search engine supporting spatiotemporal queries , 1998, IEEE Trans. Circuits Syst. Video Technol..

[19]  Alan Hanjalic,et al.  Optimal shot boundary detection based on robust statistical models , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[20]  Paul England,et al.  Comparison of automatic video segmentation algorithms , 1996, Other Conferences.

[21]  Ting Liu,et al.  Video Segmentation via Temporal Pattern Classification , 2007, IEEE Transactions on Multimedia.

[22]  Amarnath Gupta,et al.  Virage video engine , 1997, Electronic Imaging.

[23]  Thomas D. C. Little,et al.  A Survey of Technologies for Parsing and Indexing Digital Video1 , 1996, J. Vis. Commun. Image Represent..

[24]  Soo-Chang Pei,et al.  Efficient MPEG Compressed Video Analysis Using Macroblock Type Information , 1999, IEEE Trans. Multim..

[25]  Robert Babuska,et al.  Rule base reduction: some comments on the use of orthogonal transforms , 2001, IEEE Trans. Syst. Man Cybern. Syst..

[26]  André Zaccarin,et al.  A system for reliable dissolve detection in videos , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[27]  Nuno Vasconcelos,et al.  Statistical models of video structure for content analysis and characterization , 2000, IEEE Trans. Image Process..

[28]  M. Fathy,et al.  A QR decomposition based mixture model algorithm for background modeling , 2007, 2007 6th International Conference on Information, Communications & Signal Processing.

[29]  Xin Liu,et al.  Video summarization and retrieval using singular value decomposition , 2003, Multimedia Systems.

[30]  N. Nikolaidis,et al.  Video shot detection and condensed representation. a review , 2006, IEEE Signal Processing Magazine.

[31]  Chung-Lin Huang,et al.  A robust scene-change detection method for video segmentation , 2001, IEEE Trans. Circuits Syst. Video Technol..

[32]  Gene H. Golub,et al.  Matrix computations , 1983 .

[33]  Ioannis Pitas,et al.  Video shot-boundary detection using singular-value decomposition and statistical tests , 2007, J. Electronic Imaging.

[34]  Rainer Lienhart,et al.  Reliable Transition Detection in Videos: A Survey and Practitioner's Guide , 2001, Int. J. Image Graph..

[35]  Bo Zhang,et al.  A Formal Study of Shot Boundary Detection , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[36]  Ying Chen,et al.  Co-histogram and its application in video analysis , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[37]  De Xu,et al.  Information Theoretic Metrics in Shot Boundary Detection , 2005, KES.