A non parametric shot boundary detection: an eigen gap based approach

Shot boundary detection is one of the challenging and crucial task in designing video archival and retrieval system. Even though a good number of works on shot boundary detection can be found in the literature, still there is a need of developing novel shot boundary detection algorithms which can work in a real time environment. In this paper we present a novel, simple, non parametric shot boundary detection approach where eigen gap analysis is exploited to preserve the variations among the video frames. To detect different types of shot boundaries the concept of small eigen values on a curve obtained by plotting the variations of eigen gap across the video frames is used. To corroborate the efficacy of the proposed method an experimentation on a large set of video frames having different types of transitions is carried out. For experimentation, news, lecture and entertainment videos collected from the World Wide Web is used. Also a qualitative comparative analysis of the proposed method with other existing similar type of techniques has been provided in the paper.

[1]  Jirí Filip,et al.  Fast and reliable PCA-based temporal segmentation of video sequences , 2008, 2008 19th International Conference on Pattern Recognition.

[2]  Mahmood Fathy,et al.  Video Shot Boundary Detection Using QR-Decomposition and Gaussian Transition Detection , 2010, EURASIP J. Adv. Signal Process..

[3]  Rainer Lienhart,et al.  Scene Determination Based on Video and Audio Features , 2004, Multimedia Tools and Applications.

[4]  Atreyi Kankanhalli,et al.  Automatic partitioning of full-motion video , 1993, Multimedia Systems.

[5]  Joemon M. Jose,et al.  Shot Boundary Detection Based on Eigen Coefficients and Small Eigen Value , 2009, SAMT.

[6]  Nikolas P. Galatsanos,et al.  Simultaneous detection of abrupt cuts and dissolves in videos using support vector machines , 2009, Pattern Recognit. Lett..

[7]  Jun Li,et al.  DWT-Based Shot Boundary Detection Using Support Vector Machine , 2009, 2009 Fifth International Conference on Information Assurance and Security.

[8]  Özgür Ulusoy,et al.  Fuzzy color histogram-based video segmentation , 2010, Comput. Vis. Image Underst..

[9]  Marcel Worring,et al.  Systematic evaluation of logical story unit segmentation , 2002, IEEE Trans. Multim..

[10]  Ahmed H. Tewfik,et al.  Eigen-image based video segmentation and indexing , 1997, Proceedings of International Conference on Image Processing.

[11]  Ullas Gargi,et al.  Performance characterization of video-shot-change detection methods , 2000, IEEE Trans. Circuits Syst. Video Technol..

[12]  Rainer Lienhart,et al.  Reliable Transition Detection in Videos: A Survey and Practitioner's Guide , 2001, Int. J. Image Graph..

[13]  Nikolas P. Galatsanos,et al.  A Support Vector Machine Approach for Video Shot Detection , 2008, New Directions in Intelligent Interactive Multimedia.

[14]  King Ngi Ngan,et al.  An Object-Based Shot Boundary Detection Using Edge Tracing and Tracking , 2001, J. Vis. Commun. Image Represent..

[15]  Stefan Eickeler,et al.  MPEG-2 Compressed-Domain Algorithms for Video Analysis , 2006, EURASIP J. Adv. Signal Process..

[16]  Zhang Ming-xin,et al.  Effective Shot Segmentation Method Based on Rough Sets in Video Compressed Domain , 2009, CSIE.

[17]  Wei Zheng,et al.  Shot Boundary Detection and Keyframe Extraction Based on Scale Invariant Feature Transform , 2009, 2009 Eighth IEEE/ACIS International Conference on Computer and Information Science.

[18]  Xu De,et al.  Shot boundary detection based on Laplacian eigenmaps , 2004, Proceedings 7th International Conference on Signal Processing, 2004. Proceedings. ICSP '04. 2004..

[19]  Seungmin Rho,et al.  Content-based scene segmentation scheme for efficient multimedia information retrieval , 2009, Int. J. Wirel. Mob. Comput..

[20]  Zhi-Qiang Liu,et al.  Investigation on unsupervised clustering algorithms for video shot categorization , 2007, Soft Comput..

[21]  Rita Cucchiara,et al.  Shot Detection and Motion Analysis for Automatic MPEG-7 Annotation of Sports Videos , 2005, ICIAP.

[22]  Argyris Kalogeratos,et al.  Movie segmentation into scenes and chapters using locally weighted bag of visual words , 2009, CIVR '09.

[23]  Patrick Bouthemy,et al.  A unified approach to shot change detection and camera motion characterization , 1999, IEEE Trans. Circuits Syst. Video Technol..

[24]  Evangelos Pallis,et al.  Shot boundary detection without threshold parameters , 2006, J. Electronic Imaging.

[25]  Xiang Fu,et al.  An Effective Video Shot Boundary Detection Method Based on the Local Color Features of Interest Points , 2009, 2009 Second International Symposium on Electronic Commerce and Security.

[26]  Donald A. Adjeroh,et al.  Adaptive Edge-Oriented Shot Boundary Detection , 2009, EURASIP J. Image Video Process..

[27]  R. Dinesh,et al.  Non-parametric adaptive region of support useful for corner detection: a novel approach , 2004, Pattern Recognit..

[28]  Ting Liu,et al.  Video Segmentation via Temporal Pattern Classification , 2007, IEEE Transactions on Multimedia.

[29]  Marcin Grzegorzek,et al.  Shot boundary detection using spectral clustering , 2007, 2007 15th European Signal Processing Conference.

[30]  Alan Hanjalic,et al.  Shot-boundary detection: unraveled and resolved? , 2002, IEEE Trans. Circuits Syst. Video Technol..