Shot boundary detection and key-frame extraction from neurosurgical video sequences

Abstract In this work, we present a system for video shot boundary detection and key-frame extraction from video sequences based on colour histograms. The growth of archived video material has made automated indexing and browsing tools necessary. The aim of this paper is to provide a framework for such a video indexing and browsing tool. The proposed system segments video sequences based on colour similarity, and then extracts key-frames by clustering the images. Computations of colour histogram differences and self-similarity modelling have been performed in segmentation process. We have extracted three-, four- and five-frames video summaries with unsupervised k-means clustering. We have also dynamically determined the number of key-frames representing the video content without any prior information based on dominant set clustering. Our results show that our approach is successful in both segmentation and key-frame extraction processes.

[1]  Weichuan Yu,et al.  Three dimensional orientation signatures with conic kernel filtering for multiple motion analysis , 2003, Image Vis. Comput..

[2]  Sarah V. Porter,et al.  Video Segmentation and Indexing using Motion Estimation , 2004 .

[3]  Yun Q. Shi,et al.  Identifying Computer Graphics using HSV Color Model and Statistical Moments of Characteristic Functions , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[4]  Xin Liu,et al.  Video summarization using singular value decomposition , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[5]  Jonathan Foote,et al.  Scene boundary detection via video self-similarity analysis , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[6]  Otthein Herzog,et al.  Automatic Shot Boundary Detection and Classification of Indoor and Outdoor Scenes , 2002, TREC.

[7]  P. Toiviainen.  Visualization of Tonal Content in the Symbolic and Audio Domains , 2008 .

[8]  David G. Lowe,et al.  Three-Dimensional Object Recognition from Single Two-Dimensional Images , 1987, Artif. Intell..

[9]  Irena Koprinska,et al.  Temporal video segmentation: A survey , 2001, Signal Process. Image Commun..

[10]  Georgy Gimel’farb,et al.  Image Retrieval Using Colour Co-occurrence Histograms , 2003 .

[11]  Marcello Pelillo,et al.  Dominant sets and hierarchical clustering , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[12]  Zhao Huan,et al.  Shot Boundary Detection Based on Mutual Information and Canny Edge Detector , 2008, 2008 International Conference on Computer Science and Software Engineering.

[13]  Boon-Lock Yeo,et al.  Rapid scene analysis on compressed video , 1995, IEEE Trans. Circuits Syst. Video Technol..

[14]  Jasjit S. Suri,et al.  Handbook of Biomedical Image Analysis , 2005 .

[15]  Yueting Zhuang,et al.  Adaptive key frame extraction using unsupervised clustering , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).