Shot-Based Keyframe Extraction Using Bitwise-XOR Dissimilarity Approach

Keyframe extraction is an essential task in many video analysis applications such as video summarization, video classification, video indexing and retrieval. In this paper, a method of extracting keyframes from the shots using bitwise XOR dissimilarity has been proposed. The task of segmenting continuous video into shots and selection of key frames from segmented shots has been addressed. The above task has been accomplished through a feature extraction technique, based on bitwise XOR operation between consecutive gray scale frames of the video. Thresholding mechanism is employed to segment the videos into shots. Dissimilarity matrix is constructed to select a representative keyframe from every shot of a video sequence. The proposed shot boundary detection and keyframe extraction approach is implemented and evaluated on a subset of TRECVID 2001 data set. The proposed approach outperform other contemporary approaches in terms of efficiency and accuracy. Also, the experimental results on the data set have demonstrated the efficacy of the proposed keyframe extraction technique in terms of fidelity measure.

[1]  Chia-Hung Yeh,et al.  Techniques for movie content analysis and skimming: tutorial and overview on video abstraction techniques , 2006, IEEE Signal Processing Magazine.

[2]  Sung Wook Baik,et al.  Adaptive key frame extraction for video summarization using an aggregation mechanism , 2012, J. Vis. Commun. Image Represent..

[3]  Donald A. Adjeroh,et al.  Adaptive Edge-Oriented Shot Boundary Detection , 2009, EURASIP J. Image Video Process..

[4]  S. Domnic,et al.  Shot based keyframe extraction for ecological video indexing and retrieval , 2014, Ecol. Informatics.

[5]  Jin Liu,et al.  An adaptive video shot segmentation scheme based on dual-detection model , 2013, Neurocomputing.

[6]  Raimondo Schettini,et al.  Erratum to: An innovative algorithm for key frame extraction in video summarization , 2006, Journal of Real-Time Image Processing.

[7]  Li Li,et al.  A Survey on Visual Content-Based Video Indexing and Retrieval , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[8]  Harry W. Agius,et al.  Video summarisation: A conceptual framework and survey of the state of the art , 2008, J. Vis. Commun. Image Represent..

[9]  Boon-Lock Yeo,et al.  Video visualization for compact presentation and fast browsing of pictorial content , 1997, IEEE Trans. Circuits Syst. Video Technol..

[10]  Yelena Yesha,et al.  Keyframe-based video summarization using Delaunay clustering , 2006, International Journal on Digital Libraries.

[11]  Shang-Hong Lai,et al.  Integrated video shot segmentation algorithm , 2003, IS&T/SPIE Electronic Imaging.

[12]  K. P. Uma,et al.  Kirsch Directional Derivatives Based Shot Boundary Detection: An Efficient and Accurate Method , 2015 .

[13]  Marco Pellegrini,et al.  STIMO: STIll and MOving video storyboard for the web scenario , 2009, Multimedia Tools and Applications.

[14]  Andreas Girgensohn,et al.  Time-Constrained Keyframe Selection Technique , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[15]  Ioannis Pitas,et al.  Information theory-based shot cut/fade detection and video summarization , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[16]  Tudor Barbu,et al.  Novel automatic video cut detection technique using Gabor filtering , 2009, Comput. Electr. Eng..

[17]  Ba Tu Truong,et al.  Video abstraction: A systematic review and classification , 2007, TOMCCAP.

[18]  George Economou,et al.  Combining graph connectivity & dominant set clustering for video summarization , 2009, Multimedia Tools and Applications.

[19]  Yueting Zhuang,et al.  Adaptive key frame extraction using unsupervised clustering , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[20]  Xin Liu,et al.  Generating optimal video summaries , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[21]  Serkan Kiranyaz,et al.  A perceptual scheme for fully automatic video shot boundary detection , 2014, Signal Process. Image Commun..

[22]  Shiguo Lian,et al.  Automatic video temporal segmentation based on multiple features , 2011, Soft Comput..

[23]  Dong-Sik Jang,et al.  Gradual shot boundary detection using localized edge blocks , 2006, Multimedia Tools and Applications.

[24]  Sang Uk Lee,et al.  Efficient video indexing scheme for content-based retrieval , 1999, IEEE Trans. Circuits Syst. Video Technol..

[25]  Mahmood Fathy,et al.  Hierarchical Keyframe-based Video Summarization Using QR-Decomposition and Modified -Means Clustering , 2010, EURASIP J. Adv. Signal Process..

[26]  Özgür Ulusoy,et al.  Fuzzy color histogram-based video segmentation , 2010, Comput. Vis. Image Underst..

[27]  Danny Crookes,et al.  Advances in Video Summarization and Skimming , 2009 .

[28]  Abdellatif Mtibaa,et al.  Video shot boundary detection using motion activity descriptor , 2010, ArXiv.