Key Frame Extraction from Video: Framework and Advances

A complete overview of key frame extraction techniques has been provided. It has been found out that such techniques usually have three phases, namely shot boundary detection as a pre-processing phase, main phase of key frame detection, where visual, structural, audio and textual features are extracted from each frame, then processed and analyzed with artificial intelligence methods, and the last post-processing phase lies in removal of duplicates if they occur in the resulting sequence of key frames. Estimation techniques and available test video collections have been also observed. At the end, conclusions concerning drawbacks of the examined procedure and basic tendencies of its development have been marked.

[1]  Huiyu Zhou,et al.  Feature extraction and clustering for dynamic video summarisation , 2010, Neurocomputing.

[2]  O. Mikhnova,et al.  KEY FRAME PARTITION MATCHING FOR VIDEO SUMMARIZATION , 2013 .

[3]  Hamidreza Rashidy Kanan,et al.  AVCD-FRA: A novel solution to automatic video cut detection using fuzzy-rule-based approach , 2013, Comput. Vis. Image Underst..

[4]  David A. Cieslak,et al.  Hellinger distance decision trees are robust and skew-insensitive , 2011, Data Mining and Knowledge Discovery.

[5]  Michael J. Swain,et al.  Color indexing , 1991, International Journal of Computer Vision.

[6]  Jurandy Almeida,et al.  VISON: VIdeo Summarization for ONline applications , 2012, Pattern Recognit. Lett..

[7]  Paul Over,et al.  Video shot boundary detection: Seven years of TRECVid activity , 2010, Comput. Vis. Image Underst..

[8]  Zhe-Ming Lu,et al.  Video abstraction based on the visual attention model and online clustering , 2013, Signal Process. Image Commun..

[9]  Khushboo Khurana.  Video Annotation Methodology Based on Ontology for Transportation Domain , 2013 .

[10]  Ramesh C. Jain,et al.  A survey on the use of pattern recognition methods for abstraction, indexing and retrieval of images and video , 2002, Pattern Recognit..

[11]  Guozhu Liu,et al.  Key Frame Extraction from MPEG Video Stream , 2010, 2010 Third International Symposium on Information Processing.

[12]  Sung Wook Baik,et al.  Adaptive key frame extraction for video summarization using an aggregation mechanism , 2012, J. Vis. Commun. Image Represent..

[13]  Saurabh Thakare.  Intelligent Processing and Analysis of Image for Shot Boundary Detection , 2012 .

[14]  J. J. Magdum,et al.  An Algorithm for Shot Boundary Detection and Key Frame Extraction Using Histogram Difference , 2013 .

[15]  Jinchang Ren,et al.  Activity-driven content adaptation for effective video summarization , 2010, J. Vis. Commun. Image Represent..

[16]  Qi Tian,et al.  Video Repeat Recognition and Mining by Visual Features , 2010, Video Search and Mining.

[17]  Ling Shao,et al.  Boosted key-frame selection and correlated pyramidal motion-feature representation for human action recognition , 2013, Pattern Recognit..

[18]  Sergii Mashtalir,et al.  ON-LINE VIDEO SEGMENTATION USING METHODS OF FAULT DETECTION IN MULTIDIMENSIONAL TIME SEQUENCES , 2012 .

[19]  Bin Liang,et al.  Design of Video Retrieval System Using MPEG-7 Descriptors , 2012 .

[20]  Sung Wook Baik,et al.  Efficient visual attention based framework for extracting key frames from videos , 2013, Signal Process. Image Commun..

[21]  Magda B. Fayk,et al.  Particle swarm optimisation based video abstraction , 2010 .

[22]  Dim P. Papadopoulos,et al.  Automatic summarization and annotation of videos with lack of metadata information , 2013, Expert Syst. Appl..

[23]  Zhicheng Wei,et al.  Genetic Keyframe Extraction for Soccer Video , 2011 .

[24]  Yongzhao Zhan,et al.  Shot retrieval based on fuzzy evolutionary aiNet and hybrid features , 2011, Comput. Hum. Behav..

[25]  Guo-Shiang Lin,et al.  Detection of Frame Duplication Forgery in Videos Based on Spatial and Temporal Analysis , 2012, Int. J. Pattern Recognit. Artif. Intell..

[26]  Antonio Bandera,et al.  Spatio-temporal feature-based keyframe detection from video shots using spectral clustering , 2013, Pattern Recognit. Lett..

[27]  Yongkun Wang,et al.  An Improved Keyframe Extraction Method Based on HSV Colour Space , 2013, J. Softw..