Video Shot Detection based on SIFT Features and Video Summarization using Expectation-Maximization

Video Shot Detection is utilized to detect change of scene in the video. Video Summarization gives most useful frames to create the conceptual information of the given video. In this paper, we have coordinated both the ideas of shot detection and summarization for the better result of the outcomes. The SIFT features are extracted from the frames and compared with consecutive frames for Video Shot detection and the Video Summarization is done using Expected-Maximization. The shot frames of Video shot detection are utilized as contribution for the Video Summarization. The quality metric parameters are utilized to assess the strength of the key frame extraction.

[1]  Junsong Yuan,et al.  Video Summarization via Multi-view Representative Selection , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[2]  Dipti Jadhav,et al.  SURF based video summarization and its optimization , 2017, 2017 International Conference on Communication and Signal Processing (ICCSP).

[3]  Hyunwoo Nam,et al.  Content adaptive video summarization using spatio-temporal features , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[4]  Wei Zheng,et al.  Shot Boundary Detection and Keyframe Extraction Based on Scale Invariant Feature Transform , 2009, 2009 Eighth IEEE/ACIS International Conference on Computer and Information Science.

[5]  Jharna Majumdar,et al.  Video shot detection in transform domain , 2017, 2017 2nd International Conference for Convergence in Technology (I2CT).

[6]  Youness Tabii,et al.  Video Shot Boundary Detection using the Scale Invariant Feature Transform and RGB Color Channels , 2017 .

[7]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[8]  Karim Afdel,et al.  Efficient Video Summarization Based on Motion SIFT-Distribution Histogram , 2016, 2016 13th International Conference on Computer Graphics, Imaging and Visualization (CGiV).

[9]  Boqing Gong,et al.  Query-Focused Video Summarization: Dataset, Evaluation, and a Memory Network Based Approach , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Jharna Majumdar,et al.  Analysis of video shot detection using Color Layout Descriptor and video summarization based on Expectation-Maximization Clustering , 2015, 2015 International Conference on Cognitive Computing and Information Processing(CCIP).

[11]  Shaohui Mei,et al.  Video summarization via temporal collaborative representation of adjacent frames , 2017, 2017 International Symposium on Intelligent Signal Processing and Communication Systems (ISPACS).

[12]  Yi Huo,et al.  Effective algorithms for video shot and scene boundaries detection , 2016, 2016 IEEE/ACIS 15th International Conference on Computer and Information Science (ICIS).

[13]  G. G. Lakshmi Priya,et al.  Local Binary Pattern Based Shot Boundary Detection for Video Summarization , 2017, 2017 Second International Conference on Recent Trends and Challenges in Computational Models (ICRTCCM).

[14]  Jin Tang,et al.  Selecting attentive frames from visually coherent video chunks for surveillance video summarization , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[15]  Shaohui Mei,et al.  Exploring the influence of feature representation for dictionary selection based video summarization , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[16]  Svetlana Lazebnik,et al.  Enhancing Video Summarization via Vision-Language Embedding , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Santos Anderson Carlos Sousa e,et al.  Adaptive video shot detection improved by fusion of dissimilarity measures , 2016 .