Image Segmentation and Geometric Feature Based Approach for Fast Video Summarization of Surveillance Videos

In this paper, we propose a geometric feature and frame segmentation based approach for video summarization. Video summarization aims to generate a summarized video with all the salient activities of the input video. We propose to retain the salient frames towards generation of video summary. We detect saliency in foreground and background of the image separately. We propose to model the image as MRF (Markov Random Field) and use MAP (Maximum a-posteriori) as final solution to segment the image into foreground and background. The salient frame is defined by the variation in feature descriptors using the geometric features. We propose to combine the probabilities of foreground and background segments being salient using DSCR (Dempster Shafer Combination Rule). We consider the summarized video as a combination of salient frames for a user defined time. We demonstrate the results using several videos in BL-7F dataset and compare the same with state of art techniques using retention ratio and condensation ratio as quality parameters.

[1]  Xuelong Li,et al.  Surveillance Video Synopsis via Scaling Down Objects , 2016, IEEE Transactions on Image Processing.

[2]  Xuelong Li,et al.  Hierarchical Recurrent Neural Network for Video Summarization , 2017, ACM Multimedia.

[3]  Soo-Young Lee,et al.  Description of shape patterns using circular arcs for object detection , 2013, IET Comput. Vis..

[4]  Wei Liu,et al.  A time-slice optimization based weak feature association algorithm for video condensation , 2016, Multimedia Tools and Applications.

[5]  Shao-Yi Chien,et al.  Efficient Content Analysis Engine for Visual Surveillance Network , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[6]  Junbin Gao,et al.  Conics Detection Method based on Pascal's Theorem , 2015, VISAPP.

[7]  Amit K. Roy-Chowdhury,et al.  Multi-View Surveillance Video Summarization via Joint Embedding and Sparse Optimization , 2017, IEEE Transactions on Multimedia.

[8]  Manoranjan Paul,et al.  Adaptive fusion of human visual sensitive features for surveillance video summarization. , 2017, Journal of the Optical Society of America. A, Optics, image science, and vision.

[9]  Peter Kovesi,et al.  MATLAB Functions for Computer Vision and Image Analysis , 2004 .

[10]  Chun-Rong Huang,et al.  Maximum a Posteriori Probability Estimation for Online Surveillance Video Synopsis , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[11]  Jiang Yu Zheng,et al.  Temporal Mapping of Surveillance Video , 2014, 2014 22nd International Conference on Pattern Recognition.

[12]  Amit K. Roy-Chowdhury,et al.  Video summarization through change detection in a non-overlapping camera network , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[13]  Jurandy Almeida,et al.  Rapid Video Summarization on Compressed Video , 2010, 2010 IEEE International Symposium on Multimedia.

[14]  Wei Jiang,et al.  Memorable and rich video summarization , 2017, J. Vis. Commun. Image Represent..

[15]  Andrea Cavallaro,et al.  Distributed and Decentralized Multicamera Tracking , 2011, IEEE Signal Processing Magazine.

[16]  Chia-han Lee,et al.  On-Line Multi-View Video Summarization for Wireless Video Sensor Network , 2015, IEEE Journal of Selected Topics in Signal Processing.

[17]  Yang Wang,et al.  Video Summarization Using Fully Convolutional Sequence Networks , 2018, ECCV.

[18]  Kristen Grauman,et al.  Story-Driven Summarization for Egocentric Video , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Naokazu Yokoya,et al.  Textual description-based video summarization for video blogs , 2015, 2015 IEEE International Conference on Multimedia and Expo (ICME).

[20]  José María Martínez Sanchez,et al.  On-Line Video Summarization Based on Signature-Based Junk and Redundancy Filtering , 2008, 2008 Ninth International Workshop on Image Analysis for Multimedia Interactive Services.

[21]  Susanto Rahardja,et al.  Object Recognition by Discriminative Combinations of Line Segments, Ellipses, and Appearance Features , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Yi-Ping Hung,et al.  Target-driven video summarization in a camera network , 2013, 2013 IEEE International Conference on Image Processing.

[23]  Francesco Tisato,et al.  Attentive Monitoring of Multiple Video Streams Driven by a Bayesian Foraging Strategy , 2014, IEEE Transactions on Image Processing.

[24]  Sergio A. Velastin,et al.  Intelligent distributed surveillance systems: a review , 2005 .

[25]  Yongwei Nie,et al.  Object Movements Synopsis viaPart Assembling and Stitching , 2014, IEEE Transactions on Visualization and Computer Graphics.

[26]  Huang-Chia Shih,et al.  A Novel Attention-Based Key-Frame Determination Method , 2013, IEEE Transactions on Broadcasting.

[27]  Wei Jia,et al.  Angular Pattern and Binary Angular Pattern for Shape Retrieval , 2014, IEEE Transactions on Image Processing.

[28]  Ching-Tang Fan,et al.  Heterogeneous Information Fusion and Visualization for a Large-Scale Intelligent Video Surveillance System , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.