Gaussian Mixture Model for summarization of surveillance videos

We propose a method to address the problem of Video Summarization, which aims to generate a summarized video by preserving the salient activities of the input video for a user specified time. We model the motion of a feature points as Gaussian Mixture Model (GMM) to select the key feature points, which in-turn estimate the salient frames. The saliency of feature points depends on the contribution of motion in entire video and user specified time duration of summary. We generate a summarized video keeping chronology of salient frames to avoid the viewing ambiguity for the viewers. We demonstrate the proposed method for different stored surveillance videos and achieve retention ratio as 1 for the closest condensation ratio obtained for stroboscopic approach and also demonstrate the proposed GMM method with interactively selected region of interest (ROI) based results.

[1]  Pau-Choo Chung,et al.  Online surveillance video synopsis , 2012, 2012 IEEE International Symposium on Circuits and Systems.

[2]  Chia-han Lee,et al.  Low complexity on-line video summarization with Gaussian mixture model based clustering , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[3]  Yael Pritch,et al.  Clustered Synopsis of Surveillance Video , 2009, 2009 Sixth IEEE International Conference on Advanced Video and Signal Based Surveillance.

[4]  Jay L. Devore,et al.  Probability and statistics for engineering and the sciences , 1982 .

[5]  Shengcai Liao,et al.  Online Principal Background Selection for Video Synopsis , 2010, 2010 20th International Conference on Pattern Recognition.

[6]  Cuneyt M. Taskiran.  Evaluation of automatic video summarization systems , 2006, Electronic Imaging.

[7]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[8]  Yael Pritch,et al.  Making a Long Video Short: Dynamic Video Synopsis , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[9]  Lei Sun,et al.  A tracking based fast online complete video synopsis approach , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[10]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Eric R. Ziegel,et al.  Probability and Statistics for Engineering and the Sciences , 2004, Technometrics.

[12]  Uma Mudenagudi,et al.  Time driven video summarization using GMM , 2013, 2013 Fourth National Conference on Computer Vision, Pattern Recognition, Image Processing and Graphics (NCVPRIPG).

[13]  Alex Zelinsky,et al.  Learning OpenCV---Computer Vision with the OpenCV Library (Bradski, G.R. et al.; 2008)[On the Shelf] , 2009, IEEE Robotics & Automation Magazine.

[14]  Yael Pritch,et al.  This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2008 1 Non-Chronological Video , 2022 .