Summarizing Surveillance Video by Saliency Transition and Moving Object Information

Everyday an enormous amount of video is captured by surveillance system for various purposes around the whole world. However, this is almost impossible for human to analyze the vast majority of video data. In this paper, a video summarization method is introduced combining foreground object, motion, and visual attention cue. Foreground objects typically provide important information about video contents. Additionally, object motion is naturally more attractive to human being. Moreover, visual attention cue indicates the human's attraction label for key frame determination. Using these features, supervised classifier support vector machine (SVM) is applied to obtain the key frames from a surveillance video. Extensive experimental results show that the proposed method performs superior to the state-of-the-art method using publicly available BL-7F surveillance video dataset.

[1]  Nuno Vasconcelos,et al.  On the plausibility of the discriminant center-surround hypothesis for visual saliency. , 2008, Journal of vision.

[2]  Pietro Perona,et al.  Graph-Based Visual Saliency , 2006, NIPS.

[3]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[4]  Sung Wook Baik,et al.  Efficient visual attention based framework for extracting key frames from videos , 2013, Signal Process. Image Commun..

[5]  Shaohui Mei,et al.  Video summarization via minimum sparse reconstruction , 2015, Pattern Recognit..

[6]  Junseok Kwon,et al.  A unified framework for event summarization and rare event detection , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Chong-Wah Ngo,et al.  Summarizing Rushes Videos by Motion, Object, and Event Understanding , 2012, IEEE Transactions on Multimedia.

[8]  Huang-Chia Shih,et al.  A Novel Attention-Based Key-Frame Determination Method , 2013, IEEE Transactions on Broadcasting.

[9]  Shaogang Gong,et al.  Video Synopsis by Heterogeneous Multi-source Correlation , 2013, 2013 IEEE International Conference on Computer Vision.

[10]  Manoranjan Paul,et al.  A novel video coding scheme using a scene adaptive non-parametric background model , 2014, 2014 IEEE 16th International Workshop on Multimedia Signal Processing (MMSP).

[11]  Bu-Sung Lee,et al.  Explore and Model Better I-Frames for Video Coding , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[12]  Zhe-Ming Lu,et al.  Video abstraction based on the visual attention model and online clustering , 2013, Signal Process. Image Commun..

[13]  Patrick Gros,et al.  Constraint Satisfaction Programming for Video Summarization , 2013, 2013 IEEE International Symposium on Multimedia.

[14]  Petros Maragos,et al.  Multimodal Saliency and Fusion for Movie Summarization Based on Aural, Visual, and Textual Attention , 2013, IEEE Transactions on Multimedia.

[15]  Jen-Hui Chuang,et al.  A novel video summarization method for multi-intensity illuminated infrared videos , 2013, 2013 IEEE International Conference on Multimedia and Expo (ICME).

[16]  Yang Yi,et al.  Key frame extraction based on visual attention model , 2012, J. Vis. Commun. Image Represent..

[17]  Meng Wang,et al.  Event Driven Web Video Summarization by Tag Localization and Key-Shot Identification , 2012, IEEE Transactions on Multimedia.

[18]  Jurandy Almeida,et al.  Online video summarization on compressed domain , 2013, J. Vis. Commun. Image Represent..

[19]  Yong Jae Lee,et al.  Discovering important people and objects for egocentric video summarization , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Manoranjan Paul,et al.  A hybrid object detection technique from dynamic background using Gaussian mixture models , 2008, 2008 IEEE 10th Workshop on Multimedia Signal Processing.

[21]  Conrad Sanderson,et al.  Summarisation of short-term and long-term videos using texture and colour , 2014, IEEE Winter Conference on Applications of Computer Vision.

[22]  Chia-han Lee,et al.  On-Line Multi-View Video Summarization for Wireless Video Sensor Network , 2015, IEEE Journal of Selected Topics in Signal Processing.