Surveillance video summarization based on moving object detection and trajectory extraction

With the ever growing surveillance data, it is important and urgent to effectively and efficiently manage and utilize the huge amount of surveillance video repositories. In order to browse the video data quickly and make full use of the surveillance video data, we propose a fully automatic and computationally efficient framework for analysis and summarization of surveillance videos with the techniques of moving object detection and trajectory extraction. The video is first partitioned into segments based on moving object detection, then trajectory is extracted from each moving object, and then keyframes are selected, together with the trajectories to represent the video segment. The experimental results indicate the practical applicability of the proposed method.

[1]  José María Martínez Sanchez,et al.  Event Detection and Clustering for Surveillance Video Summarization , 2008, 2008 Ninth International Workshop on Image Analysis for Multimedia Interactive Services.

[2]  Yong Wang,et al.  Real time motion analysis toward semantic understanding of video content , 2005, Visual Communications and Image Processing.

[3]  Ba Tu Truong,et al.  Video abstraction: A systematic review and classification , 2007, TOMCCAP.

[4]  Takeo Kanade,et al.  A System for Video Surveillance and Monitoring , 2000 .

[5]  S. de Avila,et al.  VSUMM: A simple and efficient approach for automatic video summarization , 2008, IWSSIP 2008.

[6]  Yael Pritch,et al.  Making a Long Video Short: Dynamic Video Synopsis , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[7]  Yuting Su,et al.  Surveillance Video Sequence Segmentation Based on Moving Object Detection , 2009, 2009 Second International Workshop on Computer Science and Engineering.

[8]  Zhouyu Fu,et al.  Semantic-Based Surveillance Video Retrieval , 2007, IEEE Transactions on Image Processing.

[9]  S. de Avila,et al.  VSUMM: A simple and efficient approach for automatic video summarization , 2008, 2008 15th International Conference on Systems, Signals and Image Processing.

[10]  François Brémond,et al.  A framework for surveillance video indexing and retrieval , 2008, 2008 International Workshop on Content-Based Multimedia Indexing.

[11]  Yusuf Sinan Akgül,et al.  Eye-gaze based real-time surveillance video synopsis , 2009, Pattern Recognit. Lett..

[12]  Behrouz Minaei Bidgoli,et al.  Video summarization using genetic algorithm and information theory , 2009, 2009 14th International CSI Computer Conference.

[13]  Yael Pritch,et al.  This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2008 1 Non-Chronological Video , 2022 .