Event based surveillance video synopsis using trajectory kinematics descriptors

Video synopsis has been shown its promising performance in visual surveillance, but the rearranged foreground objects may disorderly occlude to each other which makes end users hard to identify the targets. In this paper, a novel event based video synopsis method is proposed by using the clustering results of trajectories of foreground objects. To represent the kinematic events of each trajectory, trajectory kinematics descriptors are applied. Then, affinity propagation is used to cluster trajectories with similar kinematic events. Finally, each kinematic event group is used to generate an event based synopsis video. As shown in the experiments, the generated event based synopsis videos can effectively and efficiently reduce the lengths of the surveillance videos and are much clear for browsing compared to the states-of-the-art video synopsis methods.

[1]  Mohan M. Trivedi,et al.  A Survey of Vision-Based Trajectory Learning and Analysis for Surveillance , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  Chien-Li Chou,et al.  Coherent event-based surveillance video synopsis using trajectory clustering , 2015, 2015 IEEE International Conference on Multimedia & Expo Workshops (ICMEW).

[3]  Yael Pritch,et al.  This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2008 1 Non-Chronological Video , 2022 .

[4]  Stan Z. Li,et al.  Online content-aware video condensation , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Xuelong Li,et al.  Surveillance Video Synopsis via Scaling Down Objects , 2016, IEEE Transactions on Image Processing.

[6]  Changzheng Qu,et al.  Invariant Geometric Motions of Space Curves , 2004, IWMM/GIAE.

[7]  Yael Pritch,et al.  Clustered Synopsis of Surveillance Video , 2009, 2009 Sixth IEEE International Conference on Advanced Video and Signal Based Surveillance.

[8]  Chun-Rong Huang,et al.  Maximum a Posteriori Probability Estimation for Online Surveillance Video Synopsis , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[9]  Delbert Dueck,et al.  Clustering by Passing Messages Between Data Points , 2007, Science.

[10]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[11]  Pau-Choo Chung,et al.  Trajectory kinematics descriptor for trajectory clustering in surveillance videos , 2015, 2015 IEEE International Symposium on Circuits and Systems (ISCAS).