Real time trajectory search in video summarization using direct distance transform

Searching for human trajectories in a summarized video is a way of analyzing such video within a smaller group of human moving along the same path. We propose a real time novel method for similarity search for human trajectories using a distance transform of each extracted human tunnel. We integrate this method with our previous work, Real Time Tunnel Based Video Summarization using Direct Shift Collision Detection (DSCD), which provides the human tunnels with trajectory information for being analyzed. The algorithm first creates a distance transform from provided trajectory information. A model of trajectory for screening irrelevant tunnels out of the summarized video is then used as a query. An efficient technique as in DSCD is used for calculating a direct distance transform (DDT). Then a similarity between trajectory model and human trajectories are ranked. The advantage of linear time complexity of both DSCD and distance transform gives us a real time search results while more relevant summarization output can be obtained.

[1]  Dimitrios Gunopulos,et al.  Discovering similar multidimensional trajectories , 2002, Proceedings 18th International Conference on Data Engineering.

[2]  Yasuyuki Matsushita,et al.  Space-Time Video Montage , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[3]  Shin'ichi Satoh,et al.  Real Time Tunnel Based Video Summarization Using Direct Shift Collision Detection , 2010, PCM.

[4]  Yael Pritch,et al.  Webcam Synopsis: Peeking Around the World , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[5]  Lei Chen,et al.  Robust and fast similarity search for moving object trajectories , 2005, SIGMOD '05.

[6]  Yael Pritch,et al.  Clustered Synopsis of Surveillance Video , 2009, 2009 Sixth IEEE International Conference on Advanced Video and Signal Based Surveillance.

[7]  Yael Pritch,et al.  Making a Long Video Short: Dynamic Video Synopsis , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[8]  Yael Pritch,et al.  This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2008 1 Non-Chronological Video , 2022 .

[9]  Nebojsa Jojic,et al.  Adaptive Video Fast Forward , 2005, Multimedia Tools and Applications.

[10]  Nikos Pelekis,et al.  Similarity Search in Trajectory Databases , 2007, 14th International Symposium on Temporal Representation and Reasoning (TIME'07).

[11]  P. Sojan Lal,et al.  Trajectory Similarity of Network Constrained Moving Objects and Applications to Traffic Security , 2010, PAISI.

[12]  Dimitrios Gunopulos,et al.  Robust similarity measures for mobile object trajectories , 2002, Proceedings. 13th International Workshop on Database and Expert Systems Applications.

[13]  Janusz Konrad,et al.  Video Condensation by Ribbon Carving , 2009, IEEE Transactions on Image Processing.

[14]  Michael A. Smith,et al.  Video skimming and characterization through the combination of image and language understanding techniques , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.