Homography-based Analysis of People and Vehicle Activities in Crowded Scenes

This paper presents an new framework for homography-based analysis of pedestrian-vehicle activity in crowded scenes. Planar homography constraint is exploited to extract view-invariant object features including footage area and velocity of objects on the ground plane. Spatio-temporal relationships between people- and vehicle- tracks are represented by a semantic event. Context awareness of the situation is achieved by the estimated density distribution of objects and the anticipation of possible directions of near-future tracks using piecewise velocity history. Single-view and multi-view based homography mapping options are compared. Our framework can be used to enhance situational awareness for disaster prevention, human interactions in structured environments, and crowd movement analysis at wide regions

[1]  Chris Stauffer,et al.  Robust automated planar normalization of tracking data , 2003 .

[2]  Parameswaran Ramanathan,et al.  Distributed target classification and tracking in sensor networks , 2003 .

[3]  Sergio A. Velastin,et al.  Intelligent distributed surveillance systems: a review , 2005 .

[4]  Mohan M. Trivedi,et al.  Multi-perspective Video Analysis of Persons and Vehicles for Enhanced Situational Awareness , 2006, ISI.

[5]  Alex Pentland,et al.  A Bayesian Computer Vision System for Modeling Human Interactions , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Mohan M. Trivedi,et al.  Multi-person interaction and activity analysis: a synergistic track- and body-level analysis framework , 2007, Machine Vision and Applications.

[7]  Larry S. Davis,et al.  W4: Real-Time Surveillance of People and Their Activities , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Y. Bar-Shalom,et al.  Topography-based VS-IMM estimator for large-scale ground target tracking , 1999 .

[9]  Jake K. Aggarwal,et al.  Semantic-level Understanding of Human Actions and Interactions using Event Hierarchy , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[10]  Yaakov Bar-Shalom,et al.  Multitarget-Multisensor Tracking: Applications and Advances , 1992 .

[11]  James F. Allen,et al.  Actions and Events in Interval Temporal Logic , 1994, J. Log. Comput..

[12]  Tarak Gandhi,et al.  Distributed omni-video arrays and digital tele-viewer for customized viewing, event detection and notification , 2004, International Conference on Information Technology: Coding and Computing, 2004. Proceedings. ITCC 2004..

[13]  Ian D. Reid,et al.  A plane measuring device , 1999, Image Vis. Comput..

[14]  Sergio A. Velastin,et al.  PRISMATICA: toward ambient intelligence in public transport environments , 2005, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.