Behavior recognition architecture for surveillance applications

Differentiating between normal human activity and aberrant behavior via closed circuit television cameras is a difficult and fatiguing task. The vigilance required of human observers when engaged in such tasks must remain constant, yet attention falls off dramatically over time. In this paper we propose an architecture for capturing data and creating a test and evaluation system to monitor video sensors and tag aberrant human activities for immediate review by human monitors. A psychological perspective provides the inspiration of depicting isolated human motion by point-light walker (PLW) displays, as they have been shown to be salient for recognition of action. Low level intent detection features are used to provide an initial evaluation of actionable behaviors. This relies on strong tracking algorithms that can function in an unstructured environment under a variety of environmental conditions. Critical to this is creating a description of ldquosuspicious behaviorrdquo that can be used by the automated system. The resulting confidence value assessments are useful for monitoring human activities and could potentially provide early warning of IED placement activities.

[1]  Larry S. Davis,et al.  Real-time foreground-background segmentation using codebook model , 2005, Real Time Imaging.

[2]  Kouichi Murakami,et al.  Gesture recognition using recurrent neural networks , 1991, CHI.

[3]  M. Shiffrar,et al.  Recognizing people from their movement. , 2005, Journal of experimental psychology. Human perception and performance.

[4]  T. Shipley,et al.  Markerless motion-capture for point-light displays , 2003 .

[5]  Alex Pentland,et al.  Space-time gestures , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[6]  J. Montepare,et al.  The identification of emotions from gait information , 1987 .

[7]  Kumpati S. Narendra,et al.  Improving transient response of adaptive control systems using multiple models and switching , 1993, Proceedings of 32nd IEEE Conference on Decision and Control.

[8]  J. Cutting,et al.  Recognizing the sex of a walker from a dynamic point-light display , 1977 .

[9]  N. Troje Decomposing biological motion: a framework for analysis and synthesis of human gait patterns. , 2002, Journal of vision.

[10]  G. Johansson Visual perception of biological motion and a model for its analysis , 1973 .

[11]  Jim W Kay,et al.  Gender recognition from point-light walkers. , 2005, Journal of experimental psychology. Human perception and performance.