A Surveillance System for the Recognition of Intent within Individuals and Crowds

Differentiating between normal human activity and aberrant behavior via closed circuit television cameras is a difficult and fatiguing task. The vigilance required of human observers when engaged in such tasks must remain constant, yet attention falls off dramatically over time. In this paper we propose an automated system to monitor video sensors and tag aberrant human activities for immediate review by human monitors. From the psychological perspective, isolated human motion depicted by point-light walker (PLW) displays have been shown to be salient for recognition of action [17] and determination of emotional state [18]. We propose that by using the motion data that immediately precedes hostile behavior, it may be possible to classify hostile intent before destructive actions take place. These hostile intent gestures can be used to assign individuals a threat assessment level and improve remote sensor monitoring. Such assessments are useful for monitoring human activities and could potentially provide early warning of lED emplacement activities.

[1]  Alex Pentland,et al.  Space-time gestures , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Q. Vuong,et al.  Incidental Processing of Biological Motion , 2004, Current Biology.

[3]  M. Shiffrar,et al.  Recognizing people from their movement. , 2005, Journal of experimental psychology. Human perception and performance.

[4]  A. Noë,et al.  A sensorimotor account of vision and visual consciousness. , 2001, The Behavioral and brain sciences.

[5]  P. Ekman,et al.  Constants across cultures in the face and emotion. , 1971, Journal of personality and social psychology.

[6]  Ronald A. Rensink,et al.  Active versus passive processing of biological motion , 2002, Perception.

[7]  A. Bandura Self-efficacy: toward a unifying theory of behavioral change. , 1977, Psychological review.

[8]  Daniel E. Koditschek,et al.  Dynamical system representation, generation, and recognition of basic oscillatory motion gestures , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[9]  A. Bandura Self-Efficacy: The Exercise of Control , 1997, Journal of Cognitive Psychotherapy.

[10]  Armin Bruderlin,et al.  Perceiving affect from arm movement , 2001, Cognition.

[11]  KimKyungnam,et al.  Real-time foreground-background segmentation using codebook model , 2005 .

[12]  M. Shiffrar,et al.  The visual analysis of emotional actions , 2006, Social neuroscience.

[13]  Jim W Kay,et al.  Gender recognition from point-light walkers. , 2005, Journal of experimental psychology. Human perception and performance.

[14]  P. Ekman,et al.  Behavioral markers and recognizability of the smile of enjoyment. , 1993, Journal of personality and social psychology.

[15]  Kouichi Murakami,et al.  Gesture recognition using recurrent neural networks , 1991, CHI.

[16]  Kumpati S. Narendra,et al.  Improving transient response of adaptive control systems using multiple models and switching , 1994 .

[17]  N. Troje Decomposing biological motion: a framework for analysis and synthesis of human gait patterns. , 2002, Journal of vision.

[18]  G. Johansson Visual perception of biological motion and a model for its analysis , 1973 .

[19]  J. Cutting,et al.  Recognizing the sex of a walker from a dynamic point-light display , 1977 .

[20]  Sylvia Weir,et al.  Action perception , 1974 .

[21]  Sarah Milne Self-efficacy in changing societies , 1999, Journal of health psychology.

[22]  J. Montepare,et al.  The identification of emotions from gait information , 1987 .

[23]  Kumpati S. Narendra,et al.  Improving transient response of adaptive control systems using multiple models and switching , 1993, Proceedings of 32nd IEEE Conference on Decision and Control.

[24]  Paul Ekman,et al.  Facial Expressions of Emotion: New Findings, New Questions , 1992 .

[25]  P Cavanagh,et al.  Short-range vs long-range motion: not a valid distinction. , 1991, Spatial vision.

[26]  P. Ekman,et al.  Facial signs of emotional experience. , 1980 .

[27]  D. Scott Perceptual learning. , 1974, Queen's nursing journal.

[28]  T. Shipley,et al.  Markerless motion-capture for point-light displays , 2003 .

[29]  H. Intraub The representation of visual scenes , 1997, Trends in Cognitive Sciences.

[30]  Larry S. Davis,et al.  Real-time foreground-background segmentation using codebook model , 2005, Real Time Imaging.