Navigational strategies in behaviour modelling

We propose a new method that treats visible human behaviour at the level of navigational strategies. By inferring intentions in terms of known goals, it is possible to explain the behaviour of people moving around within the field of view of a video camera. The approach presented here incorporates models of navigation from within psychology which are both simple and conceptually plausible, whilst providing good results in an event-detection application. The output is in the form of statements involving goals, such as ''Agent 25 went to exit 8 via sub-goals 34 and 21'' for a given navigational strategy, an image representing the path through the scene, and an overall score for each trajectory. The central algorithm generates all plausible paths through the scene to known goal sites and then compares each path to the agent's actual trajectory thus finding the most likely explanation for their behaviour. Two navigational strategies are examined, shortest path and simplest path. Experimental results are presented for an outdoor car-park and an indoor foyer scene, and our method is found to produce psychologically plausible explanations in the majority of cases. We propose a novel approach to determining the effectiveness of event detection systems, and evaluate the method presented here against this new ground truth. This evaluation method uses human observers to judge the behaviour shown in various video clips, then uses these judgements in correlation with those of the software. We compare the method with a standard machine learning approach based on nearest neighbour. Finally we consider the application of such a system in a binary event-detection or behaviour filtering system.

[1]  G. Csibra,et al.  Goal attribution without agency cues: the perception of ‘pure reason’ in infancy , 1999, Cognition.

[2]  Svetha Venkatesh,et al.  Policy Recognition in the Abstract Hidden Markov Model , 2002, J. Artif. Intell. Res..

[3]  Tim J. Ellis,et al.  Learning semantic scene models from observing activity in visual surveillance , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[4]  T. Troscianko,et al.  What Happens Next? The Predictability of Natural Behaviour Viewed through CCTV Cameras , 2004, Perception.

[5]  Reginald G. Golledge DEFINING THE CRITERIA USED IN PATH SELECTION. , 1995 .

[6]  Tieniu Tan,et al.  A survey on visual surveillance of object motion and behaviors , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[7]  R. Dalton The Secret Is To Follow Your Nose , 2001 .

[8]  Hilary Buxton,et al.  Learning and understanding dynamic scene activity: a review , 2003, Image Vis. Comput..

[9]  Michal Irani,et al.  Detecting Irregularities in Images and in Video , 2005, ICCV.

[10]  Shaogang Gong,et al.  Detecting and quantifying unusual interactions by correlating salient motion , 2005, IEEE Conference on Advanced Video and Signal Based Surveillance, 2005..

[11]  Derek R. Magee,et al.  Tracking multiple vehicles using foreground, background and motion models , 2004, Image Vis. Comput..

[12]  Thomas Eiter,et al.  Where is ...? Learning and Utilizing Motion Patterns of Persons with Mobile Robots , 2003, IJCAI.

[13]  Edward Y. Chang,et al.  Multi-camera spatio-temporal fusion and biased sequence-data learning for security surveillance , 2003, MULTIMEDIA '03.

[14]  Sergio A. Velastin,et al.  Intelligent distributed surveillance systems: a review , 2005 .

[15]  E. Dahlman,et al.  A Critical Assessment of Benchmark Comparison in Planning , 2002, J. Artif. Intell. Res..

[16]  Alex Pentland,et al.  A Bayesian Computer Vision System for Modeling Human Interactions , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  S. Chiba,et al.  Dynamic programming algorithm optimization for spoken word recognition , 1978 .

[18]  D. Dennett The Intentional Stance. , 1987 .

[19]  Henry A. Kautz,et al.  Learning and inferring transportation routines , 2004, Artif. Intell..

[20]  Sergio A. Velastin,et al.  How close are we to solving the problem of automated visual surveillance? , 2008, Machine Vision and Applications.

[21]  S. Siegel,et al.  Nonparametric Statistics for the Behavioral Sciences , 2022, The SAGE Encyclopedia of Research Design.

[22]  Stephen J. McKenna,et al.  Summarising contextual activity and detecting unusual inactivity in a supportive home environment , 2004, Pattern Analysis and Applications.

[23]  Svetha Venkatesh,et al.  Recognizing and monitoring high-level behaviors in complex spatial environments , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[24]  Simon Dixon,et al.  An On-Line Time Warping Algorithm for Tracking Musical Performances , 2005, IJCAI.

[25]  David C. Hogg,et al.  Learning the distribution of object trajectories for event recognition , 1996, Image Vis. Comput..

[26]  Jianbo Shi,et al.  Detecting unusual activity in video , 2004, CVPR 2004.

[27]  Aaron F. Bobick,et al.  Recognition of Visual Activities and Interactions by Stochastic Parsing , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  W. Eric L. Grimson,et al.  Learning Patterns of Activity Using Real-Time Tracking , 2000, IEEE Trans. Pattern Anal. Mach. Intell..