Action classification of 3D human models using dynamic ANNs for mobile robot surveillance

This paper presents an alternative approach on physical human action classification implemented by mobile robots. In contrast with other action recognition methods, this research indicates the best configuration topology of a number of dynamic neural networks to be used in 3D time series classification by showing several comparison performances. In this action recognition investigation we demonstrate high level network granularity on dynamic classification and class discrimination of normal and aggressive action recognition. An interconnection between an ubiquitous 3D sensory tracker system and a mobile robot is set to create a perception to action architecture capable to perceive, process, and classify physical human actions. The robot is used as a process-to-action unit to process the 3D data taken by the tracker and to eventually generate surveillance assessment reports pointing towards action-class matchings as well as generating evaluation statistics which signify the quality of the actions recognized.

[1]  Rémi Ronfard,et al.  Motion History Volumes for Free Viewpoint Action Recognition , 2005 .

[2]  William C. Davidon,et al.  Variable Metric Method for Minimization , 1959, SIAM J. Optim..

[3]  Ramakant Nevatia,et al.  Recognition and Segmentation of 3-D Human Action Using HMM and Multi-class AdaBoost , 2006, ECCV.

[4]  Peter Stagge,et al.  Recurrent neural networks for time series classification , 2003, Neurocomputing.

[5]  É MikaelBoden A guide to recurrent neural networks and backpropagation , 2001 .

[6]  Mikael Bodén,et al.  A guide to recurrent neural networks and backpropagation , 2001 .

[7]  Rama Chellappa,et al.  View invariants for human action recognition , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[8]  Montse Pardàs,et al.  Human model and motion based 3D action recognition in multiple view scenarios , 2006, 2006 14th European Signal Processing Conference.

[9]  Mubarak Shah,et al.  Recognizing human actions in videos acquired by uncalibrated moving cameras , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[10]  Isaac Cohen,et al.  Posture and Gesture Recognition using 3D Body Shapes Decomposition , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.