HMMs-based human action recognition for an intelligent household surveillance robot

The aging of population has become a social problem and fall is a major health risk in the elderly. To this end, this paper presents a novel approach for fall detection applied to an intelligent household surveillance robot. Silhouette based features are extracted, including aspect ratio of minimal bounding box of the human silhouette, approximated elliptical eccentricity, normalized central moments and Hu moments. Fall and other human motions, such as walk, bend, run and crouch, are modeled using Hidden Markov Models (HMM) with Gaussian Mixture Models (GMM). The experimental results are evaluated by sensitivity, specificity and accuracy and the average of them reaches 88.71%, 97.56% and 96.26% respectively.

[1]  Paulo Cortez,et al.  Prediction of Abnormal Behaviors for Intelligent Video Surveillance Systems , 2007, 2007 IEEE Symposium on Computational Intelligence and Data Mining.

[2]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[3]  Tieniu Tan,et al.  A survey on visual surveillance of object motion and behaviors , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[4]  Ren C. Luo,et al.  A multiagent multisensor based real-time sensory control system for intelligent security robot , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[5]  Sabu Emmanuel,et al.  Intelligent Video Surveillance for Monitoring Elderly in Home Environments , 2007, 2007 IEEE 9th Workshop on Multimedia Signal Processing.

[6]  Stephen J. McKenna,et al.  Activity summarisation and fall detection in a supportive home environment , 2004, ICPR 2004.

[7]  H. Seki,et al.  Abnormality detection monitoring system for elderly people in sensing and robotic support room , 2008, 2008 10th IEEE International Workshop on Advanced Motion Control.

[8]  A. Sixsmith.  An evaluation of an intelligent home monitoring system , 2000, Journal of telemedicine and telecare.

[9]  A. Enis Çetin,et al.  HMM Based Falling Person Detection Using Both Audio and Video , 2005, 2006 IEEE 14th Signal Processing and Communications Applications.

[10]  N. Massios,et al.  Hierarchical decision-theoretic planning for autonomous robotic surveillance , 1999, 1999 Third European Workshop on Advanced Mobile Robots (Eurobot'99). Proceedings (Cat. No.99EX355).

[11]  S. Miaou,et al.  A Customized Human Fall Detection System Using Omni-Camera Images and Personal Information , 2006, 1st Transdisciplinary Conference on Distributed Diagnosis and Home Healthcare, 2006. D2H2..

[12]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.

[13]  C. Rougier,et al.  Monocular 3D Head Tracking to Detect Falls of Elderly People , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[14]  M. Mathie,et al.  of the 23 rd Annual EMBS International Conference , October 25-28 , Istanbul , Turkey A SYSTEM FOR MONITORING POSTURE AND PHYSICAL ACTIVITY USING ACCELEROMETERS , 2004 .

[15]  Toshiyo Tamura,et al.  An ambulatory fall monitor for the elderly , 2000, Proceedings of the 22nd Annual International Conference of the IEEE Engineering in Medicine and Biology Society (Cat. No.00CH37143).

[16]  Yangsheng Xu,et al.  Intelligent household surveillance robot , 2009, 2008 IEEE International Conference on Robotics and Biomimetics.

[17]  Junji Yamato,et al.  Recognizing human action in time-sequential images using hidden Markov model , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[18]  David P. Colvin,et al.  Falls In The Elderly: Detection And Assessment , 1991, Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society Volume 13: 1991.

[19]  Jean Meunier,et al.  Fall Detection from Human Shape and Motion History Using Video Surveillance , 2007, 21st International Conference on Advanced Information Networking and Applications Workshops (AINAW'07).

[20]  Takeo Kanade,et al.  A System for Video Surveillance and Monitoring , 2000 .

[21]  B. Ugur Toreyin,et al.  Ses ve video işaretlerinde saklı markof modeli tabanlı düşen kişi tespiti , 2006 .