Recognition and Classification of Human Behavior in Intelligent Surveillance Systems using Hidden Markov Model

Nowadays, the human behavior analysis by computer vision techniques has been an interesting issue for researchers. Automatic recognition of actions in video allows automation of many otherwise manually intensive tasks such as video surveillance. Video surveillance system especially for elderly care and their behavior analysis has an important role to take care of aged, impatient or bedridden persons. In this paper, we propose a high accuracy human action classification and recognition method using hidden Markov model classifier. In our approach, first, we use star skeleton feature extraction method to extract extremities of human body silhouette to produce feature vectors as inputs of hidden Markov model classifier. Then, hidden Markov model, which is learned and used in our proposed surveillance system, classifies the investigated behaviors and detects abnormal actions with high accuracy in comparison by other abnormal detection reported in previous works. The accuracy about 94% resulted from confusion matrix approve the efficiency of the proposed method when compared with its counterparts for abnormal action detection.

[1]  Jean Meunier,et al.  Fall Detection from Human Shape and Motion History Using Video Surveillance , 2007, 21st International Conference on Advanced Information Networking and Applications Workshops (AINAW'07).

[2]  Won Sohn,et al.  Feature extraction and dimensions reduction using R transform and Principal Component Analysis for abnormal human activity recognition , 2010, 2010 6th International Conference on Advanced Information Management and Service (IMS).

[3]  Chin-Hua Hu,et al.  An efficient method of human behavior recognition in smart environments , 2010, 2010 International Conference on Computer Application and System Modeling (ICCASM 2010).

[4]  Teddy Ko,et al.  A survey on behavior analysis in video surveillance for homeland security applications , 2008, 2008 37th IEEE Applied Imagery Pattern Recognition Workshop.

[5]  Jun-Wei Hsieh,et al.  Segmentation of Human Body Parts Using Deformable Triangulation , 2006, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[6]  Jiao Licheng,et al.  Classification mechanism of support vector machines , 2000, WCC 2000 - ICSP 2000. 2000 5th International Conference on Signal Processing Proceedings. 16th World Computer Congress 2000.

[7]  H. Pourreza,et al.  An eigenspace-based approach for human fall detection using Integrated Time Motion Image and multi-class Support Vector Machine , 2008, 2008 4th International Conference on Intelligent Computer Communication and Processing.

[8]  Junji Yamato,et al.  Recognizing human action in time-sequential images using hidden Markov model , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[9]  Chung-Lin Huang,et al.  Human upper body posture recognition and upper limbs motion parameters estimation , 2013, 2013 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference.

[10]  Shahrizat Shaik Mohamed,et al.  Background modelling and background subtraction performance for object detection , 2010, 2010 6th International Colloquium on Signal Processing & its Applications.

[11]  Anupam Agrawal,et al.  Framework for human action recognition using spatial temporal based cuboids , 2011, 2011 International Conference on Image Information Processing.

[12]  Xin Yuan,et al.  A Robust Human Action Recognition System Using Single Camera , 2009, 2009 International Conference on Computational Intelligence and Software Engineering.

[13]  Massimo Piccardi,et al.  Training Initialization of Hidden Markov Models in Human Action Recognition , 2014, IEEE Transactions on Automation Science and Engineering.

[14]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[15]  Itaru Nagayama,et al.  A Method for Automatic Detection of Crimes for Public Security by Using Motion Analysis , 2009, 2009 Fifth International Conference on Intelligent Information Hiding and Multimedia Signal Processing.

[16]  Rupali Nikhare,et al.  Visual surveillance using absolute difference motion detection , 2015, 2015 International Conference on Technologies for Sustainable Development (ICTSD).

[17]  Siddharth Swarup Rautaray,et al.  Real Time Multiple Hand Gesture Recognition System for Human Computer Interaction , 2012 .

[18]  Yasushi Makihara,et al.  Action recognition using dynamics features , 2011, 2011 IEEE International Conference on Robotics and Automation.

[19]  Subhas Mukhopadhyay,et al.  Forecasting the behavior of an elderly using wireless sensors data in a smart home , 2013, Eng. Appl. Artif. Intell..

[20]  Norbert Noury,et al.  Computer simulation of the activity of the elderly person living independently in a Health Smart Home , 2012, Comput. Methods Programs Biomed..

[21]  Pau-Choo Chung,et al.  A daily behavior enabled hidden Markov model for human behavior understanding , 2008, Pattern Recognit..

[22]  Mohammed Abdul Wajeed,et al.  Semi-supervised text classification using enhanced KNN algorithm , 2011, 2011 World Congress on Information and Communication Technologies.

[23]  Megha D. Bengalur.  Human activity recognition using body pose features and support vector machine , 2013, 2013 International Conference on Advances in Computing, Communications and Informatics (ICACCI).

[24]  Homa Foroughi,et al.  Distinguishing Fall Activities using Human Shape Characteristics , 2008, EIAT/IETA.

[25]  Yafei Lu,et al.  Dynamic model behavior analysis of small groups based on particle video , 2013, 2013 International Conference on Wireless Communications and Signal Processing.

[26]  N. Ellouze,et al.  Robust Features for Speech Recognition using Temporal Filtering Technique in the Presence of Impulsive Noise , 2014 .