Hidden Markov Model based human activity recognition using shape and optical flow based features

Recognizing human activity is an important area of research in computer vision application. Manual monitoring of all cameras continuously for longer duration is inefficient making auto-detection of activity important. In this paper shape and optical flow features are fused together and used for human activity recognition. Features extracted are found to be efficient as concluded by ANOVA test. Hidden Markov Model are generated for each activity. System is trained and tested in various indoor and outdoor environment. The method adapted is made shape and angle invariant. Accuracy achieved using least square support vector machine classifier is 80% for all activities. Hidden Markov Model resulted in better accuracy as compared to least square support vector machine classifier with accuracy of 100.00% for walking, 100.00% for hand waving, 90% for bending, 84.61% for running and 90% for side gallop activities. 100% accuracy is achieved in recognizing activity in different angle with respect to camera.

[1]  S. Sengupta,et al.  Hidden Markov model based video indexing with discrete cosine transform as a likelihood function , 2004, Proceedings of the IEEE INDICON 2004. First India Annual Conference, 2004..

[2]  Tae-Seong Kim,et al.  Human Activity Recognition via 3-D joint angle features and Hidden Markov models , 2010, 2010 IEEE International Conference on Image Processing.

[3]  Hafiz Imtiaz,et al.  Human Action Recognition based on Spectral Domain Features , 2015, KES.

[4]  Barbara Caputo,et al.  Recognizing human actions: a local SVM approach , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[5]  Somnath Sengupta,et al.  Hidden Markov Model Based Structuring of Cricket Video Sequences Using Motion and Color Features , 2004, ICVGIP.

[6]  Matti Pietikäinen,et al.  Human Activity Recognition Using Sequences of Postures , 2005, MVA.

[7]  R. Rodrigo,et al.  Faster human activity recognition with SVM , 2012, International Conference on Advances in ICT for Emerging Regions (ICTer2012).

[8]  Junji Yamato,et al.  Recognizing human action in time-sequential images using hidden Markov model , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[9]  Mubarak Shah,et al.  Human Action Recognition in Videos Using Kinematic Features and Multiple Instance Learning , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Sridha Sridharan,et al.  Activity recognition using binary tree SVM , 2014, 2014 IEEE Workshop on Statistical Signal Processing (SSP).

[11]  Hanqing Lu,et al.  Human activity recognition based on the blob features , 2009, 2009 IEEE International Conference on Multimedia and Expo.

[12]  Simon Baker,et al.  Lucas-Kanade 20 Years On: A Unifying Framework , 2004, International Journal of Computer Vision.

[13]  Ronen Basri,et al.  Actions as Space-Time Shapes , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Somnath Sengupta,et al.  Bayesian Network-Based Customized Highlight Generation for Broadcast Soccer Videos , 2015, IEEE Transactions on Broadcasting.

[15]  Elsayed E. Hemayed,et al.  Human action recognition using trajectory-based representation , 2015 .