Human Interaction Recognition Using Improved Spatio-Temporal Features

Human Interaction Recognition (HIR) plays a major role in building intelligent video surveillance systems. In this paper, a new interaction recognition mechanism has been proposed to recognize the activity/interaction of the person with improved spatio-temporal feature extraction techniques robust against occlusion. In order to identify the interaction between two persons, tracking is necessary step to track the movement of the person. Next to tracking, local spatio temporal interest points have been detected using corner detector and the motion of the each corner points have been analysed using optical flow. Feature descriptor provides the motion information and the location of the body parts where the motion is exhibited in the blobs. Action has been predicted from the pose information and the temporal information from the optical flow. Hierarchical SVM (H-SVM) has been used to recognize the interaction and Occlusion of blobs gets determined based on the intersection of the region lying in that path. Performance of this system has been tested over different data sets and results seem to be promising.

[1]  Barbara Caputo,et al.  Recognizing human actions: a local SVM approach , 2004, ICPR 2004.

[2]  S. Abirami,et al.  Motion Tracking of Humans under Occlusion Using Blobs , 2014 .

[3]  Patrick Bouthemy,et al.  Better Exploiting Motion for Better Action Recognition , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Jake K. Aggarwal,et al.  An Overview of Contest on Semantic Description of Human Activities (SDHA) 2010 , 2010, ICPR Contests.

[5]  J. Weickert,et al.  Lucas/Kanade meets Horn/Schunck: combining local and global optic flow methods , 2005 .

[6]  Ian D. Reid,et al.  High Five: Recognising human interactions in TV shows , 2010, BMVC.

[7]  Yannick Benezeth,et al.  Human Interaction Recognition Based on the Co-occurrence of Visual Words , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[8]  Juan Carlos Augusto,et al.  A Hierarchical Human Activity Recognition Framework Based on Automated Reasoning , 2013, 2013 IEEE International Conference on Systems, Man, and Cybernetics.

[9]  Bo Gao,et al.  A discriminative key pose sequence model for recognizing human interactions , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[10]  Tieniu Tan,et al.  Human Behavior Analysis Based on a New Motion Descriptor , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[11]  R. Baskaran,et al.  Construction of Image Ontology using low-level features for Image Retrieval , 2012, 2012 International Conference on Computer Communication and Informatics.

[12]  Serge J. Belongie,et al.  Behavior recognition via sparse spatio-temporal features , 2005, 2005 IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance.

[13]  S Abirami,et al.  Suspicious Human Activity Detection from Surveillance Videos , 2012 .

[14]  Yunde Jia,et al.  Learning Human Interaction by Interactive Phrases , 2012, ECCV.

[15]  J.K. Aggarwal,et al.  Human activity analysis , 2011, ACM Comput. Surv..