Multi-view recognition system for human activity based on multiple features for video surveillance system

Recognition of the activities of human, image sequences is most active area of research in computer vision and most of the previous projects, the focus of the activity is to acknowledge the recognition, from a single view and ignored issues of multiple view invariance. In this paper, the proposed framework for the recognition of a view-invariant human activity, solves the above problem. The components of the proposed framework are three consecutive modules: (i) the detection and positioning of the person’s background subtraction, (ii) the function extraction (iii) and the final activity is referenced by using a set of hidden Markov models (HMMs). During features extraction phase in the proposed method for activity representation a combination of contour-based distance signal feature, optical flow-based motion feature and uniform rotation local binary patterns has been used. Due to its rotation invariant nature the uniform LBP provides view-invariant recognition of multi-view human activities. A successful testing of the proposed approach was done on our own viewpoint dataset, KTH action recognition dataset, i3DPost multi-view dataset, and MSR view-point action dataset. From the experimental results and analysis over the chosen datasets, it is observed that the proposed framework is robust, flexible and efficient with respect to multiple views activity recognition, scale and phase variations.

[1]  Matti Pietikäinen,et al.  Recognition of human actions using texture descriptors , 2011, Machine Vision and Applications.

[2]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  A. Enis Çetin,et al.  Silhouette-Based Method for Object Classification and Human Action Recognition in Video , 2006, ECCV Workshop on HCI.

[4]  Isaac Cohen,et al.  Inference of human postures by classification of 3D human body shape , 2003, 2003 IEEE International SOI Conference. Proceedings (Cat. No.03CH37443).

[5]  Luming Zhang,et al.  Action2Activity: Recognizing Complex Activities from Sensor Data , 2015, IJCAI.

[6]  Mohiuddin Ahmad,et al.  Human action recognition using shape and CLG-motion flow from multi-view image sequences , 2008, Pattern Recognit..

[7]  Li Liu,et al.  Recognizing Complex Activities by a Probabilistic Interval-Based Model , 2016, AAAI.

[8]  Matti Pietikäinen,et al.  Texture Based Description of Movements for Activity Analysis , 2008, VISAPP.

[9]  Jari Hannuksela,et al.  Camera based motion estimation and recognition for human-computer interaction , 2008 .

[10]  Mohan M. Trivedi,et al.  Human Pose Estimation and Activity Recognition From Multi-View Videos: Comparative Explorations of Recent Developments , 2012, IEEE Journal of Selected Topics in Signal Processing.

[11]  David S. Rosenblum,et al.  From action to activity: Sensor-based activity recognition , 2016, Neurocomputing.

[12]  James W. Davis,et al.  The Recognition of Human Movement Using Temporal Templates , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Shyamsundar Rajaram,et al.  Human Activity Recognition Using Multidimensional Indexing , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Yan Huang,et al.  ARGMode - Activity Recognition using Graphical Models , 2003, 2003 Conference on Computer Vision and Pattern Recognition Workshop.

[15]  Mohammad H. Mahoor,et al.  Human activity recognition using multi-features and multiple kernel learning , 2014, Pattern Recognit..

[16]  Swati Nigam,et al.  Automatic human activity recognition in video using background modeling and spatio-temporal template matching based technique , 2011, ACAI '11.

[17]  Paul F. Whelan,et al.  Evaluation of robustness against rotation of LBP, CCR and ILBP features in granite texture classification , 2011, Machine Vision and Applications.

[18]  Nazli Ikizler-Cinbis,et al.  Object, Scene and Actions: Combining Multiple Features for Human Action Recognition , 2010, ECCV.

[19]  Matti Pietikäinen,et al.  Dynamic Texture Recognition Using Volume Local Binary Patterns , 2006, WDV.

[20]  Keiichi Abe,et al.  Topological structural analysis of digitized binary images by border following , 1985, Comput. Vis. Graph. Image Process..

[21]  Ayoub Al-Hamadi,et al.  Affine-Invariant Feature Extraction for Activity Recognition , 2013 .

[22]  Matti Pietikäinen,et al.  Computer Vision Using Local Binary Patterns , 2011, Computational Imaging and Vision.

[23]  Matti Pietikäinen,et al.  Dynamic textures for human movement recognition , 2010, CIVR '10.

[24]  Ashok Veeraraghavan,et al.  The Function Space of an Activity , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[25]  J. Sullivan,et al.  Action Recognition by Shape Matching to Key Frames , 2002 .

[26]  Christoph Bregler,et al.  Learning and recognizing human dynamics in video sequences , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[27]  Matti Pietikäinen,et al.  Rotation Invariant Image Description with Local Binary Pattern Histogram Fourier Features , 2009, SCIA.

[28]  Yangsheng Xu,et al.  Human action learning via hidden Markov model , 1997, IEEE Trans. Syst. Man Cybern. Part A.

[29]  Ying Wu,et al.  Discriminative Video Pattern Search for Efficient Action Detection , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  KwangYun Wohn,et al.  Recognition of space-time hand-gestures using hidden Markov model , 1996, VRST.

[31]  Rémi Ronfard,et al.  A survey of vision-based methods for action representation, segmentation and recognition , 2011, Comput. Vis. Image Underst..

[32]  Zhiquan Wang,et al.  Recognition of human activities using SVM multi-class classifier , 2010, Pattern Recognit. Lett..

[33]  J. Weickert,et al.  Lucas/Kanade meets Horn/Schunck: combining local and global optic flow methods , 2005 .

[34]  Honghai Liu,et al.  Advances in View-Invariant Human Motion Analysis: A Review , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).