Human action recognition in compressed domain using PBL-McRBFN approach

Large variations in human actions lead to major challenges in computer vision research. Several algorithms are designed to solve the challenges. Algorithms that stand apart, help in solving the challenge in addition to performing faster and efficient manner. In this paper, we propose a human cognition inspired projection based learning for person-independent human action recognition in the H.264/AVC compressed domain and demonstrate a PBL-McRBFN based approach to help take the machine learning algorithms to the next level. Here, we use gradient image based feature extraction process where the motion vectors and quantization parameters are extracted and these are studied temporally to form several Group of Pictures (GoP). The GoP is then considered individually for two different bench mark data sets and the results are classified using person independent human action recognition. The functional relationship is studied using Projection Based Learning algorithm of the Meta-cognitive Radial Basis Function Network (PBL-McRBFN) which has a cognitive and meta-cognitive component. The cognitive component is a radial basis function network while the Meta-Cognitive Component(MCC) employs self regulation. The McC emulates human cognition like learning to achieve better performance. Performance of the proposed approach can handle sparse information in compressed video domain and provides more accuracy than other pixel domain counterparts. Performance of the feature extraction process achieved more than 90% accuracy using the PBL-McRBFN which catalyzes the speed of the proposed high speed action recognition algorithm. We have conducted twenty random trials to find the performance in GoP. The results are also compared with other well known classifiers in machine learning literature.

[1]  Thomas Serre,et al.  HMDB: A large video database for human motion recognition , 2011, 2011 International Conference on Computer Vision.

[2]  K. Subramanian,et al.  Human Action Recognition using MetaCognitive Neuro-Fuzzy Inference System , 2012 .

[3]  R. Venkatesh Babu,et al.  Rapid human action recognition in H.264/AVC compressed domain for video surveillance , 2013, 2013 Visual Communications and Image Processing (VCIP).

[4]  Ayoub Al-Hamadi,et al.  A Fast Statistical Approach for Human Activity Recognition , 2012 .

[5]  Narasimhan Sundararajan,et al.  A Metacognitive Neuro-Fuzzy Inference System (McFIS) for Sequential Classification Problems , 2013, IEEE Transactions on Fuzzy Systems.

[6]  S. Shankar Sastry,et al.  High-Speed Action Recognition and Localization in Compressed Domain Videos , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[8]  Shyh-Kang Jeng,et al.  Action recognition using instance-specific and class-consistent cues , 2012, 2012 19th IEEE International Conference on Image Processing.

[9]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.

[10]  R. Venkatesh Babu,et al.  Subject independent human action recognition using spatio-depth information and meta-cognitive RBF network , 2013, Eng. Appl. Artif. Intell..

[11]  R. Venkatesh Babu,et al.  Compressed domain action classification using HMM , 2002, Pattern Recognit. Lett..

[12]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[13]  Sundaram Suresh,et al.  Human action recognition using Meta-Cognitive Neuro-Fuzzy Inference System , 2012, The 2012 International Joint Conference on Neural Networks (IJCNN).

[14]  Ronen Basri,et al.  Actions as space-time shapes , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[15]  Sundaram Suresh,et al.  A projection based learning in Meta-cognitive Radial Basis Function Network for classification problems , 2012, The 2012 International Joint Conference on Neural Networks (IJCNN).

[16]  R. Venkatesh Babu,et al.  Human action recognition using a fast learning fully complex-valued classifier , 2012, Neurocomputing.

[17]  Chunfeng Yuan,et al.  HUMAN ACTION RECOGNITION BASED ON A HEAT KERNEL STRUCTURAL DESCRIPTOR , 2012 .

[18]  Wayne H. Wolf,et al.  Human activity detection in MPEG sequences , 2000, Proceedings Workshop on Human Motion.

[19]  R. Venkatesh Babu,et al.  Recognition of human actions using motion history information extracted from the compressed video , 2004, Image Vis. Comput..

[20]  Yang Wang,et al.  Max-margin hidden conditional random fields for human action recognition , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Tae-Kyun Kim,et al.  Real-time Action Recognition by Spatiotemporal Semantic and Structural Forests , 2010, BMVC.

[22]  Pong C. Yuen,et al.  Human action recognition using boosted EigenActions , 2010, Image Vis. Comput..

[23]  Zhu Li,et al.  Real-time human action recognition by luminance field trajectory analysis , 2008, ACM Multimedia.

[24]  Gary J. Sullivan,et al.  Rate-constrained coder control and comparison of video coding standards , 2003, IEEE Trans. Circuits Syst. Video Technol..

[25]  Mubarak Shah,et al.  UCF101: A Dataset of 101 Human Actions Classes From Videos in The Wild , 2012, ArXiv.

[26]  Sundaram Suresh,et al.  A Meta-Cognitive Learning Algorithm for an Extreme Learning Machine Classifier , 2013, Cognitive Computation.

[27]  Sundaram Suresh,et al.  A meta-cognitive sequential learning algorithm for neuro-fuzzy inference system , 2012, Appl. Soft Comput..

[28]  Victor C. M. Leung,et al.  Non-negative sparse coding for human action recognition , 2012, 2012 19th IEEE International Conference on Image Processing.

[29]  Zhenjiang Miao,et al.  Human action categories using motion descriptors , 2012, 2012 19th IEEE International Conference on Image Processing.

[30]  Sundaram Suresh,et al.  Meta-cognitive RBF Network and its Projection Based Learning algorithm for classification problems , 2013, Appl. Soft Comput..

[31]  Sundaram Suresh,et al.  A meta-cognitive learning algorithm for a Fully Complex-valued Relaxation Network , 2012, Neural Networks.

[32]  Sundaram Suresh,et al.  Metacognitive Learning in a Fully Complex-Valued Radial Basis Function Neural Network , 2012, Neural Computation.