Video-Based Human Activity Recognition Using Multilevel Wavelet Decomposition and Stepwise Linear Discriminant Analysis

Video-based human activity recognition (HAR) means the analysis of motions and behaviors of human from the low level sensors. Over the last decade, automatic HAR is an exigent research area and is considered a significant concern in the field of computer vision and pattern recognition. In this paper, we have presented a robust and an accurate activity recognition system called WS-HAR that consists of wavelet transform coupled with stepwise linear discriminant analysis (SWLDA) followed by hidden Markov model (HMM). Symlet wavelet has been employed in order to extract the features from the activity frames. The most prominent features were selected by proposing a robust technique called stepwise linear discriminant analysis (SWLDA) that focuses on selecting the localized features from the activity frames and discriminating their class based on regression values (i.e., partial F-test values). Finally, we applied a well-known sequential classifier called hidden Markov model (HMM) to give the appropriate labels to the activities. In order to validate the performance of the WS-HAR, we utilized two publicly available standard datasets under two different experimental settings, n–fold cross validation scheme based on subjects; and a set of experiments was performed in order to show the effectiveness of each approach. The weighted average recognition rate for the WS-HAR was 97% across the two different datasets that is a significant improvement in classication accuracy compared to the existing well-known statistical and state-of-the-art methods.

[1]  Bingbing Ni,et al.  RGBD-HuDaAct: A color-depth video database for human daily activity recognition , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[2]  R. Rodrigo,et al.  Faster human activity recognition with SVM , 2012, International Conference on Advances in ICT for Emerging Regions (ICTer2012).

[3]  B. Ijaz,et al.  Vision based human activity tracking using artificial neural networks , 2010, 2010 International Conference on Intelligent and Advanced Systems.

[4]  Neha Mehan,et al.  Recognition of Human Actions Using Motion History Information Extracted from the Compressed , 2013 .

[5]  Lior Wolf,et al.  Local Trinary Patterns for human action recognition , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[6]  Barbara Caputo,et al.  Recognizing human actions: a local SVM approach , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[7]  Lasitha Piyathilaka,et al.  Gaussian mixture based HMM for human daily activity recognition using 3D skeleton features , 2013, 2013 IEEE 8th Conference on Industrial Electronics and Applications (ICIEA).

[8]  V. Sadasivam,et al.  Optimized Local Ternary Patterns: a New texture Model with Set of Optimal Patterns for texture Analysis , 2013, J. Comput. Sci..

[9]  Hong Zhang,et al.  Exploring Techniques for Vision Based Human Activity Recognition: Methods, Systems, and Evaluation , 2013, Sensors.

[10]  Theo Gevers,et al.  Evaluation of Color Spatio-Temporal Interest Points for Human Action Recognition , 2014, IEEE Transactions on Image Processing.

[11]  Tal Hassner,et al.  The Action Similarity Labeling Challenge , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Lamberto Ballan,et al.  Human Action Recognition and Localization using Spatio-temporal Descriptors and Tracking , 2009 .

[13]  Md. Zia Uddin,et al.  Independent shape component-based human activity recognition via Hidden Markov Model , 2010, Applied Intelligence.

[14]  Hoang Le Uyen Thuc,et al.  Quasi-periodic action recognition from monocular videos via 3D human models and cyclic HMMs , 2012, The 2012 International Conference on Advanced Technologies for Communications.

[15]  Serge J. Belongie,et al.  Behavior recognition via sparse spatio-temporal features , 2005, 2005 IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance.

[16]  Rama Chellappa,et al.  "Shape Activity": a continuous-state HMM for moving/deforming shapes with application to abnormal activity detection , 2005, IEEE Transactions on Image Processing.

[17]  Jiebo Luo,et al.  Recognizing realistic actions from videos “in the wild” , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[18]  Kostas Karpouzis,et al.  Exploring trace transform for robust human action recognition , 2013, Pattern Recognit..

[19]  Ronen Basri,et al.  Actions as space-time shapes , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[20]  Eli Shechtman,et al.  Space-time behavior based correlation , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[21]  Araceli Sanchis,et al.  Activity Recognition Using Hybrid Generative/Discriminative Models on Home Environments Using Binary Sensors , 2013, Sensors.

[22]  L. Baum,et al.  An inequality and associated maximization technique in statistical estimation of probabilistic functions of a Markov process , 1972 .

[23]  Jukka Turunen,et al.  A wavelet-based method for estimating damping in power systems , 2011 .

[24]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[25]  Jenq-Neng Hwang,et al.  A Review on Video-Based Human Activity Recognition , 2013, Comput..

[26]  Martin D. Levine,et al.  A Multi-Scale Hierarchical Codebook Method for Human Action Recognition in Videos Using a Single Example , 2012, 2012 Ninth Conference on Computer and Robot Vision.

[27]  Johan Stephen Simeon Ballot Face recognition using Hidden Markov Models , 2005 .

[28]  R. Venkatesh Babu,et al.  Recognition of human actions using motion history information extracted from the compressed video , 2004, Image Vis. Comput..

[29]  Anil K. Jain,et al.  Statistical Pattern Recognition: A Review , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  Martin D. Levine,et al.  Human activity recognition in videos using a single example , 2013, Image Vis. Comput..

[31]  Cordelia Schmid,et al.  Learning realistic human actions from movies , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[32]  Irfan A. Essa,et al.  Augmenting Bag-of-Words: Data-Driven Discovery of Temporal and Structural Information for Activity Recognition , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[33]  James J. Little,et al.  Incremental Learning for Video-Based Gait Recognition With LBP Flow , 2013, IEEE Transactions on Cybernetics.

[34]  Martial Hebert,et al.  Spatio-temporal Shape and Flow Correlation for Action Recognition , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[35]  Brian C. Lovell,et al.  Spatio-temporal covariance descriptors for action and gesture recognition , 2013, 2013 IEEE Workshop on Applications of Computer Vision (WACV).

[36]  H. Foroughi,et al.  An eigenspace-based approach for human fall detection using Integrated Time Motion Image and Neural Network , 2008, 2008 9th International Conference on Signal Processing.

[37]  J.K. Aggarwal,et al.  Human activity analysis , 2011, ACM Comput. Surv..

[38]  Radha Poovendran,et al.  Human activity recognition for video surveillance , 2008, 2008 IEEE International Symposium on Circuits and Systems.

[39]  Chin-Pan Huang,et al.  Human Action Recognition Using Histogram of Oriented Gradient of Motion History Image , 2011, 2011 First International Conference on Instrumentation, Measurement, Computer, Communication and Control.

[40]  G. Baudat,et al.  Generalized Discriminant Analysis Using a Kernel Approach , 2000, Neural Computation.

[41]  H. S. Wolff,et al.  iRun: Horizontal and Vertical Shape of a Region-Based Graph Compression , 2022, Sensors.

[42]  Jean-Marc Odobez,et al.  Time-sensitive topic models for action recognition in videos , 2013, 2013 IEEE International Conference on Image Processing.

[43]  Jake K. Aggarwal,et al.  Real-time detection of illegally parked vehicles using 1-D transformation , 2007, 2007 IEEE Conference on Advanced Video and Signal Based Surveillance.

[44]  Megha D. Bengalur Human activity recognition using body pose features and support vector machine , 2013, 2013 International Conference on Advances in Computing, Communications and Informatics (ICACCI).

[45]  Shih-Fu Chang,et al.  The holy grail of content-based media analysis , 2002 .

[46]  B. Scholkopf,et al.  Fisher discriminant analysis with kernels , 1999, Neural Networks for Signal Processing IX: Proceedings of the 1999 IEEE Signal Processing Society Workshop (Cat. No.98TH8468).

[47]  M. Kalaiselvi Geetha,et al.  Motion Intensity Code for Action Recognition in Video Using PCA and SVM , 2013, MIKE.

[48]  E. W. Sellers,et al.  Toward enhanced P300 speller performance , 2008, Journal of Neuroscience Methods.

[49]  Faicel Chamroukhi,et al.  An Unsupervised Approach for Automatic Activity Recognition Based on Hidden Markov Model Regression , 2013, IEEE Transactions on Automation Science and Engineering.

[50]  Thomas Serre,et al.  HMDB: A large video database for human motion recognition , 2011, 2011 International Conference on Computer Vision.

[51]  Shiv Ram Dubey,et al.  Human Activity Recognition Using Gait Pattern , 2013, Int. J. Comput. Vis. Image Process..

[52]  Tae-Seong Kim,et al.  An Indoor Human Activity Recognition System for Smart Home Using Local Binary Pattern Features with Hidden Markov Models , 2013 .

[53]  Lihong Zheng,et al.  Three Dimensional Motion Trail Model for Gesture Recognition , 2013, 2013 IEEE International Conference on Computer Vision Workshops.

[54]  Sebastian Mika,et al.  Kernel Fisher Discriminants , 2003 .

[55]  Cordelia Schmid,et al.  Action recognition by dense trajectories , 2011, CVPR 2011.

[56]  Adrian Hilton,et al.  A survey of advances in vision-based human motion capture and analysis , 2006, Comput. Vis. Image Underst..