Human motion classification using 2D stick-model matching regression coefficients

A 2D human motion model developed based on polynomial regression data fit.Human motion modeled in three segments: backbone, upper body and lower body.Tolerance rate considers the acceptable range for reliable motion estimations.Classification accuracy for developed estimation model is on par with the actual. Motion estimation methods have been proposed via different approaches, such as silhouette based, model based and image based estimations. However, these methods are highly dependent on the quality of motion data for optimal classification accuracy. Further, because of the complexity of existing algorithms for motion estimation, there are difficulties in interpretation. Hence, the contribution of this work is to model simple human motions for the purpose of recognizing different activity behavior patterns for classification analysis. The model is made up of three body component integrations - Backbone (BB), Upper Body (UB) and Lower Body (LB) - to form a simple 2D human stick figure. Two case studies involving a publicly available video of walking, running and jumping motions as well as experimental captures of Yoga motions are studied. Video motions are simplified into time-step image snapshots, which are later translated into a numeric 2D coordinate system. Initially, the human pelvis is considered the origin of the stick figure. The stick model was drawn by integrating the BB, UB and LB components based on the 2D body joint coordinates. The motion estimation model applies the concept of polynomial fitting to the coordinates data. Computations on the polynomial fitting coefficient deviations at sequential time steps were performed to evaluate the estimation tolerance. A summation of the precedent time-step coordinates with the average deviation metric is used iteratively to estimate the joint coordinates of the stick figure in the subsequent time step to develop the entire motion model. Finally, the developed motion estimation mathematical model was compared to the actual motion phases for classification efficiencies using the Bayes, Lazy, Function, Meta, Misc, Rules and Trees classifiers. Our findings revealed the feasibility of using 2D stick-model matching estimation for human motion classification analysis.

[1]  P. J. García Nieto,et al.  A SVM-based regression model to study the air quality at local scale in Oviedo urban area (Northern Spain): A case study , 2013, Appl. Math. Comput..

[2]  Xuemei Guo,et al.  Compressive classification of human motion using pyroelectric infrared sensors , 2014, Pattern Recognit. Lett..

[3]  Dionisio F. Yáñez,et al.  Cell-average multiresolution based on local polynomial regression. Application to image processing , 2014, Appl. Math. Comput..

[4]  Billur Barshan,et al.  Classifying Human Leg Motions with Uniaxial Piezoelectric Gyroscopes , 2009, Sensors.

[5]  Osama Masoud,et al.  View-independent human motion classification using image-based reconstruction , 2009, Image Vis. Comput..

[6]  Jun Morimoto,et al.  Real-time stylistic prediction for whole-body human motions , 2012, Neural Networks.

[7]  Nadia Magnenat-Thalmann,et al.  A simple footskate removal method for virtual reality applications , 2007, The Visual Computer.

[8]  Neill W. Campbell,et al.  Estimating pose of articulated objects using low-level motion , 2012, Comput. Vis. Image Underst..

[9]  Wen Gao,et al.  Learning discriminative features for fast frame-based action recognition , 2013, Pattern Recognit..

[10]  Pierre Payeur,et al.  Automatic Temporal Location and Classification of Human Actions Based on Optical Features , 2009, 2009 2nd International Congress on Image and Signal Processing.

[11]  和達 三樹 G. L. Lamb, Jr.: Elements of Soliton Theory, John Wiley, New York and Chichester, 1980, xiii+289ページ, 24×17cm, 8,980円(Pure and Applied Mathematics; A Wiley-Interscience Series of Texts, Monographs and Tracts). , 1981 .

[12]  Guoliang Fan,et al.  Two-layer dual gait generative models for human motion estimation from a single camera , 2013, Image Vis. Comput..

[13]  Cristian Canton-Ferrer,et al.  Human motion capture using scalable body models , 2011, Comput. Vis. Image Underst..

[14]  Bedrich Benes,et al.  Sketching human character animations by composing sequences from large motion database , 2013, The Visual Computer.

[15]  Qingmin Liao,et al.  Multiview human pose estimation with unconstrained motions , 2011, Pattern Recognit. Lett..

[16]  Liang Wang,et al.  Human action recognition by feature-reduced Gaussian process classification , 2009, Pattern Recognit. Lett..

[17]  Wei-Yang Lin,et al.  Kernel-based representation for 2D/3D motion trajectory retrieval and classification , 2013, Pattern Recognit..

[18]  Jian J. Zhang,et al.  Automatic Estimation of Skeletal Motion from Optical Motion Capture Data , 2008, MIG.

[19]  Richard Souvenir,et al.  Viewpoint Manifolds for Action Recognition , 2009, EURASIP J. Image Video Process..

[20]  Feifei Zhang,et al.  Motion estimation based on optical flow and an artificial neural network (ANN) , 2009, Artificial Life and Robotics.

[21]  Xueyin Lin,et al.  Human pose estimation from corrupted silhouettes using a sub-manifold voting strategy in latent variable space , 2009, Pattern Recognit. Lett..

[22]  Nikos Nikolaidis,et al.  Activity-based methods for person recognition in motion capture sequences , 2014, Pattern Recognit. Lett..

[23]  Leonardo Bocchi,et al.  Video-Based Human Motion Estimation System , 2009, HCI.

[24]  Kiyoharu Aizawa,et al.  Cooperative estimation of human motion and surfaces using multiview videos , 2013, Comput. Vis. Image Underst..

[25]  Andrew Zisserman,et al.  2D Articulated Human Pose Estimation and Retrieval in (Almost) Unconstrained Still Images , 2012, International Journal of Computer Vision.

[26]  Yaming Wang,et al.  Human motion estimation from monocular image sequence based on cross-entropy regularization , 2003, Pattern Recognit. Lett..

[27]  Xianghua Xie,et al.  A bag of words approach to subject specific 3D human pose interaction classification with random decision forests , 2014, Graph. Model..

[28]  Rin-ichiro Taniguchi,et al.  Real-Time Human Motion Analysis Based on Analysis of Silhouette Contour and Color Blob , 2002, AMDO.

[29]  Sameer Singh,et al.  Video analysis of human dynamics - a survey , 2003, Real Time Imaging.

[30]  Wei Ping Loh,et al.  Data Elimination cum Interpolation for Imputation: A Robust Preprocessing Concept for Human Motion Data , 2013 .

[31]  David Windridge,et al.  An evaluation of bags-of-words and spatio-temporal shapes for action recognition , 2011, 2011 IEEE Workshop on Applications of Computer Vision (WACV).

[32]  Theodore G. Faticoni,et al.  Pure and Applied Mathematics: A Wiley‐Interscience Series of Texts, Monographs and Tracts , 2006 .

[33]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.

[34]  Bodo Rosenhahn,et al.  A System for Marker-Less Human Motion Estimation , 2005, DAGM-Symposium.

[35]  Rama Chellappa,et al.  Ieee Transactions on Pattern Analysis and Machine Intelligence 1 Matching Shape Sequences in Video with Applications in Human Movement Analysis. Ieee Transactions on Pattern Analysis and Machine Intelligence 2 , 2022 .

[36]  Ladislav Jurišica,et al.  Real Time Motion Data Preprocessing , 2010 .

[37]  Jake K. Aggarwal,et al.  Human Motion Analysis: A Review , 1999, Comput. Vis. Image Underst..

[38]  Long Xiang,et al.  Motion Segmentation Based on Edge Detection , 2012 .

[39]  Changryong Baek,et al.  A piecewise polynomial trend against long range dependence , 2015 .

[40]  Alon Wolf,et al.  Motion Estimation using a Statistical Solid Dynamic Method , 2009 .

[41]  Junsong Yuan,et al.  Middle-Level Representation for Human Activities Recognition: The Role of Spatio-Temporal Relationships , 2010, ECCV Workshops.

[42]  Thomas S. Huang,et al.  3D human model and joint parameter estimation from monocular image , 2007, Pattern Recognit. Lett..

[43]  M. Oshita,et al.  Motion Style Transformation by Extracting and Applying Motion Features , 2006 .

[44]  Ehud Rivlin,et al.  Dimensionality reduction using a Gaussian Process Annealed Particle Filter for tracking and classification of articulated body motions , 2011, Comput. Vis. Image Underst..

[45]  Mohan M. Trivedi,et al.  Human Body Model Acquisition and Tracking Using Voxel Data , 2003, International Journal of Computer Vision.

[46]  Jorge S. Marques,et al.  Using middle level features for robust shape tracking , 2003, Pattern Recognit. Lett..

[47]  Dariu Gavrila,et al.  Multi-view 3D Human Pose Estimation in Complex Environment , 2011, International Journal of Computer Vision.

[48]  Michael F. Cohen,et al.  Verbs and Adverbs: Multidimensional Motion Interpolation , 1998, IEEE Computer Graphics and Applications.

[49]  Christopher T. Lovelace,et al.  Classification of body movements based on posturographic data. , 2014, Human movement science.

[50]  Bodo Rosenhahn,et al.  Silhouette Based Human Motion Estimation , 2004, DAGM-Symposium.

[51]  Avi Parush,et al.  Perceptual validity in animation of human motion , 2016, Comput. Animat. Virtual Worlds.

[52]  S. Ali Etemad,et al.  Classification and translation of style and affect in human motion using RBF neural networks , 2014, Neurocomputing.

[53]  Aaron Hertzmann,et al.  Style machines , 2000, SIGGRAPH 2000.

[54]  Dong-Jo Park,et al.  Unsupervised video object segmentation and tracking based on new edge features , 2004, Pattern Recognit. Lett..

[55]  Irena Orovic,et al.  A new approach for classification of human gait based on time-frequency feature representations , 2011, Signal Process..

[56]  Adrian Hilton,et al.  A survey of advances in vision-based human motion capture and analysis , 2006, Comput. Vis. Image Underst..

[57]  Jessica K. Hodgins,et al.  Interactive control of avatars animated with human motion data , 2002, SIGGRAPH.

[58]  Lance Williams,et al.  Motion signal processing , 1995, SIGGRAPH.

[59]  Ugur Güdükbay,et al.  Motion capture and human pose reconstruction from a single-view video sequence , 2013, Digit. Signal Process..

[60]  Loris Nanni,et al.  Local Ternary Patterns from Three Orthogonal Planes for human action classification , 2011, Expert Syst. Appl..

[61]  S. Ali Etemad,et al.  SEGMENTATION AND CLASSIFICATION OF H UMAN ACTIONS AND ACTOR CHARACTERISTICS WITH 3D M OTION DATA , 2012 .