Detecting load conditions in human walking using expectation maximization and neural networks

Weight carrying conditions in human subjects is classified using a mixture of Gaussian based classifier and neural networks. Expectation maximization (EM) algorithm is used to learn the model parameters for the mixture of Gaussian (MOG) based classifier. Since variables change in time as the human subjects walk, and likelihood score in a mixture model is usually calculated for stationary data, a scoring system is developed to calculate how likely a time sequence of variables belongs to a particular distribution. A neural network (NN) based classifier is also developed which uses the traditional back-propagation algorithm for training. The results obtained show overall 74.1% accuracy using MOG and 66.4% using NN for the test set in a binary classification task of detecting “load” or “no-load” conditions using just two variables. The lower accuracy using NN is not surprising as averaged variables are provided as inputs to the NN while MOG is able to use the dynamic information. In another classification task with four classes and using two variables, the accuracy was 37.2% using MOG and 34.2% using NN on the test set which are both better than chance. Accuracy of NN using 7 variables was 81.4% for binary classification and 41.3% for four-class classification. An interesting finding from these results is that NN (using 7 averaged variables) performed better than human perceivers who were asked to judge based on stick figure animations of subjects walking. Another interesting revelation from this study was that the covariance matrices from the MOG model revealed “anti-phase” locking of the elbow and stoop angle as the subjects walk.

[1]  S. D. Prentice,et al.  Simple artificial neural network models can generate basic muscle activity patterns for human locomotion at different speeds , 1998, Experimental Brain Research.

[2]  Lyle N. Long,et al.  Scalable Massively Parallel Artificial Neural Networks , 2005, J. Aerosp. Comput. Inf. Commun..

[3]  Paul J. Werbos Backpropagation: basics and new developments , 1998 .

[4]  Lyle N. Long,et al.  Character Recognition using Spiking Neural Networks , 2007, 2007 International Joint Conference on Neural Networks.

[5]  J. MacQueen Some methods for classification and analysis of multivariate observations , 1967 .

[6]  Jacek M. Zurada,et al.  Introduction to artificial neural systems , 1992 .

[7]  Jitendra Malik,et al.  Blobworld: Image Segmentation Using Expectation-Maximization and Its Application to Image Querying , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Michael J. Black,et al.  Mixture models for optical flow computation , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[9]  James M. Rehg,et al.  Statistical Color Models with Application to Skin Detection , 2004, International Journal of Computer Vision.

[10]  A E Patla,et al.  Artificial neural network model for the generation of muscle activation patterns for human locomotion. , 2001, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[11]  Paul J. Werbos,et al.  The Roots of Backpropagation: From Ordered Derivatives to Neural Networks and Political Forecasting , 1994 .

[12]  R. Jain,et al.  Estimation of articulated motion using kinematically constrained mixture densities , 1997, Proceedings IEEE Nonrigid and Articulated Motion Workshop.

[13]  J. Nazuno Haykin, Simon. Neural networks: A comprehensive foundation, Prentice Hall, Inc. Segunda Edición, 1999 , 2000 .

[14]  M. Hahn,et al.  A Model for Detecting Balance Impairment and Estimating Falls Risk in the Elderly , 2005, Annals of Biomedical Engineering.

[15]  Robert T. Collins,et al.  Silhouette-based human identification from body shape and gait , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[16]  James M. Rehg,et al.  Analyzing articulated motion using expectation-maximization , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[17]  C. Tomasi Estimating Gaussian Mixture Densities with EM – A Tutorial , 2004 .

[18]  Lyle N. Long,et al.  Hebbian learning with winner take all for spiking neural networks , 2009, 2009 International Joint Conference on Neural Networks.

[19]  D W Grieve,et al.  The use of neural networks to recognize patterns of human movement: gait patterns. , 1995, Clinical biomechanics.

[20]  R Lafuente,et al.  Design and test of neural networks and statistical classifiers in computer-aided movement analysis: a case study on gait analysis. , 1998, Clinical biomechanics.

[21]  Mahesan Niranjan,et al.  Realisable Classifiers: Improving Operating Performance on Variable Cost Problems , 1998, BMVC.

[22]  J. G. Barton,et al.  An application of neural networks for distinguishing gait patterns on the basis of hip-knee joint angle diagrams , 1997 .

[23]  S. Hyakin,et al.  Neural Networks: A Comprehensive Foundation , 1994 .

[24]  Ben J. A. Kröse,et al.  An EM-like algorithm for color-histogram-based object tracking , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[25]  Hans H.C.M. Savelberg,et al.  Assessment of the horizontal, fore-aft component of the ground reaction force from insole pressure patterns by using artificial neural networks , 1999 .

[26]  B. Kröse,et al.  An EM-like algorithm for color-histogram-based object tracking , 2004, CVPR 2004.