Human Postural Sway Estimation from Noisy Observations

Postural sway is a reflection of brain signals that are generated to control a person’s balance. During the process of ageing, the postural sway changes, which increases the likelihood of a fall. Thus far, expensive specialist equipment is required, such as a force plate, in order to detect such changes over time, which makes the process costly and impractical. Our long-term goal is to investigate the use of inexpensive, everyday video technology as an alternative. This paper describes a study that establishes a 3-way correlation between the clinical gold standard (force plate), a highly accurate multi-camera 3D video tracking system (Vicon) and a standard RGB video camera. To this end, a dataset of 18 subjects performing the BESS balance test on the force plate was recorded, while simultaneously recording the 3D Vicon data, and the RGB video camera data. Then, using Gaussian process regression and a recurrent neural network, models were built to predict the lateral postural sway in the force plate data from the RGB video data. The predicted results show high correlation with the actual force plate signals, which supports the hypothesis that lateral postural sway can be accurately predicted from video data alone. Detecting changes to a person’s postural sway can be used to improve elderly people’s life by monitoring the likelihood of a fall and detecting its increase well before a fall occurs, so that countermeasures (e.g. exercises) can be put in place to prevent falls occurring.

[1]  James M. Rehg,et al.  Movement Pattern Histogram for Action Recognition and Retrieval , 2014, ECCV.

[2]  Roland Göcke,et al.  Occlusion-Aware Human Pose Estimation with Mixtures of Sub-Trees , 2015, ArXiv.

[3]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[4]  Joel A. Goebel,et al.  Practical Management of the Dizzy Patient , 2001 .

[5]  Jay Smith,et al.  Intrarater and Interrater Reliability of the Balance Error Scoring System (BESS) , 2009, PM & R : the journal of injury, function, and rehabilitation.

[6]  Thomas Wollseifen,et al.  Different methods of calculating body sway area , 2011 .

[7]  A. Shumway-cook,et al.  Postural sway biofeedback: its effect on reestablishing stance stability in hemiplegic patients. , 1988, Archives of physical medicine and rehabilitation.

[8]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[9]  Jay Hertel,et al.  Effect of lower-extremity muscle fatigue on postural control. , 2004, Archives of physical medicine and rehabilitation.

[10]  Roland Göcke,et al.  Monocular Image 3D Human Pose Estimation under Self-Occlusion , 2013, 2013 IEEE International Conference on Computer Vision.

[11]  Shigeru Sonoda,et al.  Validity study of the standing test for imbalance and disequilibrium (SIDE): Is the amount of body sway in adopted postures consistent with item order? , 2011, Gait & posture.

[12]  Quoc V. Le,et al.  Sequence to Sequence Learning with Neural Networks , 2014, NIPS.

[13]  James M. Keller,et al.  Body sway measurement for fall risk assessment using inexpensive webcams , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[14]  Yi Yang,et al.  Articulated pose estimation with flexible mixtures-of-parts , 2011, CVPR 2011.

[15]  Yoshua Bengio,et al.  Neural Machine Translation by Jointly Learning to Align and Translate , 2014, ICLR.

[16]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[17]  A. Torralba,et al.  Motion magnification , 2005, SIGGRAPH 2005.