Video analysis of “YouTube funnies” to aid the study of human gait and falls - preliminary results and proof of concept

Because falls are funny, YouTube and other video sharing sites contain a large repository of real-life falls. We propose extracting gait and balance information from these videos to help us better understand some of the factors that contribute to falls. Proof-of-concept is explored in a single video containing multiple (n=14) falls/non-falls in the presence of an unexpected obstacle. The analysis explores: computing spatiotemporal parameters of gait in a video captured from an arbitrary viewpoint; the relationship between parameters of gait from the last few steps before the obstacle and falling vs. not falling; and the predictive capacity of a multivariate model in predicting a fall in the presence of an unexpected obstacle. Homography transformations correct the perspective projection distortion and allow for the consistent tracking of gait parameters as an individual walks in an arbitrary direction in the scene. A synthetic top view allows for computing the average stride length and a synthetic side view allows for measuring up and down motions of the head. In leave-one-out cross-validation, we were able to correctly predict whether a person would fall or not in 11 out of the 14 cases (78.6%), just by looking at the average stride length and the range of vertical head motion during the 1–4 most recent steps prior to reaching the obstacle.

[1]  David J. Fleet,et al.  Human attributes from 3D pose tracking , 2010, Comput. Vis. Image Underst..

[2]  S. Robinovitch,et al.  Video capture of the circumstances of falls in elderly people residing in long-term care: an observational study , 2013, The Lancet.

[3]  Andrew Zisserman,et al.  Progressive search space reduction for human pose estimation , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Andrew Zisserman,et al.  Flowing ConvNets for Human Pose Estimation in Videos , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[5]  Avril Mansfield,et al.  Preventing falls in older adults: new interventions to promote more effective change-in-support balance reactions. , 2008, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[6]  Alex Mihailidis,et al.  Vision-based approach for long-term mobility monitoring: Single case study following total hip replacement. , 2014, Journal of rehabilitation research and development.

[7]  Flavio Firmani,et al.  Biometric system for measuring gait and fall characteristics captured on video. , 2014, Journal of biomechanical engineering.

[8]  Christopher M. Bishop,et al.  Pattern Recognition and Machine Learning (Information Science and Statistics) , 2006 .

[9]  Christian Szegedy,et al.  DeepPose: Human Pose Estimation via Deep Neural Networks , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Fabio Feldman,et al.  Reducing hip fracture risk during sideways falls: evidence in young adults of the protective effects of impact to the hands and stepping. , 2007, Journal of biomechanics.