Automated Analysis and Quantification of Human Mobility Using a Depth Sensor

Analysis and quantification of human motion to support clinicians in the decision-making process is the desired outcome for many clinical-based approaches. However, generating statistical models that are free from human interpretation and yet representative is a difficult task. In this paper, we propose a framework that automatically recognizes and evaluates human mobility impairments using the Microsoft Kinect One depth sensor. The framework is composed of two parts. First, it recognizes motions, such as sit-to-stand or walking 4 m, using abstract feature representation techniques and machine learning. Second, evaluation of the motion sequence in the temporal domain by comparing the test participant with a statistical mobility model, generated from tracking movements of healthy people. To complement the framework, we propose an automatic method to enable a fairer, unbiased approach to label motion capture data. Finally, we demonstrate the ability of the framework to recognize and provide clinically relevant feedback to highlight mobility concerns, hence providing a route toward stratified rehabilitation pathways and clinician-led interventions.

[1]  Gunnar Rätsch,et al.  Totally corrective boosting algorithms that maximize the margin , 2006, ICML.

[2]  S. Heymsfield,et al.  Epidemiology of sarcopenia among the elderly in New Mexico. , 1998, American journal of epidemiology.

[3]  Moi Hoon Yap,et al.  Benchmarking human motion analysis using kinect one: An open source dataset , 2015, 2015 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA).

[4]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[5]  Marco Grangetto,et al.  Gait characterization using dynamic skeleton acquisition , 2013, 2013 IEEE 15th International Workshop on Multimedia Signal Processing (MMSP).

[6]  Ian J. Deary,et al.  Grip Strength across the Life Course: Normative Data from Twelve British Studies , 2014, PloS one.

[7]  Mohammad H. Mahoor,et al.  Automatic measurement of physical mobility in Get-Up-and-Go Test using kinect sensor , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[8]  Ana-Maria Cretu,et al.  Human movement quantification using Kinect for in-home physical exercise monitoring , 2014, 2014 IEEE International Conference on Computational Intelligence and Virtual Environments for Measurement Systems and Applications (CIVEMSA).

[9]  Lichao Zhang,et al.  A Kinect based Golf Swing Score and Grade System using GMM and SVM , 2012, 2012 5th International Congress on Image and Signal Processing.

[10]  Masayoshi Tomizuka,et al.  A tele-monitoring system for gait rehabilitation with an inertial measurement unit and a shoe-type ground reaction force sensor , 2013 .

[11]  Patricia Gregory,et al.  Clinical Telerehabilitation: Applications for Physiatrists , 2011, PM & R : the journal of injury, function, and rehabilitation.

[12]  Alex Mihailidis,et al.  A MARKERLESS MOTION TRACKING APPROACH TO UNDERSTAND CHANGES IN GAIT AND BALANCE : A CASE STUDY , 2013 .

[13]  H. Boter,et al.  Prevalence of Frailty in Community‐Dwelling Older Persons: A Systematic Review , 2012, Journal of the American Geriatrics Society.

[14]  Gérard G. Medioni,et al.  Home Monitoring Musculo-skeletal Disorders with a Single 3D Sensor , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[15]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[16]  David Webster,et al.  Experimental evaluation of Microsoft Kinect's accuracy and capture rate for stroke rehabilitation applications , 2014, 2014 IEEE Haptics Symposium (HAPTICS).

[17]  Yong Du,et al.  Hierarchical recurrent neural network for skeleton based action recognition , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Trevor Hastie,et al.  The Elements of Statistical Learning , 2001 .

[19]  Linda Denehy,et al.  Validity of the Microsoft Kinect for assessment of postural control. , 2012, Gait & posture.

[20]  Octavian Postolache,et al.  Kinect based system and Artificial Neural Networks classifiers for physiotherapy assessment , 2014, 2014 IEEE International Symposium on Medical Measurements and Applications (MeMeA).

[21]  Vassiliki Derri,et al.  The effect of Xbox Kinect intervention on balance ability for previously injured young competitive male athletes: a preliminary study. , 2014, Physical therapy in sport : official journal of the Association of Chartered Physiotherapists in Sports Medicine.

[22]  Kingshuk Chakravarty,et al.  Pose Based Person Identification Using Kinect , 2013, 2013 IEEE International Conference on Systems, Man, and Cybernetics.

[23]  John Darby,et al.  Exemplar-Based Human Action Recognition with Template Matching from a Stream of Motion Capture , 2014, ICIAR.

[24]  P. Verschure,et al.  Virtual reality based rehabilitation speeds up functional recovery of the upper extremities after stroke: a randomized controlled pilot study in the acute phase of stroke using the rehabilitation gaming system. , 2011, Restorative neurology and neuroscience.

[25]  Jean-Christophe Nebel,et al.  Temporal Extension of Laplacian Eigenmaps for Unsupervised Dimensionality Reduction of Time Series , 2010, 2010 20th International Conference on Pattern Recognition.

[26]  P. Verschure,et al.  The rehabilitation gaming system: a review. , 2009, Studies in health technology and informatics.

[27]  P. Verschure,et al.  Neurorehabilitation using the virtual reality based Rehabilitation Gaming System: methodology, design, psychometrics, usability and validation , 2010, Journal of NeuroEngineering and Rehabilitation.

[28]  Yoav Freund,et al.  A Short Introduction to Boosting , 1999 .

[29]  John Cosmas,et al.  Recognition of postures and Freezing of Gait in Parkinson's disease patients using Microsoft Kinect sensor , 2015, 2015 7th International IEEE/EMBS Conference on Neural Engineering (NER).

[30]  Dimitrios Makris,et al.  Clustered Spatio-temporal Manifolds for Online Action Recognition , 2014, 2014 22nd International Conference on Pattern Recognition.

[31]  M. Fuhrer Subjectifying quality of life as a medical rehabilitation outcome , 2000, Disability and rehabilitation.

[32]  Dejan Gjorgjevikj,et al.  Evaluation of different feature sets for gait recognition using skeletal data from Kinect , 2014, 2014 37th International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO).

[33]  P. Olivier,et al.  Accuracy of the Microsoft Kinect sensor for measuring movement in people with Parkinson's disease. , 2014, Gait & posture.

[34]  Philippe Fraisse,et al.  Estimation of the center of mass with Kinect and Wii balance board , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[35]  L. Ferrucci,et al.  A short physical performance battery assessing lower extremity function: association with self-reported disability and prediction of mortality and nursing home admission. , 1994, Journal of gerontology.

[36]  Philippe Fraisse,et al.  A personalized balance measurement for home-based rehabilitation , 2015, 2015 7th International IEEE/EMBS Conference on Neural Engineering (NER).

[37]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[38]  John Darby,et al.  Human Activity Recognition for Physical Rehabilitation , 2013, 2013 IEEE International Conference on Systems, Man, and Cybernetics.

[39]  B. Schölkopf,et al.  Modeling Human Motion Using Binary Latent Variables , 2007 .

[40]  L. Fried,et al.  Frailty in older adults: evidence for a phenotype. , 2001, The journals of gerontology. Series A, Biological sciences and medical sciences.

[41]  Taghi M. Khoshgoftaar,et al.  RUSBoost: Improving classification performance when training data is skewed , 2008, 2008 19th International Conference on Pattern Recognition.