Performance analysis of a generalized motion capture system using microsoft kinect 2.0

Abstract This work presents a fine-grained analysis of the performance and limitations of the Microsoft Kinect sensor for tracking human movement in the context of biomechanical research and clinical applications. Earlier work in this field has focused on scalar summary measures or ad-hoc metrics with respect to specific movements that do not generalize well across clinical applications. In this work, the performance of the Microsoft Kinect is compared to motion tracking from a concurrently sampled professional grade Qualisys motion capture system. Subjects performed a range of clinically relevant tasks such as Sit-to-Stand and Timed Up-and-Go. Captured data included both three-dimensional joint center displacements and joint angles as recorded from both systems. Kinect performance was measured using cross correlation coefficients (CCR), root mean squared error (RMSE) relative to the Qualisys gold-standard and a new summary metric (SM) that combines both. Our results show that the Kinect-based system provides adequate performance when tracking joint center displacements in time, with overall CCR = 0.78, RMSE = 3.35 cm and SM = 1.21. On the contrary, lower accuracy was measured when tracking joint angles, with CCR = 0.58, RMSE = 24.59°, and SM = 3.76. Although performance differences for various movements and motion planes have been found, the results suggest that the Kinect is a viable tool for general biomechanical research, with specific limits on what levels of performance can be expected under various conditions.

[1]  Ross A Clark,et al.  Gait assessment using the Microsoft Xbox One Kinect: Concurrent validity and inter-day reliability of spatiotemporal and kinematic variables. , 2015, Journal of biomechanics.

[2]  Ruzena Bajcsy,et al.  Evaluation of Pose Tracking Accuracy in the First and Second Generations of Microsoft Kinect , 2015, 2015 International Conference on Healthcare Informatics.

[3]  R. B. Davis,et al.  A gait analysis data collection and reduction technique , 1991 .

[4]  Melvyn Roerdink,et al.  Kinematic Validation of a Multi-Kinect v2 Instrumented 10-Meter Walkway for Quantitative Gait Assessments , 2015, PloS one.

[5]  A. Cappozzo,et al.  Human movement analysis using stereophotogrammetry. Part 1: theoretical background. , 2005, Gait & posture.

[6]  David A. Winter,et al.  Biomechanics and Motor Control of Human Movement , 1990 .

[7]  Ruzena Bajcsy,et al.  Remote Health Coaching System and Human Motion Data Analysis for Physical Therapy with Microsoft Kinect , 2015, ArXiv.

[8]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  P. Olivier,et al.  Accuracy of the Microsoft Kinect sensor for measuring movement in people with Parkinson's disease. , 2014, Gait & posture.

[10]  Knut Möller,et al.  Evaluating the microsoft kinect skeleton joint tracking as a tool for home-based physiotherapy , 2015 .

[11]  Richard Campbell,et al.  Validation of the Microsoft Kinect® camera system for measurement of lower extremity jump landing and squatting kinematics , 2016, Sports biomechanics.

[12]  Carole Tucker,et al.  Automated assessment of postural stability system , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[13]  Xu Xu,et al.  Accuracy of the Microsoft Kinect for measuring gait parameters during treadmill walking. , 2015, Gait & posture.

[14]  Laurence Chèze,et al.  Rotation sequence as an important factor in shoulder kinematics. , 2006, Clinical biomechanics.

[15]  Alexandra Pfister,et al.  Comparative abilities of Microsoft Kinect and Vicon 3D motion capture for gait analysis , 2014, Journal of medical engineering & technology.

[16]  Alex Mihailidis,et al.  Concurrent validity of the Microsoft Kinect for Windows v2 for measuring spatiotemporal gait parameters. , 2016, Medical engineering & physics.

[17]  Linda Denehy,et al.  Validity of the Microsoft Kinect for assessment of postural control. , 2012, Gait & posture.

[18]  Dohyung Lim,et al.  Use of the Microsoft Kinect system to characterize balance ability during balance training , 2015, Clinical interventions in aging.

[19]  Geoff Rose,et al.  High-speed camera characterization of voluntary eye blinking kinematics , 2013, Journal of The Royal Society Interface.

[20]  B Bonnechère,et al.  Validity and reliability of the Kinect within functional assessment activities: comparison with standard stereophotogrammetry. , 2014, Gait & posture.

[21]  M. Johnson,et al.  Circulating microRNAs in Sera Correlate with Soluble Biomarkers of Immune Activation but Do Not Predict Mortality in ART Treated Individuals with HIV-1 Infection: A Case Control Study , 2015, PloS one.

[22]  Ross A Clark,et al.  Reliability and concurrent validity of the Microsoft Xbox One Kinect for assessment of standing balance and postural control. , 2015, Gait & posture.

[23]  Bryan Buchholz,et al.  ISB recommendation on definitions of joint coordinate systems of various joints for the reporting of human joint motion--Part II: shoulder, elbow, wrist and hand. , 2005, Journal of biomechanics.

[24]  Ayman Habib,et al.  OpenSim: Open-Source Software to Create and Analyze Dynamic Simulations of Movement , 2007, IEEE Transactions on Biomedical Engineering.

[25]  Hartmut Witte,et al.  ISB recommendation on definitions of joint coordinate system of various joints for the reporting of human joint motion--part I: ankle, hip, and spine. International Society of Biomechanics. , 2002, Journal of biomechanics.

[26]  Marjorie Skubic,et al.  Evaluation of the Microsoft Kinect for screening ACL injury , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[27]  A. Nemtsov Alcohol consumption level in Russia: a viewpoint on monitoring health conditions in the Russian Federation (RLMS). , 2003, Addiction.

[28]  Kade Paterson,et al.  Instrumenting gait assessment using the Kinect in people living with stroke: reliability and association with balance tests , 2015, Journal of NeuroEngineering and Rehabilitation.

[29]  Toby Sharp,et al.  Real-time human pose recognition in parts from single depth images , 2011, CVPR.

[30]  Kelly J. Bower,et al.  Concurrent validity of the Microsoft Kinect for assessment of spatiotemporal gait variables. , 2013, Journal of biomechanics.

[31]  Paul McCrory,et al.  Validity and reliability of the Nintendo Wii Balance Board for assessment of standing balance. , 2010, Gait & posture.

[32]  Winson C.C. Lee,et al.  Evaluation of the Microsoft Kinect as a clinical assessment tool of body sway. , 2014, Gait & posture.