Kinematic and Kinetic Validation of an Improved Depth Camera Motion Assessment System Using Rigid Bodies

The study of joint kinematics and dynamics has broad clinical applications, including the identification of pathological motions or compensation strategies and the analysis of dynamic stability. High-end motion capture systems, however, are expensive and require dedicated camera spaces with lengthy setup and data processing commitments. Depth cameras, such as the Microsoft Kinect, provide an inexpensive, marker-free alternative at the sacrifice of joint-position accuracy. In this work, we present a fast framework for adding biomechanical constraints to the joint estimates provided by a depth camera system. We also present a new model for the lower lumbar joint angle. We validate key joint position, angle, and velocity measurements against a gold standard active motion-capture system on ten healthy subjects performing sit to stand (STS). Our method showed significant improvement in mean absolute error and intraclass correlation coefficients for the recovered joint angles and position-based metrics. These improvements suggest that depth cameras can provide an accurate and clinically viable method of rapidly assessing the kinematics and kinetics of the STS action, providing data for further analysis using biomechanical or machine learning methods.

[1]  Hans-Peter Seidel,et al.  Fast articulated motion tracking using a sums of Gaussians body model , 2011, 2011 International Conference on Computer Vision.

[2]  Rudolph van der Merwe,et al.  The unscented Kalman filter for nonlinear estimation , 2000, Proceedings of the IEEE 2000 Adaptive Systems for Signal Processing, Communications, and Control Symposium (Cat. No.00EX373).

[3]  D B Chaffin,et al.  A Study of Lumbosacral Orientation under Varied Static Loads , 1986, Spine.

[4]  I. Kingma,et al.  Accuracy of the sagittal vertical axis in a standing lateral radiograph as a measurement of balance in spinal deformities , 1998, European Spine Journal.

[5]  Cristian Sminchisescu,et al.  Human3.6M: Large Scale Datasets and Predictive Methods for 3D Human Sensing in Natural Environments , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  J. Fleiss,et al.  Intraclass correlations: uses in assessing rater reliability. , 1979, Psychological bulletin.

[7]  Antonius Rohlmann,et al.  Comparative evaluation of a novel measurement tool to assess lumbar spine posture and range of motion , 2012, European Spine Journal.

[8]  Gary A. Mirka,et al.  Accuracy of a three-dimensional lumbar motion monitor for recording dynamic trunk motion characteristics , 1992 .

[9]  Xiaowei Zhou,et al.  Coarse-to-Fine Volumetric Prediction for Single-Image 3D Human Pose , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Ayman Habib,et al.  OpenSim: Open-Source Software to Create and Analyze Dynamic Simulations of Movement , 2007, IEEE Transactions on Biomedical Engineering.

[11]  Hartmut Witte,et al.  ISB recommendation on definitions of joint coordinate system of various joints for the reporting of human joint motion--part I: ankle, hip, and spine. International Society of Biomechanics. , 2002, Journal of biomechanics.

[12]  Terry K Koo,et al.  A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research. , 2016, Journal of chiropractic medicine.

[13]  Michael Damsgaard,et al.  THE ANYBODY PROJECT – COMPUTER ANALYSIS OF THE HUMAN BODY , 2002 .

[14]  Matthew P. Reed,et al.  Methods for Measuring and Representing Automobile Occupant Posture , 1999 .

[15]  J W Young,et al.  Spatial Geometry of the Human Pelvis , 1982 .

[16]  W. Crow,et al.  Estimating Cost of Care for Patients With Acute Low Back Pain: A Retrospective Review of Patient Records , 2009, The Journal of the American Osteopathic Association.

[17]  John T. McConville,et al.  Anthropometric source book. Volume 1: Anthropometry for designers , 1978 .

[18]  Hans Kainz,et al.  Reliability of functional and predictive methods to estimate the hip joint centre in human motion analysis in healthy adults. , 2017, Gait & posture.

[19]  F. G. Corley Clinical Tests for the Musculoskeletal System: Examinations-Signs-Phenomena , 2006 .

[20]  Nojun Kwak,et al.  3D Human Pose Estimation Using Convolutional Neural Networks with 2D Pose Information , 2016, ECCV Workshops.

[21]  Sharon M Henry,et al.  Individuals with non-specific low back pain use a trunk stiffening strategy to maintain upright posture. , 2012, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[22]  G. Mahon A Proposal for Strength-of-Agreement Criteria for Lin’s Concordance Correlation Coefficient , 2005 .

[23]  Oliver M O'Reilly,et al.  A Kinect-based movement assessment system: marker position comparison to Vicon , 2017, Computer methods in biomechanics and biomedical engineering.

[24]  Don B. Chaffin,et al.  Development of Computerized Human Static Strength Simulation Model for Job Design , 1997 .

[25]  J. Mizrahi,et al.  Joint torques during sit-to-stand in healthy subjects and people with Parkinson's disease. , 2003, Clinical biomechanics.

[26]  David G Lloyd,et al.  Repeatability of gait data using a functional hip joint centre and a mean helical knee axis. , 2003, Journal of biomechanics.

[27]  Wei Zhang,et al.  Deep Kinematic Pose Regression , 2016, ECCV Workshops.

[28]  Alexandra Pfister,et al.  Comparative abilities of Microsoft Kinect and Vicon 3D motion capture for gait analysis , 2014, Journal of medical engineering & technology.

[29]  D. Cicchetti Guidelines, Criteria, and Rules of Thumb for Evaluating Normed and Standardized Assessment Instruments in Psychology. , 1994 .

[30]  Guoliang Fan,et al.  Articulated and Generalized Gaussian Kernel Correlation for Human Pose Estimation , 2016, IEEE Transactions on Image Processing.

[31]  R. Schmidt,et al.  Evaluation of Lumbar Spine Motion With Dynamic X-ray–A Reliability Analysis , 2006, Spine.

[32]  S L Delp,et al.  A graphics-based software system to develop and analyze models of musculoskeletal structures. , 1995, Computers in biology and medicine.

[33]  B J McFadyen,et al.  Transfer strategies used to rise from a chair in normal and low back pain subjects. , 1994, Clinical biomechanics.

[34]  W S Marras,et al.  Longitudinal Quantitative Measures of the Natural Course of Low Back Pain Recovery , 2000, Spine.

[35]  D. Anton Occupational biomechanics , 1986 .

[36]  William R Taylor,et al.  A novel system for the dynamic assessment of back shape. , 2010, Medical engineering & physics.

[37]  Zhengyou Zhang,et al.  Microsoft Kinect Sensor and Its Effect , 2012, IEEE Multim..

[38]  Moataz A. Eltoukhy,et al.  Validation of Static and Dynamic Balance Assessment Using Microsoft Kinect for Young and Elderly Populations , 2018, IEEE Journal of Biomedical and Health Informatics.

[39]  Hans-Peter Seidel,et al.  VNect , 2017, ACM Trans. Graph..

[40]  Jeffrey K. Uhlmann,et al.  New extension of the Kalman filter to nonlinear systems , 1997, Defense, Security, and Sensing.

[41]  Roman Kamnik,et al.  Model based inertial sensing of human body motion kinematics in sit-to-stand movement , 2008, Simul. Model. Pract. Theory.

[42]  André Plamondon,et al.  Comparative evaluation of six quantitative lifting tools to estimate spine loads during static activities. , 2015, Applied ergonomics.

[43]  K. McGraw,et al.  Forming inferences about some intraclass correlation coefficients. , 1996 .

[44]  A Cappozzo,et al.  Sit-to-stand motor strategies investigated in able-bodied young and elderly subjects. , 2000, Journal of biomechanics.

[45]  Chao Li,et al.  Motion Capture With Ellipsoidal Skeleton Using Multiple Depth Cameras , 2017, IEEE Transactions on Visualization and Computer Graphics.

[46]  Gentiane Venture,et al.  Identification of humanoid robots dynamics using floating-base motion dynamics , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[47]  Ruzena Bajcsy,et al.  Evaluation of Pose Tracking Accuracy in the First and Second Generations of Microsoft Kinect , 2015, 2015 International Conference on Healthcare Informatics.

[48]  Hartmut Witte,et al.  ISB recommendation on definitions of joint coordinate system of various joints for the reporting of human joint motion, I: ankle, hip, and spine , 2002 .