A Depth Camera Motion Analysis Framework for Tele-rehabilitation: Motion Capture and Person-Centric Kinematics Analysis

With increasing importance given to tele-rehabilitation, there is a growing need for accurate, low-cost, and portable motion capture systems that do not require specialist assessment venues. This paper proposes a novel framework for motion capture using only a single depth camera, which is portable and cost effective compared to most industry-standard optical systems, without compromising on accuracy. Novel signal processing and computer vision algorithms are proposed to determine motion patterns of interest from infrared and depth data. In order to demonstrate the proposed framework's suitability for rehabilitation, we developed a gait analysis application that depends on the underlying motion capture sub-system. Each subject's individual kinematics parameters, which are unique to that subject, are calculated and stored for monitoring individual progress of the clinical therapy. Experiments were conducted on 14 different subjects, 5 healthy, and 9 stroke survivors. The results show very close agreement of the resulting relevant joint angles with a benchmarking 12-camera based VICON system, a mean error of at most 1.75 % in detecting gait events w.r.t. the hand-labeled ground-truth, and significant performance improvements in terms of accuracy and efficiency compared to a previous Kinect-based system.

[1]  Shaou-Gang Miaou,et al.  A gait analysis system using two cameras with orthogonal view , 2011, 2011 International Conference on Multimedia Technology.

[2]  Byongmin Kang,et al.  Parametric model-based noise reduction for ToF depth sensors , 2012, Electronic Imaging.

[3]  Ju Shen,et al.  Layer Depth Denoising and Completion for Structured-Light RGB-D Cameras , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Ennio Gambi,et al.  Kinect as a Tool for Gait Analysis: Validation of a Real-Time Joint Extraction Algorithm Working in Side View , 2015, Sensors.

[5]  Cheng Yang,et al.  Autonomous Gait Event Detection with Portable Single-Camera Gait Kinematics Analysis System , 2016, J. Sensors.

[6]  J. P. Paul Gait analysis. , 1989, Annals of the rheumatic diseases.

[7]  Deirdre R Dawson,et al.  Reliability and construct validity of a revised Baycrest Multiple Errands Test , 2017, Neuropsychological rehabilitation.

[8]  Cheng Yang,et al.  Kinematics Analysis Multimedia System for Rehabilitation , 2015, ICIAP Workshops.

[9]  Cheng Yang,et al.  Gait analysis using a single depth camera , 2015, 2015 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[10]  Andreas Hein,et al.  Skeleton Timed Up and Go , 2012, 2012 IEEE International Conference on Bioinformatics and Biomedicine.

[11]  Luis Salgado,et al.  Adaptive spatio-temporal filter for low-cost camera depth maps , 2012, 2012 IEEE International Conference on Emerging Signal Processing Applications.

[12]  Ruigang Yang,et al.  Accurate 3D pose estimation from a single depth image , 2011, 2011 International Conference on Computer Vision.

[13]  P. Langhorne,et al.  Motor recovery after stroke: a systematic review , 2009, The Lancet Neurology.

[14]  Tony Lindeberg,et al.  Feature Detection with Automatic Scale Selection , 1998, International Journal of Computer Vision.

[15]  Begonya Garcia-Zapirain,et al.  Gait Analysis Methods: An Overview of Wearable and Non-Wearable Systems, Highlighting Clinical Applications , 2014, Sensors.

[16]  Neil Genzlinger A. and Q , 2006 .

[17]  CHENG YANG,et al.  Human Upper Limb Motion Analysis for Post-Stroke Impairment Assessment Using Video Analytics , 2016, IEEE Access.

[18]  M. Duncan Bézier Curves I , 2005 .

[19]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[20]  Ullrich Köthe,et al.  Edge and Junction Detection with an Improved Structure Tensor , 2003, DAGM-Symposium.

[21]  Venkat N. Krovi,et al.  A Comparative Study of Human Motion Capture and Computational Analysis Tools , 2013 .

[22]  Qingguo Li,et al.  Concurrent validation of Xsens MVN measurement of lower limb joint angular kinematics , 2013, Physiological measurement.

[23]  Kade Paterson,et al.  Instrumenting gait assessment using the Kinect in people living with stroke: reliability and association with balance tests , 2015, Journal of NeuroEngineering and Rehabilitation.

[24]  Hanan Samet,et al.  Efficient Component Labeling of Images of Arbitrary Dimension Represented by Linear Bintrees , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  Stefan Hinz,et al.  Fast and subpixel precise blob detection and attribution , 2005, IEEE International Conference on Image Processing 2005.

[26]  Jean Meunier,et al.  Gait Analysis from Video: Camcorders vs. Kinect , 2014, ICIAR.

[27]  H. Macher,et al.  FIRST EXPERIENCES WITH KINECT V2 SENSOR FOR CLOSE RANGE 3D MODELLING , 2015 .

[28]  Christoph S. Garbe,et al.  Denoising Time-Of-Flight Data with Adaptive Total Variation , 2011, ISVC.

[29]  Sergio Escalera,et al.  Automatic digital biometry analysis based on depth maps , 2013, Comput. Ind..

[30]  Ran Gilad-Bachrach,et al.  Full body gait analysis with Kinect , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[31]  Shaou-Gang Miaou,et al.  A vision-based walking posture analysis system without markers , 2010, 2010 2nd International Conference on Signal Processing Systems.

[32]  Max K. Agoston,et al.  Computer graphics and geometric modelling - implementation and algorithms , 2005 .

[33]  Lin Yang,et al.  Evaluating and Improving the Depth Accuracy of Kinect for Windows v2 , 2015, IEEE Sensors Journal.

[34]  Philip Rowe,et al.  Kinect-based lower limb motion analysis , 2015 .

[35]  Oscar C. Au,et al.  Depth map denoising using graph-based transform and group sparsity , 2013, 2013 IEEE 15th International Workshop on Multimedia Signal Processing (MMSP).

[36]  Danijela Ristic-Durrant,et al.  A robust markerless vision-based human gait analysis system , 2011, 2011 6th IEEE International Symposium on Applied Computational Intelligence and Informatics (SACI).